Sep 11 13:17:37.988185 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 13:17:37.988198 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 13:17:37.988205 ip-10-0-140-8 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 13:17:37.988381 ip-10-0-140-8 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 13:17:48.158635 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 13:17:48.158656 ip-10-0-140-8 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7bbe6e893bef44059370e71bc7c5856b --
Sep 11 13:19:42.363764 ip-10-0-140-8 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 13:19:42.692186 ip-10-0-140-8 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 13:19:42.692186 ip-10-0-140-8 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 13:19:42.692186 ip-10-0-140-8 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 13:19:42.692186 ip-10-0-140-8 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 13:19:42.692186 ip-10-0-140-8 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 13:19:42.694255 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.694159    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 13:19:42.697880 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697856    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:42.697880 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697879    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:42.697880 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697883    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697887    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697891    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697894    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697898    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697901    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697903    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697906    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697909    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697911    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697914    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697917    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697919    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697922    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697925    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697927    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697930    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697943    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697947    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:42.697979 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697950    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697953    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697956    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697959    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697962    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697965    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697968    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697970    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697975    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697978    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697981    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697984    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697987    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697990    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697993    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697995    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.697998    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698000    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698003    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698006    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:42.698463 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698008    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698011    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698014    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698016    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698019    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698021    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698024    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698026    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698029    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698031    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698034    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698038    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698041    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698043    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698046    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698050    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698053    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698055    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698058    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698060    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:42.698954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698064    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698067    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698070    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698073    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698075    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698079    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698082    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698085    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698087    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698091    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698095    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698098    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698101    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698104    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698106    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698109    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698112    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698115    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698117    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:42.699502 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698120    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698123    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698125    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698129    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698131    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698134    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698137    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698139    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698142    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698145    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698147    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698150    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698153    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698156    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698160    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698164    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698166    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698168    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698171    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698940    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:42.699978 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698948    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698951    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698954    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698957    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698960    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698963    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698966    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698969    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698972    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698975    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698977    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698980    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698982    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698985    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698987    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698991    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698993    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.698997    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699001    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699004    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:42.700499 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699007    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699009    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699012    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699014    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699018    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699021    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699023    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699026    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699029    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699032    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699034    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699037    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699039    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699042    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699044    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699048    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699050    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699053    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699055    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699058    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:42.701008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699061    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699063    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699066    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699068    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699071    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699073    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699076    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699082    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699085    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699087    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699090    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699093    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699096    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699098    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699101    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699104    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699106    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699109    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699111    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:42.701537 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699113    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699118    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699121    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699125    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699127    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699130    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699133    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699135    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699138    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699140    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699143    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699145    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699148    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699151    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699154    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699156    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699159    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699162    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699164    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699167    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:42.702008 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699171    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699174    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699177    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699179    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699183    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699187    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699190    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699193    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699196    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699198    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699201    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699203    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699206    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699209    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699211    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699213    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699216    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699218    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699221    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:42.702543 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699642    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699647    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699650    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699653    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699656    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699659    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699661    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699664    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699666    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699669    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699672    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699674    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699676    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699681    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699685    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699688    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699690    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699693    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699697    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:42.703019 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699699    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699703    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699707    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699710    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699713    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699716    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699719    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699721    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699724    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699727    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699729    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699732    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699735    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699737    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699740    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699742    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699745    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699748    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699750    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:42.703508 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699754    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699756    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699759    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699761    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699764    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699767    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699769    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699774    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699776    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699779    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699782    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699784    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699786    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699790    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699792    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699794    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699797    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699799    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699802    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699804    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:42.703971 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699807    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699809    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699812    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699814    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699817    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699820    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699822    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699825    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699827    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699830    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699832    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699836    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699839    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699842    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699845    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699847    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699850    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699852    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699855    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699860    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:42.704534 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699862    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699865    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699867    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699871    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699875    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699878    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699881    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699884    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699887    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699889    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699892    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699894    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699898    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699900    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699903    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699905    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699908    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699910    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699913    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:42.705027 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699917    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.699920    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700001    2547 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700038    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700047    2547 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700052    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700057    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700060    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700065    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700070    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700073    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700076    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700081    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700084    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700087    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700090    2547 flags.go:64] FLAG: --cgroup-root=""
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700093    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700096    2547 flags.go:64] FLAG: --client-ca-file=""
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700099    2547 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700102    2547 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700109    2547 flags.go:64] FLAG: --cluster-domain=""
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700113    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700116    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700119    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 13:19:42.705498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700122    2547 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700126    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700129    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700133    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700136    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700139    2547 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700142    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700145    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700148    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700151    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700156    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700159    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700163    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700166    2547 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700169    2547 flags.go:64] FLAG: --enable-server="true"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700173    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700177    2547 flags.go:64] FLAG: --event-burst="100"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700181    2547 flags.go:64] FLAG: --event-qps="50"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700184    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700187    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700190    2547 flags.go:64] FLAG: --eviction-hard=""
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700194    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700197    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700200    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700204    2547 flags.go:64] FLAG: --eviction-soft=""
Sep 11 13:19:42.706166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700207    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700210    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700213    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700216    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700220    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700223    2547 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700227    2547 flags.go:64] FLAG: --feature-gates=""
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700230    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700233    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700237    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700240    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700243    2547 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700246    2547 flags.go:64] FLAG: --help="false"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700249    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-140-8.ec2.internal"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700252    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700255    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700258    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700261    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700264    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700269    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700272    2547 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700274    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700277    2547 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 13:19:42.706912 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700281    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700284    2547 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700287    2547 flags.go:64] FLAG: --kube-reserved=""
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700290    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700293    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700296    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700299    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700303    2547 flags.go:64] FLAG: --lock-file=""
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700306    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700309    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700312    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700317    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700320    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700323    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700327    2547 flags.go:64] FLAG: --logging-format="text"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700331    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700335    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700338    2547 flags.go:64] FLAG: --manifest-url=""
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700340    2547 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700345    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700348    2547 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700352    2547 flags.go:64] FLAG: --max-pods="110"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700355    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700359    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700362    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 13:19:42.707557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700365    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700368    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700371    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700376    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700383    2547 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700386    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700389    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700392    2547 flags.go:64] FLAG: --pod-cidr=""
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700396    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700402    2547 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700405    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700408    2547 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700424    2547 flags.go:64] FLAG: --port="10250"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700427    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700431    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002946042ac65e105"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700434    2547 flags.go:64] FLAG: --qos-reserved=""
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700437    2547 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700440    2547 flags.go:64] FLAG: --register-node="true"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700443    2547 flags.go:64] FLAG: --register-with-taints=""
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700447    2547 flags.go:64] FLAG: --registry-burst="10"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700451    2547 flags.go:64] FLAG: --registry-qps="5"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700453    2547 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700457    2547 flags.go:64] FLAG: --reserved-memory=""
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700461    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700464    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 13:19:42.708236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700468    2547 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700470    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700473    2547 flags.go:64] FLAG: --runonce="false"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700476    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700479    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700482    2547 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700485    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700488    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700490    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700494    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700498    2547 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700503    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700506    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700509    2547 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700512    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700515    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700518    2547 flags.go:64] FLAG: --system-cgroups=""
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700521    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700527    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700530    2547 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700533    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700537    2547 flags.go:64] FLAG: --tls-min-version=""
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700540    2547 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700542    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700545    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 13:19:42.708891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700548    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700551    2547 flags.go:64] FLAG: --v="2"
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700555    2547 flags.go:64] FLAG: --version="false"
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700559    2547 flags.go:64] FLAG: --vmodule=""
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700563    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.700567    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700726    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700730    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700734    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700738    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700742    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700745    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700748    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700751    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700754    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700756    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700759    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700763    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700768    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700771    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700774    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:42.709869 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700777    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700780    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700783    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700786    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700789    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700791    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700794    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700797    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700799    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700802    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700805    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700807    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700812    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700816    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700819    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700822    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700825    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700828    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700831    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:42.710507 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700834    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700837    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700840    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700843    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700845    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700848    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700851    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700853    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700856    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700860    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700864    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700867    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700870    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700872    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700875    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700877    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700880    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700883    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700886    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700888    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:42.710989 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700891    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700893    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700896    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700899    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700901    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700904    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700906    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700909    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700912    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700914    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700917    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700920    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700922    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700925    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700928    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700930    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700933    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700935    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700938    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700940    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:42.711511 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700943    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700947    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700951    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700954    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700957    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700959    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700962    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700964    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700967    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700970    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700972    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700975    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700977    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700980    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700982    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700985    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700987    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700990    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700992    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700995    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:42.712010 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.700998    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.701000    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.701004    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.701008    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.701011    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.701020    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.710268    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.710290    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.710937    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.710946    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711013    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711020    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711024    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711027    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:42.712566 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711030    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711033    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711035    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711039    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711042    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711045    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711047    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711050    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711053    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711057    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711060    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711062    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711065    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711068    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711071    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711074    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711077    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711079    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711082    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711085    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:42.712921 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711088    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711091    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711093    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711097    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711099    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711103    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711106    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711109    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711111    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711114    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711117    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711120    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711122    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711125    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711128    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711130    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711133    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711135    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711138    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711141    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:42.713409 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711144    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711146    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711151    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711154    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711156    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711159    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711163    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711167    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711170    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711172    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711175    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711178    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711181    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711183    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711186    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711190    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711193    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711196    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711199    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:42.713912 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711202    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711205    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711208    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711210    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711213    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711216    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711219    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711222    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711224    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711227    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711230    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711233    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711235    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711240    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711244    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711247    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711250    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711254    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711256    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:42.714392 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711259    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711262    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711266    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711269    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711272    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711275    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711278    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711281    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711283    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711286    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711289    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711292    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711295    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711298    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711300    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711303    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:42.714901 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711306    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.711311    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711455    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711462    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711465    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711468    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711472    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711475    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711478    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711481    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711484    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711486    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711489    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711492    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 13:19:42.715340 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711495    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711498    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711501    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711503    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711506    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711508    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711511    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711514    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711517    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711520    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711523    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711525    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711529    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711532    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711535    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711538    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711540    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711543    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711546    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711548    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 13:19:42.715778 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711551    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711553    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711556    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711559    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711561    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711564    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711567    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711569    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711572    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711574    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711577    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711579    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711582    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711585    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711588    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711590    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711593    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711597    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711602    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 13:19:42.716290 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711606    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711609    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711612    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711615    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711618    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711622    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711625    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711628    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711630    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711633    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711636    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711639    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711641    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711645    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711647    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711650    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711653    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711656    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711658    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711661    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 13:19:42.716766 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711663    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711665    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711668    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711670    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711673    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711675    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711678    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711681    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711684    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711687    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711689    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711692    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711695    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711698    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711700    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711703    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711705    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711708    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711711    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711713    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 13:19:42.717253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711716    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711718    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711721    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711723    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711726    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711729    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711732    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:42.711736    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.711742    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.711885    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.715367    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.716233    2547 server.go:1019] "Starting client certificate rotation"
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.716342    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 13:19:42.717757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.716384    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 13:19:42.718543 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.718525    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 13:19:42.724776 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.724754    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 13:19:42.739647 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.739621    2547 log.go:25] "Validated CRI v1 runtime API"
Sep 11 13:19:42.742947 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.742931    2547 log.go:25] "Validated CRI v1 image API"
Sep 11 13:19:42.745232 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.745207    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 13:19:42.747902 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.747875    2547 fs.go:135] Filesystem UUIDs: map[14b2ea0f-e604-4d7d-94f3-f0f2441f8190:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f5757e3e-dc27-4713-be13-7f38da71fc70:/dev/nvme0n1p3]
Sep 11 13:19:42.747988 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.747898    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 13:19:42.753125 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.753101    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 13:19:42.754692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.754562    2547 manager.go:216] Machine: {Timestamp:2026-09-11 13:19:42.753071156 +0000 UTC m=+0.288112705 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099255 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2622f0d224da6790e1fc41f8c68f34 SystemUUID:ec2622f0-d224-da67-90e1-fc41f8c68f34 BootID:7bbe6e89-3bef-4405-9370-e71bc7c5856b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:05:df:dc:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:05:df:dc:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:aa:05:67:35:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 13:19:42.754692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.754681    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 13:19:42.754895 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.754870    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 13:19:42.758685 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.758645    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 13:19:42.758868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.758688    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 13:19:42.760272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.760257    2547 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 13:19:42.760272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.760273    2547 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 13:19:42.760340 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.760281    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 13:19:42.761111 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.761100    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 13:19:42.762354 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.762339    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 13:19:42.766942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.766924    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 13:19:42.767089 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.767078    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 13:19:42.767128 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.767112    2547 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 13:19:42.767165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.767130    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 13:19:42.767165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.767161    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 13:19:42.767640 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.767628    2547 kubelet.go:398] "Adding apiserver pod source"
Sep 11 13:19:42.767703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.767647    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 13:19:42.768126 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.768112    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 13:19:42.768186 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.768137    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 13:19:42.772720 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.772693    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 13:19:42.775051 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.775034    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 13:19:42.775147 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.775065    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 13:19:42.777142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777125    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 13:19:42.777142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777145    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777151    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777156    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777165    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777174    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777191    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777197    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777204    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777210    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777218    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 13:19:42.777248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.777224    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 13:19:42.778131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.778120    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 13:19:42.778164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.778132    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 13:19:42.779632 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.779610    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 13:19:42.779684 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.779629    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 13:19:42.782164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.782150    2547 server.go:1268] "Started kubelet"
Sep 11 13:19:42.782268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.782239    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 13:19:42.782333 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.782287    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 13:19:42.782387 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.782354    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 13:19:42.783138 ip-10-0-140-8 systemd[1]: Started Kubernetes Kubelet.
Sep 11 13:19:42.783959 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.783935    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 13:19:42.784065 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.783998    2547 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 13:19:42.789540 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.789520    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 13:19:42.789933 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.789914    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 13:19:42.790713 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.789547    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18d446c965bbc933  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-09-11 13:19:42.782105907 +0000 UTC m=+0.317147457,LastTimestamp:2026-09-11 13:19:42.782105907 +0000 UTC m=+0.317147457,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}"
Sep 11 13:19:42.790803 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.790745    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 13:19:42.791467 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.791450    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 13:19:42.791620 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.791586    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:42.792262 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792246    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 13:19:42.792262 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792249    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 13:19:42.792389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792277    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 13:19:42.792468 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792407    2547 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 13:19:42.792468 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792434    2547 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 13:19:42.792559 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792526    2547 factory.go:153] Registering CRI-O factory
Sep 11 13:19:42.792559 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792543    2547 factory.go:223] Registration of the crio container factory successfully
Sep 11 13:19:42.792641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792601    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 13:19:42.792641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792612    2547 factory.go:55] Registering systemd factory
Sep 11 13:19:42.792641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792621    2547 factory.go:223] Registration of the systemd container factory successfully
Sep 11 13:19:42.792641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792638    2547 factory.go:103] Registering Raw factory
Sep 11 13:19:42.792807 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.792651    2547 manager.go:1196] Started watching for new ooms in manager
Sep 11 13:19:42.793018 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.793005    2547 manager.go:349] Starting recovery of all containers
Sep 11 13:19:42.794731 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.794702    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 13:19:42.794840 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.794821    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 13:19:42.802483 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.802341    2547 manager.go:354] Recovery completed
Sep 11 13:19:42.808264 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.808244    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:42.810102 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.810079    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:42.810225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.810120    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:42.810225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.810135    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:42.811084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811063    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 13:19:42.811084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811080    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 13:19:42.811211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811092    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:42.811211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811100    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 13:19:42.811905 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811886    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:42.811953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811917    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:42.811953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.811929    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:42.813349 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.813336    2547 policy_none.go:49] "None policy: Start"
Sep 11 13:19:42.813391 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.813353    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 13:19:42.813391 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.813362    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 13:19:42.815400 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.815388    2547 policy_none.go:47] "Start"
Sep 11 13:19:42.828723 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.828620    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18d446c96766f755  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-09-11 13:19:42.810101589 +0000 UTC m=+0.345143141,LastTimestamp:2026-09-11 13:19:42.810101589 +0000 UTC m=+0.345143141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}"
Sep 11 13:19:42.841698 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.841601    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18d446c9676759a2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-09-11 13:19:42.810126754 +0000 UTC m=+0.345168310,LastTimestamp:2026-09-11 13:19:42.810126754 +0000 UTC m=+0.345168310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}"
Sep 11 13:19:42.844163 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844147    2547 manager.go:337] "Starting Device Plugin manager"
Sep 11 13:19:42.844229 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.844198    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 13:19:42.844229 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844212    2547 server.go:87] "Starting device plugin registration server"
Sep 11 13:19:42.844642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844629    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 13:19:42.844703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844645    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 13:19:42.844868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844839    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 13:19:42.844922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844916    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 13:19:42.844974 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.844924    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 13:19:42.845735 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.845628    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 13:19:42.845735 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.845673    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:42.873462 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.855234    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18d446c96767900c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-8.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-09-11 13:19:42.810140684 +0000 UTC m=+0.345182236,LastTimestamp:2026-09-11 13:19:42.810140684 +0000 UTC m=+0.345182236,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}"
Sep 11 13:19:42.873462 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.865909    2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-8.ec2.internal.18d446c96766f755\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18d446c96766f755  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-09-11 13:19:42.810101589 +0000 UTC m=+0.345143141,LastTimestamp:2026-09-11 13:19:42.811904759 +0000 UTC m=+0.346946308,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}"
Sep 11 13:19:42.873462 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.872617    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8cdb"
Sep 11 13:19:42.879497 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.879387    2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-8.ec2.internal.18d446c9676759a2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18d446c9676759a2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-09-11 13:19:42.810126754 +0000 UTC m=+0.345168310,LastTimestamp:2026-09-11 13:19:42.811922399 +0000 UTC m=+0.346963948,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}"
Sep 11 13:19:42.882660 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.882634    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8cdb"
Sep 11 13:19:42.918227 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.918183    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 13:19:42.919473 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.919442    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 13:19:42.919600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.919507    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 13:19:42.919600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.919538    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 13:19:42.919600 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.919585    2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 13:19:42.922145 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.922127    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:42.945499 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.945359    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:42.947365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.947346    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:42.947477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.947380    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:42.947477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.947398    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:42.947477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.947437    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-8.ec2.internal"
Sep 11 13:19:42.962322 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:42.962298    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-8.ec2.internal"
Sep 11 13:19:42.962467 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:42.962333    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-8.ec2.internal\": node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.017994 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.017963    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.020014 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.019992    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"]
Sep 11 13:19:43.020114 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.020079    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:43.021242 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.021223    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:43.021351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.021257    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:43.021351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.021268    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:43.023731 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.023718    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:43.023841 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.023826    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.023882 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.023857    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:43.024600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.024583    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:43.024688 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.024610    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:43.024688 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.024621    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:43.024688 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.024584    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:43.024820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.024697    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:43.024820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.024715    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:43.026899 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.026885    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.026955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.026911    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 13:19:43.027851 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.027825    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 13:19:43.027925 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.027860    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 13:19:43.027925 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.027876    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID"
Sep 11 13:19:43.051324 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.051298    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.055702 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.055683    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.093830 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.093801    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4bdfbde465325de64ecce647f250262-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"a4bdfbde465325de64ecce647f250262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.093952 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.093837    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4bdfbde465325de64ecce647f250262-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"a4bdfbde465325de64ecce647f250262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.093952 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.093858    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40ebe202d4a2d8cca9cb5126efaa8412-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"40ebe202d4a2d8cca9cb5126efaa8412\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.118749 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.118712    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.194538 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.194504    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40ebe202d4a2d8cca9cb5126efaa8412-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"40ebe202d4a2d8cca9cb5126efaa8412\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.194538 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.194539    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4bdfbde465325de64ecce647f250262-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"a4bdfbde465325de64ecce647f250262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.194744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.194557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4bdfbde465325de64ecce647f250262-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"a4bdfbde465325de64ecce647f250262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.194744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.194611    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40ebe202d4a2d8cca9cb5126efaa8412-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"40ebe202d4a2d8cca9cb5126efaa8412\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.194744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.194667    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4bdfbde465325de64ecce647f250262-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"a4bdfbde465325de64ecce647f250262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.194744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.194697    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4bdfbde465325de64ecce647f250262-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"a4bdfbde465325de64ecce647f250262\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.219812 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.219748    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.320674 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.320640    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.353514 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.353482    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.358992 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.358799    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.421520 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.421487    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.522106 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.522040    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.622715 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.622656    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found"
Sep 11 13:19:43.677538 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.677503    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:43.680930 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.680909    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:43.691654 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.691625    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.715823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.715797    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 13:19:43.716311 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.716294    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 13:19:43.716474 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.716457    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 13:19:43.716551 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.716470    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 13:19:43.716551 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.716489    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 13:19:43.717170 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.717154    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"
Sep 11 13:19:43.755756 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.755730    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 13:19:43.767860 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.767831    2547 apiserver.go:52] "Watching apiserver"
Sep 11 13:19:43.777378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.777272    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 13:19:43.779779 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.779745    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-kfwz8","openshift-multus/network-metrics-daemon-zzf9j","openshift-network-diagnostics/network-check-target-76vfp","openshift-ovn-kubernetes/ovnkube-node-rsvqf","kube-system/global-pull-secret-syncer-cxcf7","kube-system/konnectivity-agent-mljf5","kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nzwn9","openshift-dns/node-resolver-c2vxd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal","openshift-network-operator/iptables-alerter-ckd9l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g","openshift-image-registry/node-ca-vn8ph","openshift-multus/multus-additional-cni-plugins-pknmv"]
Sep 11 13:19:43.782232 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.782207    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.784985 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.784963    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 13:19:43.785505 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.785484    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:43.785581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.785536    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.785581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.785573    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.785657 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.785574    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:43.785657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.785647    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2q9k5\""
Sep 11 13:19:43.787696 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.787678    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:43.787770 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.787751    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:43.790105 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.790082    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.790966 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.790948    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 13:19:43.792806 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.792787    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.792924 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.792856    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:43.795483 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.795460    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:43.795738 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.795616    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 13:19:43.795738 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.795624    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.795738 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.795617    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 13:19:43.795954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.795938    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 13:19:43.796852 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.796835    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.796920 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.796835    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 13:19:43.797576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.797558    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8v24g\""
Sep 11 13:19:43.798148 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85ks\" (UniqueName: \"kubernetes.io/projected/49ce5973-5472-4798-aaac-5fcf1913ff49-kube-api-access-p85ks\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.798337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:43.798337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798224    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3fc972e-a8f3-435e-82ae-f1d703a6c534-dbus\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.798337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798231    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.798337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798252    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqdmm\" (UniqueName: \"kubernetes.io/projected/90de78bd-4709-4ea2-879f-1178fcecf024-kube-api-access-sqdmm\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:43.798337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-var-lib-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798353    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798382    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-run-netns\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798408    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-ovn\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798446    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-log-socket\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798469    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-cni-bin\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798498    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ce5973-5472-4798-aaac-5fcf1913ff49-host\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798551    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-slash\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798589    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8tw8\" (UniqueName: \"kubernetes.io/projected/d2f680ef-2d0d-492e-9620-91150a3a477c-kube-api-access-k8tw8\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798617    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49ce5973-5472-4798-aaac-5fcf1913ff49-serviceca\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798644    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798674    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-env-overrides\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798700    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2f680ef-2d0d-492e-9620-91150a3a477c-ovn-node-metrics-cert\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798738    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-ovnkube-script-lib\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798767    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798803    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-kubelet\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798837    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-systemd\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798868    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-node-log\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798889    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-cni-netd\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798903    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-systemd-units\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.798922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798921    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-etc-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.799272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798947    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.799272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798973    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.799272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.798999    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-ovnkube-config\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.799272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.799029    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3fc972e-a8f3-435e-82ae-f1d703a6c534-kubelet-config\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.799858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.799839    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 13:19:43.800062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.800048    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 13:19:43.800996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.800975    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-km84p\""
Sep 11 13:19:43.801375 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.801350    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.803818 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.803799    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:43.804653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.804599    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 13:19:43.804653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.804645    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.804833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.804661    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.804833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.804651    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 13:19:43.804833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.804776    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sk2t2\""
Sep 11 13:19:43.805243 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.805225    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.805809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.805794    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kfjg5\""
Sep 11 13:19:43.805809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.805803    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.806160 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.806145    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.806229 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.806157    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.806698 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.806683    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4b6fr\""
Sep 11 13:19:43.806769 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.806734    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.809010 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.808989    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:43.809564 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.809545    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 13:19:43.809669 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.809550    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 13:19:43.809729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.809685    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7h5kz\""
Sep 11 13:19:43.811729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.811705    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.824432 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.824386    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 13:19:43.824617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.824506    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.824617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.824533    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.825708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.825682    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:19:43.825708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.825693    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8mc9b\""
Sep 11 13:19:43.825896 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.825770    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 13:19:43.827015 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.826982    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 13:19:43.829025 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.827889    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tnvj2\""
Sep 11 13:19:43.830881 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.829905    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 13:19:43.853578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.853557    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:43.886074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.886022    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 13:14:44 +0000 UTC" deadline="2028-02-28 06:30:03.817512288 +0000 UTC"
Sep 11 13:19:43.886074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.886069    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12833h10m19.931447424s"
Sep 11 13:19:43.892999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.892976    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 13:19:43.894274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.894257    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-frj2p"
Sep 11 13:19:43.899494 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899468    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-ovn\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899498    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-log-socket\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899521    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-cni-binary-copy\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n96jx\" (UniqueName: \"kubernetes.io/projected/b22e3a36-6aeb-4069-b872-cc45d076973a-kube-api-access-n96jx\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899563    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-registration-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899580    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-ovn\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899587    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899588    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-log-socket\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.899623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899616    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ce5973-5472-4798-aaac-5fcf1913ff49-host\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899631    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-systemd\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899646    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b22e3a36-6aeb-4069-b872-cc45d076973a-host-slash\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899664    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrxv\" (UniqueName: \"kubernetes.io/projected/46011153-b863-42c5-94da-b3fc4e5b75b2-kube-api-access-7qrxv\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899689    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49ce5973-5472-4798-aaac-5fcf1913ff49-serviceca\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899710    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ce5973-5472-4798-aaac-5fcf1913ff49-host\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899749    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-env-overrides\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899829    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2f680ef-2d0d-492e-9620-91150a3a477c-ovn-node-metrics-cert\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899862    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899889    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-etc-kubernetes\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899914    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-device-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.899942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899944    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-node-log\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899969    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-cni-netd\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899991    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-conf-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.899996    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-node-log\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.900011    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900040    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-cni-netd\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.900101    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:44.400076976 +0000 UTC m=+1.935118532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900015    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xkvk\" (UniqueName: \"kubernetes.io/projected/8a53247d-9ee5-488b-a192-c3edd196ea81-kube-api-access-2xkvk\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900141    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d54940d9-3814-41a3-b61c-9bc85f85106e-hosts-file\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900215    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysctl-d\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900147    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49ce5973-5472-4798-aaac-5fcf1913ff49-serviceca\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-systemd-units\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900183    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-env-overrides\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900278    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-systemd-units\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900310    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da3487fb-8404-41d2-bb6d-df7679b34a69-konnectivity-ca\") pod \"konnectivity-agent-mljf5\" (UID: \"da3487fb-8404-41d2-bb6d-df7679b34a69\") " pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900343    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-system-cni-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900363    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-hostroot\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.900408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-var-lib-kubelet\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900456    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-cni-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900484    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a53247d-9ee5-488b-a192-c3edd196ea81-cni-binary-copy\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900507    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-daemon-config\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900531    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b22e3a36-6aeb-4069-b872-cc45d076973a-iptables-alerter-script\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900556    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-sys-fs\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900590    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900617    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-cni-bin\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900620    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900643    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-host\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900663    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-tmp\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900689    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900711    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffght\" (UniqueName: \"kubernetes.io/projected/a96da024-eefc-457c-affa-ea6a20c48011-kube-api-access-ffght\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900746    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-var-lib-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900789    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-var-lib-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900818    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900859    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-netns\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.901213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900893    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900936    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-lib-modules\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.900978    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901013    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-run-netns\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901034    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-run-netns\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901051    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-cni-bin\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901076    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-kubernetes\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901109    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-cni-bin\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-tuned\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901148    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-system-cni-dir\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901170    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-slash\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901191    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8tw8\" (UniqueName: \"kubernetes.io/projected/d2f680ef-2d0d-492e-9620-91150a3a477c-kube-api-access-k8tw8\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901210    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-cnibin\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901229    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-k8s-cni-cncf-io\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901258    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-kubelet\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901279    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901301    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-slash\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901337    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdrxz\" (UniqueName: \"kubernetes.io/projected/d54940d9-3814-41a3-b61c-9bc85f85106e-kube-api-access-rdrxz\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901367    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-ovnkube-script-lib\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901511    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d54940d9-3814-41a3-b61c-9bc85f85106e-tmp-dir\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.901528    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901540    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-sys\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901560    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-kubelet\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.901590    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:44.401569605 +0000 UTC m=+1.936611155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901595    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-kubelet\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901606    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-systemd\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901626    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-multus-certs\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901632    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-systemd\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901643    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-etc-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901664    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-etc-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901665    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901689    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-run-openvswitch\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901688    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.902691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901713    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f680ef-2d0d-492e-9620-91150a3a477c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901719    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-ovnkube-config\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901754    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-socket-dir-parent\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901770    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-run\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901784    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-cnibin\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901805    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901823    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3fc972e-a8f3-435e-82ae-f1d703a6c534-kubelet-config\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901867    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3fc972e-a8f3-435e-82ae-f1d703a6c534-kubelet-config\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901871    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da3487fb-8404-41d2-bb6d-df7679b34a69-agent-certs\") pod \"konnectivity-agent-mljf5\" (UID: \"da3487fb-8404-41d2-bb6d-df7679b34a69\") " pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901891    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-ovnkube-script-lib\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901918    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-cni-multus\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901960    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-socket-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.901989    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85ks\" (UniqueName: \"kubernetes.io/projected/49ce5973-5472-4798-aaac-5fcf1913ff49-kube-api-access-p85ks\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902014    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3fc972e-a8f3-435e-82ae-f1d703a6c534-dbus\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902036    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-modprobe-d\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902076    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2f680ef-2d0d-492e-9620-91150a3a477c-ovnkube-config\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902084    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3fc972e-a8f3-435e-82ae-f1d703a6c534-dbus\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:43.903268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902099    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8928c\" (UniqueName: \"kubernetes.io/projected/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-kube-api-access-8928c\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.903795 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902128    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqdmm\" (UniqueName: \"kubernetes.io/projected/90de78bd-4709-4ea2-879f-1178fcecf024-kube-api-access-sqdmm\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:43.903795 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902223    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysconfig\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.903795 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.902250    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysctl-conf\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:43.904278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.904258    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2f680ef-2d0d-492e-9620-91150a3a477c-ovn-node-metrics-cert\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.905245 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.905219    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-frj2p"
Sep 11 13:19:43.918610 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.918582    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:43.918610 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.918609    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:43.918610 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.918620    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:43.918798 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:43.918690    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:19:44.418673076 +0000 UTC m=+1.953714629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:43.920739 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.920717    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqdmm\" (UniqueName: \"kubernetes.io/projected/90de78bd-4709-4ea2-879f-1178fcecf024-kube-api-access-sqdmm\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:43.924686 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.924662    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85ks\" (UniqueName: \"kubernetes.io/projected/49ce5973-5472-4798-aaac-5fcf1913ff49-kube-api-access-p85ks\") pod \"node-ca-vn8ph\" (UID: \"49ce5973-5472-4798-aaac-5fcf1913ff49\") " pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:43.924793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.924779    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8tw8\" (UniqueName: \"kubernetes.io/projected/d2f680ef-2d0d-492e-9620-91150a3a477c-kube-api-access-k8tw8\") pod \"ovnkube-node-rsvqf\" (UID: \"d2f680ef-2d0d-492e-9620-91150a3a477c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:43.960122 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:43.960074    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ebe202d4a2d8cca9cb5126efaa8412.slice/crio-5656be42a931d8f7295f2ea93d6872aff4b4af04967240a46956cb26a1325185 WatchSource:0}: Error finding container 5656be42a931d8f7295f2ea93d6872aff4b4af04967240a46956cb26a1325185: Status 404 returned error can't find the container with id 5656be42a931d8f7295f2ea93d6872aff4b4af04967240a46956cb26a1325185
Sep 11 13:19:43.961087 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:43.961062    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bdfbde465325de64ecce647f250262.slice/crio-13832afdc29fee11bf4592fbcd141aa6e400ffa334e5f00d1c53d9c207ec4ad3 WatchSource:0}: Error finding container 13832afdc29fee11bf4592fbcd141aa6e400ffa334e5f00d1c53d9c207ec4ad3: Status 404 returned error can't find the container with id 13832afdc29fee11bf4592fbcd141aa6e400ffa334e5f00d1c53d9c207ec4ad3
Sep 11 13:19:43.963873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:43.963856    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:19:44.003495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003446    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-kubernetes\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.003495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003494    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-tuned\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.003495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003510    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-system-cni-dir\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003543    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-cnibin\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003598    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-cnibin\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003601    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-system-cni-dir\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003628    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-k8s-cni-cncf-io\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003657    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-kubernetes\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003662    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-kubelet\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003691    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-k8s-cni-cncf-io\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003742    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-kubelet\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003711    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.003811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003773    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdrxz\" (UniqueName: \"kubernetes.io/projected/d54940d9-3814-41a3-b61c-9bc85f85106e-kube-api-access-rdrxz\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003834    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d54940d9-3814-41a3-b61c-9bc85f85106e-tmp-dir\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003857    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-sys\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003882    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-multus-certs\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003911    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-socket-dir-parent\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003951    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-sys\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003965    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-socket-dir-parent\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.003949    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-run\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004001    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-cnibin\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004031    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004035    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-multus-certs\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da3487fb-8404-41d2-bb6d-df7679b34a69-agent-certs\") pod \"konnectivity-agent-mljf5\" (UID: \"da3487fb-8404-41d2-bb6d-df7679b34a69\") " pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004080    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004001    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-run\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004087    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-cni-multus\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-socket-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004204    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d54940d9-3814-41a3-b61c-9bc85f85106e-tmp-dir\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004215    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-cnibin\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.004369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004232    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-modprobe-d\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004243    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-cni-multus\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8928c\" (UniqueName: \"kubernetes.io/projected/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-kube-api-access-8928c\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004307    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysconfig\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004330    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysctl-conf\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004343    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-socket-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004350    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-modprobe-d\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004399    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysconfig\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004443    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004481    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-cni-binary-copy\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004551    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n96jx\" (UniqueName: \"kubernetes.io/projected/b22e3a36-6aeb-4069-b872-cc45d076973a-kube-api-access-n96jx\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.004577    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysctl-conf\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005003    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-registration-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005180    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005219    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-systemd\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005247    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b22e3a36-6aeb-4069-b872-cc45d076973a-host-slash\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrxv\" (UniqueName: \"kubernetes.io/projected/46011153-b863-42c5-94da-b3fc4e5b75b2-kube-api-access-7qrxv\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005334    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-etc-kubernetes\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005386    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-device-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005448    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-conf-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-conf-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005562    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-cni-binary-copy\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005536    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005640    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b22e3a36-6aeb-4069-b872-cc45d076973a-host-slash\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005641    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-systemd\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.005728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005718    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xkvk\" (UniqueName: \"kubernetes.io/projected/8a53247d-9ee5-488b-a192-c3edd196ea81-kube-api-access-2xkvk\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005760    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d54940d9-3814-41a3-b61c-9bc85f85106e-hosts-file\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005785    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysctl-d\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005815    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da3487fb-8404-41d2-bb6d-df7679b34a69-konnectivity-ca\") pod \"konnectivity-agent-mljf5\" (UID: \"da3487fb-8404-41d2-bb6d-df7679b34a69\") " pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005849    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-system-cni-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005882    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-hostroot\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.005920    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-var-lib-kubelet\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-cni-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006076    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a53247d-9ee5-488b-a192-c3edd196ea81-cni-binary-copy\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006110    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-daemon-config\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006143    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b22e3a36-6aeb-4069-b872-cc45d076973a-iptables-alerter-script\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006175    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-sys-fs\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006227    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-cni-bin\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006248    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-registration-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006255    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-host\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006311    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-host\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.006321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006301    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-tmp\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006359    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006395    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffght\" (UniqueName: \"kubernetes.io/projected/a96da024-eefc-457c-affa-ea6a20c48011-kube-api-access-ffght\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006443    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-netns\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006500    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-lib-modules\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006539    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006785    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a96da024-eefc-457c-affa-ea6a20c48011-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006881    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-tuned\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.007120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006957    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-device-dir\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007562    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-daemon-config\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.006163    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-etc-kubernetes\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007648    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-system-cni-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007649    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-run-netns\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007707    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d54940d9-3814-41a3-b61c-9bc85f85106e-hosts-file\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007711    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-etc-sysctl-d\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007713    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-hostroot\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007812    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-multus-cni-dir\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007808    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a96da024-eefc-457c-affa-ea6a20c48011-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.007873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007877    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-var-lib-kubelet\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.009140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007908    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46011153-b863-42c5-94da-b3fc4e5b75b2-sys-fs\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.009140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007927    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a53247d-9ee5-488b-a192-c3edd196ea81-host-var-lib-cni-bin\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.009140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.008039    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-lib-modules\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.009140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.008292    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da3487fb-8404-41d2-bb6d-df7679b34a69-konnectivity-ca\") pod \"konnectivity-agent-mljf5\" (UID: \"da3487fb-8404-41d2-bb6d-df7679b34a69\") " pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:44.009140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.008373    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a53247d-9ee5-488b-a192-c3edd196ea81-cni-binary-copy\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.009140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.008770    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-tmp\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.009392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.007796    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b22e3a36-6aeb-4069-b872-cc45d076973a-iptables-alerter-script\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.010273 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.010253    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da3487fb-8404-41d2-bb6d-df7679b34a69-agent-certs\") pod \"konnectivity-agent-mljf5\" (UID: \"da3487fb-8404-41d2-bb6d-df7679b34a69\") " pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:44.021655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.021619    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n96jx\" (UniqueName: \"kubernetes.io/projected/b22e3a36-6aeb-4069-b872-cc45d076973a-kube-api-access-n96jx\") pod \"iptables-alerter-ckd9l\" (UID: \"b22e3a36-6aeb-4069-b872-cc45d076973a\") " pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.028244 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.028182    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrxv\" (UniqueName: \"kubernetes.io/projected/46011153-b863-42c5-94da-b3fc4e5b75b2-kube-api-access-7qrxv\") pod \"aws-ebs-csi-driver-node-c8j5g\" (UID: \"46011153-b863-42c5-94da-b3fc4e5b75b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.028827 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.028779    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8928c\" (UniqueName: \"kubernetes.io/projected/97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e-kube-api-access-8928c\") pod \"tuned-nzwn9\" (UID: \"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e\") " pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.029642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.029616    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xkvk\" (UniqueName: \"kubernetes.io/projected/8a53247d-9ee5-488b-a192-c3edd196ea81-kube-api-access-2xkvk\") pod \"multus-kfwz8\" (UID: \"8a53247d-9ee5-488b-a192-c3edd196ea81\") " pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.029921 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.029902    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdrxz\" (UniqueName: \"kubernetes.io/projected/d54940d9-3814-41a3-b61c-9bc85f85106e-kube-api-access-rdrxz\") pod \"node-resolver-c2vxd\" (UID: \"d54940d9-3814-41a3-b61c-9bc85f85106e\") " pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.032102 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.032077    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffght\" (UniqueName: \"kubernetes.io/projected/a96da024-eefc-457c-affa-ea6a20c48011-kube-api-access-ffght\") pod \"multus-additional-cni-plugins-pknmv\" (UID: \"a96da024-eefc-457c-affa-ea6a20c48011\") " pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.111846 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.111813    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vn8ph"
Sep 11 13:19:44.122558 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.122392    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ce5973_5472_4798_aaac_5fcf1913ff49.slice/crio-2b9856f4ecc665f14b85792afc849c7c65b6c924e06529499ee8e41f146e72a5 WatchSource:0}: Error finding container 2b9856f4ecc665f14b85792afc849c7c65b6c924e06529499ee8e41f146e72a5: Status 404 returned error can't find the container with id 2b9856f4ecc665f14b85792afc849c7c65b6c924e06529499ee8e41f146e72a5
Sep 11 13:19:44.133137 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.133113    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:19:44.141576 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.141547    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f680ef_2d0d_492e_9620_91150a3a477c.slice/crio-5c83cba574ba7eb1ca6ea5da1dfa2182444112d5b32b10c08aa3cd577788145f WatchSource:0}: Error finding container 5c83cba574ba7eb1ca6ea5da1dfa2182444112d5b32b10c08aa3cd577788145f: Status 404 returned error can't find the container with id 5c83cba574ba7eb1ca6ea5da1dfa2182444112d5b32b10c08aa3cd577788145f
Sep 11 13:19:44.149969 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.149941    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:19:44.158510 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.158481    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3487fb_8404_41d2_bb6d_df7679b34a69.slice/crio-28f9752c2b48bfbc2de0aeb6a1ea6a8d210e4c4abe39dc6da79402b8911dbaa2 WatchSource:0}: Error finding container 28f9752c2b48bfbc2de0aeb6a1ea6a8d210e4c4abe39dc6da79402b8911dbaa2: Status 404 returned error can't find the container with id 28f9752c2b48bfbc2de0aeb6a1ea6a8d210e4c4abe39dc6da79402b8911dbaa2
Sep 11 13:19:44.164938 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.164914    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kfwz8"
Sep 11 13:19:44.173382 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.173358    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a53247d_9ee5_488b_a192_c3edd196ea81.slice/crio-dc35f053ec21a7f4d7abb9c6b0797953d7325bed979bb285d0b21743512c38f3 WatchSource:0}: Error finding container dc35f053ec21a7f4d7abb9c6b0797953d7325bed979bb285d0b21743512c38f3: Status 404 returned error can't find the container with id dc35f053ec21a7f4d7abb9c6b0797953d7325bed979bb285d0b21743512c38f3
Sep 11 13:19:44.187499 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.187467    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzwn9"
Sep 11 13:19:44.195631 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.195607    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97822bc6_b305_4c6a_a2e7_e0e9d57a4c0e.slice/crio-87831be83c5071ed0889eb7285f3397d16c9eac189dd584dba2128fe859ab844 WatchSource:0}: Error finding container 87831be83c5071ed0889eb7285f3397d16c9eac189dd584dba2128fe859ab844: Status 404 returned error can't find the container with id 87831be83c5071ed0889eb7285f3397d16c9eac189dd584dba2128fe859ab844
Sep 11 13:19:44.204926 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.204900    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2vxd"
Sep 11 13:19:44.213647 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.213617    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54940d9_3814_41a3_b61c_9bc85f85106e.slice/crio-a1b76f7985c3dbf39dcac6c0edf5a2dd699b73002fe53f2cffbcc9cde7fb660b WatchSource:0}: Error finding container a1b76f7985c3dbf39dcac6c0edf5a2dd699b73002fe53f2cffbcc9cde7fb660b: Status 404 returned error can't find the container with id a1b76f7985c3dbf39dcac6c0edf5a2dd699b73002fe53f2cffbcc9cde7fb660b
Sep 11 13:19:44.229971 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.229941    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pknmv"
Sep 11 13:19:44.238955 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.238929    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96da024_eefc_457c_affa_ea6a20c48011.slice/crio-d72bfc5f687ec7af436170e68f7d126e95e10026f9b98e956c790db1c4d3c93e WatchSource:0}: Error finding container d72bfc5f687ec7af436170e68f7d126e95e10026f9b98e956c790db1c4d3c93e: Status 404 returned error can't find the container with id d72bfc5f687ec7af436170e68f7d126e95e10026f9b98e956c790db1c4d3c93e
Sep 11 13:19:44.246538 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.246511    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ckd9l"
Sep 11 13:19:44.254322 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.254298    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g"
Sep 11 13:19:44.255655 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.255624    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22e3a36_6aeb_4069_b872_cc45d076973a.slice/crio-4710f3ef0ece8bd1300e46fa92448f55a0adbc6e5f6042d2cd7d922695686d6e WatchSource:0}: Error finding container 4710f3ef0ece8bd1300e46fa92448f55a0adbc6e5f6042d2cd7d922695686d6e: Status 404 returned error can't find the container with id 4710f3ef0ece8bd1300e46fa92448f55a0adbc6e5f6042d2cd7d922695686d6e
Sep 11 13:19:44.263177 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:19:44.263152    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46011153_b863_42c5_94da_b3fc4e5b75b2.slice/crio-aa749ef1cfeed1a2906365d3930035a45ef26cf9b720fcd881ea1560370421e8 WatchSource:0}: Error finding container aa749ef1cfeed1a2906365d3930035a45ef26cf9b720fcd881ea1560370421e8: Status 404 returned error can't find the container with id aa749ef1cfeed1a2906365d3930035a45ef26cf9b720fcd881ea1560370421e8
Sep 11 13:19:44.408736 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.408634    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:44.408736 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.408698    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:44.408933 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.408828    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:44.408933 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.408833    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:44.408933 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.408894    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:45.408876385 +0000 UTC m=+2.943917940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:44.408933 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.408919    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:45.408902738 +0000 UTC m=+2.943944273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:44.509474 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.509435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:44.509657 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.509610    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:44.509657 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.509640    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:44.509657 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.509656    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:44.509794 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.509726    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:19:45.509706894 +0000 UTC m=+3.044748433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:44.908303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.908205    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 13:14:45 +0000 UTC" deadline="2028-03-05 12:24:41.230691689 +0000 UTC"
Sep 11 13:19:44.908303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.908252    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12983h4m56.32244481s"
Sep 11 13:19:44.922550 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.922520    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:44.922725 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:44.922669    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:44.935170 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.935105    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2vxd" event={"ID":"d54940d9-3814-41a3-b61c-9bc85f85106e","Type":"ContainerStarted","Data":"a1b76f7985c3dbf39dcac6c0edf5a2dd699b73002fe53f2cffbcc9cde7fb660b"}
Sep 11 13:19:44.938470 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.938440    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"a4bdfbde465325de64ecce647f250262","Type":"ContainerStarted","Data":"13832afdc29fee11bf4592fbcd141aa6e400ffa334e5f00d1c53d9c207ec4ad3"}
Sep 11 13:19:44.956910 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.956749    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"40ebe202d4a2d8cca9cb5126efaa8412","Type":"ContainerStarted","Data":"5656be42a931d8f7295f2ea93d6872aff4b4af04967240a46956cb26a1325185"}
Sep 11 13:19:44.969736 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:44.969696    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g" event={"ID":"46011153-b863-42c5-94da-b3fc4e5b75b2","Type":"ContainerStarted","Data":"aa749ef1cfeed1a2906365d3930035a45ef26cf9b720fcd881ea1560370421e8"}
Sep 11 13:19:45.006762 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.006719    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ckd9l" event={"ID":"b22e3a36-6aeb-4069-b872-cc45d076973a","Type":"ContainerStarted","Data":"4710f3ef0ece8bd1300e46fa92448f55a0adbc6e5f6042d2cd7d922695686d6e"}
Sep 11 13:19:45.031187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.031093    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerStarted","Data":"d72bfc5f687ec7af436170e68f7d126e95e10026f9b98e956c790db1c4d3c93e"}
Sep 11 13:19:45.049011 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.048910    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzwn9" event={"ID":"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e","Type":"ContainerStarted","Data":"87831be83c5071ed0889eb7285f3397d16c9eac189dd584dba2128fe859ab844"}
Sep 11 13:19:45.063861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.063780    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kfwz8" event={"ID":"8a53247d-9ee5-488b-a192-c3edd196ea81","Type":"ContainerStarted","Data":"dc35f053ec21a7f4d7abb9c6b0797953d7325bed979bb285d0b21743512c38f3"}
Sep 11 13:19:45.079064 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.079024    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mljf5" event={"ID":"da3487fb-8404-41d2-bb6d-df7679b34a69","Type":"ContainerStarted","Data":"28f9752c2b48bfbc2de0aeb6a1ea6a8d210e4c4abe39dc6da79402b8911dbaa2"}
Sep 11 13:19:45.099774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.099735    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"5c83cba574ba7eb1ca6ea5da1dfa2182444112d5b32b10c08aa3cd577788145f"}
Sep 11 13:19:45.117130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.117058    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vn8ph" event={"ID":"49ce5973-5472-4798-aaac-5fcf1913ff49","Type":"ContainerStarted","Data":"2b9856f4ecc665f14b85792afc849c7c65b6c924e06529499ee8e41f146e72a5"}
Sep 11 13:19:45.209933 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:45.209852    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:46.739553 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:46.739512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:46.739729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:46.739597    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:46.739805 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.739733    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:46.739805 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.739794    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:48.739775353 +0000 UTC m=+4.952319137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:46.740217 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.740199    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:46.740292 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.740257    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:48.740238174 +0000 UTC m=+4.952781953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:46.840495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:46.840397    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:46.840667 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.840608    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:46.840667 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.840628    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:46.840667 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.840640    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:46.840812 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:46.840698    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:19:48.840680209 +0000 UTC m=+5.053223989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:47.231995 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:47.231855    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 13:14:45 +0000 UTC" deadline="2028-06-05 04:59:55.592530608 +0000 UTC"
Sep 11 13:19:47.231995 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:47.231932    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15183h40m8.360603118s"
Sep 11 13:19:47.242579 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:47.242277    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:47.242579 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:47.242414    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:47.242579 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:47.242496    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:47.242579 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:47.242570    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:47.485665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:47.485586    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:47.533212 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:47.533181    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 13:19:48.249260 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:48.249202    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:48.249720 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.249337    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:48.762820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:48.761889    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:48.762820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:48.761993    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:48.762820 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.762143    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:48.762820 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.762207    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:52.762189538 +0000 UTC m=+8.974733330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:48.762820 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.762596    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:48.762820 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.762647    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:19:52.762629689 +0000 UTC m=+8.975173481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:48.862671 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:48.862630    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:48.862870 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.862822    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:48.862870 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.862851    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:48.862870 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.862863    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:48.863050 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:48.862938    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:19:52.86290389 +0000 UTC m=+9.075447686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:49.242994 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:49.242897    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:49.243164 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:49.243052    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:49.243463 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:49.243440    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:49.243559 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:49.243539    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:50.245855 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:50.245328    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:50.245855 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:50.245473    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:51.242591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:51.242449    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:51.242591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:51.242499    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:51.242852 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:51.242618    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:51.243095 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:51.243061    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:52.242444 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:52.242408    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:52.243083 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.242559    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:52.799029 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:52.798987    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:52.799257 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:52.799090    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:52.799257 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.799164    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:52.799257 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.799219    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:52.799257 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.799244    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:00.799223701 +0000 UTC m=+17.011767490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:19:52.799486 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.799271    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:00.799258994 +0000 UTC m=+17.011802785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:19:52.900474 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:52.900369    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:52.900625 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.900535    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:19:52.900625 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.900561    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:19:52.900625 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.900575    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:52.900788 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:52.900640    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:20:00.90062024 +0000 UTC m=+17.113164025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:19:53.242692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:53.242604    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:53.243195 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:53.242744    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:53.243195 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:53.242611    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:53.243310 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:53.243194    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:54.243651 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:54.243618    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:54.244235 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:54.243737    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:55.243120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:55.243028    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:55.243301 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:55.243156    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:55.243528 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:55.243503    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:55.243631 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:55.243598    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:56.243398 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:56.243364    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:56.243820 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:56.243513    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:57.242617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:57.242575    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:57.242617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:57.242606    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:57.242854 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:57.242700    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:19:57.242854 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:57.242822    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:58.242296 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:58.242264    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:19:58.242725 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:58.242387    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:19:59.242499 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:59.242457    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:19:59.242499 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:19:59.242499    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:19:59.243058 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:59.242592    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:19:59.243058 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:19:59.242715    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:00.242755 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:00.242723    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:00.243178 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.242847    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:00.860759 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:00.860673    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:00.860759 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:00.860728    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:00.861024 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.860838    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:00.861024 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.860843    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:00.861024 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.860900    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:16.860881551 +0000 UTC m=+33.073425333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:00.861024 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.860935    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:16.860923569 +0000 UTC m=+33.073467352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:00.961825 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:00.961782    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:00.962024 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.962000    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:20:00.962101 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.962029    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:20:00.962101 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.962039    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:00.962191 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:00.962104    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:20:16.962086154 +0000 UTC m=+33.174629932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:01.242924 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:01.242818    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:01.243356 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:01.242972    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:01.243356 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:01.242993    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:01.243356 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:01.243117    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:02.243256 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:02.243221    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:02.243692 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:02.243353    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:03.243080 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:03.243027    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:03.243271 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:03.243040    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:03.243271 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:03.243176    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:03.243674 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:03.243265    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:04.243323 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:04.243284    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:04.243529 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:04.243395    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:05.242437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.242265    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:05.242589 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:05.242556    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:05.242627 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.242265    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:05.242740 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:05.242720    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:05.485539 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.485498    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"47301ed4e17ed2bbcedb10a44337a2b3b57455decd65c65e1316282ed185cc2e"}
Sep 11 13:20:05.486278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.485602    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"1706c3b7da71b40ff25afdd5153233fd3d3a4e86c6a3d07802132b1ef9ee4713"}
Sep 11 13:20:05.486278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.485656    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"d86cb85f146bd7736eb9207ed9b85317d032a72b1341fb88dc0e049433ade1ac"}
Sep 11 13:20:05.486278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.485699    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"acf3509996547ecd873c36c8c67bc17ded132d3b735594d37adb1daeddfbf318"}
Sep 11 13:20:05.486278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.485736    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"6b1ad4760b0fcc1c10a0c64fe9671036010328e9634486741bc6082ed7a9257e"}
Sep 11 13:20:05.486278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.485773    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"54c5887f027f2b4a9efad43b55276fe351f8d4401c14549cf8de117abef59f21"}
Sep 11 13:20:05.487377 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.487353    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vn8ph" event={"ID":"49ce5973-5472-4798-aaac-5fcf1913ff49","Type":"ContainerStarted","Data":"0318ef26cf662ae8b0957ad81609e11d3020f85ea42453c91007d2371a635acb"}
Sep 11 13:20:05.490700 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.490666    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2vxd" event={"ID":"d54940d9-3814-41a3-b61c-9bc85f85106e","Type":"ContainerStarted","Data":"01e83e7dd1354d49d7ae30f324d1929a201684254856718f649d1de2d07cea13"}
Sep 11 13:20:05.492197 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.492172    2547 generic.go:356] "Generic (PLEG): container finished" podID="a4bdfbde465325de64ecce647f250262" containerID="a0fb0e3bc917e56012f919ffeb88e7b7effa2ae6522e2abf7e6c6907ba82696b" exitCode=0
Sep 11 13:20:05.492340 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.492255    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"a4bdfbde465325de64ecce647f250262","Type":"ContainerDied","Data":"a0fb0e3bc917e56012f919ffeb88e7b7effa2ae6522e2abf7e6c6907ba82696b"}
Sep 11 13:20:05.493878 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.493837    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"40ebe202d4a2d8cca9cb5126efaa8412","Type":"ContainerStarted","Data":"307d3fd22ad3d79123dfd442e3f3ea5db2b7aac246dc481acb1b490ef96cb88f"}
Sep 11 13:20:05.495403 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.495379    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g" event={"ID":"46011153-b863-42c5-94da-b3fc4e5b75b2","Type":"ContainerStarted","Data":"0355096a151c45024b594d8979ca06ece2851aa2ab5e2d927a592e08ea529924"}
Sep 11 13:20:05.497033 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.497005    2547 generic.go:356] "Generic (PLEG): container finished" podID="a96da024-eefc-457c-affa-ea6a20c48011" containerID="fff767fbc77c11ffb8007515776baaa663730970f046ac206088a58a33c5d4de" exitCode=0
Sep 11 13:20:05.497163 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.497080    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerDied","Data":"fff767fbc77c11ffb8007515776baaa663730970f046ac206088a58a33c5d4de"}
Sep 11 13:20:05.498784 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.498763    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzwn9" event={"ID":"97822bc6-b305-4c6a-a2e7-e0e9d57a4c0e","Type":"ContainerStarted","Data":"60e03ed8fd962e1e0fd463d5dc0abad8c5cfde9a99b930756a697ba7c7fae3a8"}
Sep 11 13:20:05.500415 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.500391    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kfwz8" event={"ID":"8a53247d-9ee5-488b-a192-c3edd196ea81","Type":"ContainerStarted","Data":"d988a7b75f8e35c0da81b0a6584b599e17c800d4e8872b94b5afabfe1af1d9df"}
Sep 11 13:20:05.501883 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.501863    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mljf5" event={"ID":"da3487fb-8404-41d2-bb6d-df7679b34a69","Type":"ContainerStarted","Data":"7271d202d0ba33169e3085fe207f4d5221820242597fe1c740213c77526408e3"}
Sep 11 13:20:05.554145 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.552737    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vn8ph" podStartSLOduration=2.547699691 podStartE2EDuration="21.552712091s" totalImagesPullingTime="19.0050124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:05.512613106 +0000 UTC m=+21.725156908" watchObservedRunningTime="2026-09-11 13:20:05.552712091 +0000 UTC m=+21.765255893"
Sep 11 13:20:05.577369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.577320    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c2vxd" podStartSLOduration=2.647664684 podStartE2EDuration="21.577302714s" totalImagesPullingTime="18.92963803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:05.552937605 +0000 UTC m=+21.765481406" watchObservedRunningTime="2026-09-11 13:20:05.577302714 +0000 UTC m=+21.789846511"
Sep 11 13:20:05.601878 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.601828    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kfwz8" podStartSLOduration=2.3914202749999998 podStartE2EDuration="21.601815109s" totalImagesPullingTime="19.210394834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:05.601692103 +0000 UTC m=+21.814235904" watchObservedRunningTime="2026-09-11 13:20:05.601815109 +0000 UTC m=+21.814358909"
Sep 11 13:20:05.679192 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.679136    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mljf5" podStartSLOduration=6.744166258 podStartE2EDuration="21.679119273s" totalImagesPullingTime="14.934953015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:05.678787601 +0000 UTC m=+21.891331402" watchObservedRunningTime="2026-09-11 13:20:05.679119273 +0000 UTC m=+21.891663073"
Sep 11 13:20:05.679398 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:05.679221    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" podStartSLOduration=20.679217616 podStartE2EDuration="20.679217616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:05.660549066 +0000 UTC m=+21.873092865" watchObservedRunningTime="2026-09-11 13:20:05.679217616 +0000 UTC m=+21.891761415"
Sep 11 13:20:06.243196 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.243114    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:06.243412 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:06.243241    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:06.393772 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.393737    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 13:20:06.507141 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.507040    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g" event={"ID":"46011153-b863-42c5-94da-b3fc4e5b75b2","Type":"ContainerStarted","Data":"7835a6070638677f274e63de6a82768ce027c146ea48b00e4ea5851471e95fd7"}
Sep 11 13:20:06.508752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.508718    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ckd9l" event={"ID":"b22e3a36-6aeb-4069-b872-cc45d076973a","Type":"ContainerStarted","Data":"fcb460d9c8d48458ff11dd60d8df18202329f2889b5f3289016d6bd800d7c50c"}
Sep 11 13:20:06.510511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.510478    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"a4bdfbde465325de64ecce647f250262","Type":"ContainerStarted","Data":"753e037447d63ae24943b39b7f3cd754b952214a67238fa888e991e7f0141e71"}
Sep 11 13:20:06.525949 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.525873    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nzwn9" podStartSLOduration=3.5763291600000002 podStartE2EDuration="22.525852761s" totalImagesPullingTime="18.949523601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:05.702214642 +0000 UTC m=+21.914758442" watchObservedRunningTime="2026-09-11 13:20:06.525852761 +0000 UTC m=+22.738396562"
Sep 11 13:20:06.526124 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:06.526102    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ckd9l" podStartSLOduration=3.637709124 podStartE2EDuration="22.526095473s" totalImagesPullingTime="18.888386349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:06.52541871 +0000 UTC m=+22.737962514" watchObservedRunningTime="2026-09-11 13:20:06.526095473 +0000 UTC m=+22.738639273"
Sep 11 13:20:07.179129 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.179007    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T13:20:06.393759623Z","UUID":"3c969b25-3174-4863-b1d4-b2b351059c56","Handler":null,"Name":"","Endpoint":""}
Sep 11 13:20:07.180775 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.180746    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 13:20:07.180932 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.180790    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 13:20:07.242451 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.242415    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:07.242640 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:07.242546    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:07.242640 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.242597    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:07.242760 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:07.242706    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:07.516049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.515808    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g" event={"ID":"46011153-b863-42c5-94da-b3fc4e5b75b2","Type":"ContainerStarted","Data":"6e65b9f9596c3efc95515b99c86190b8f851e6c2fd0a82e744810fd236bf9518"}
Sep 11 13:20:07.566940 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:07.566864    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" podStartSLOduration=22.566842854 podStartE2EDuration="22.566842854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:06.542854688 +0000 UTC m=+22.755398490" watchObservedRunningTime="2026-09-11 13:20:07.566842854 +0000 UTC m=+23.779386655"
Sep 11 13:20:08.242866 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.242829    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:08.243067 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:08.242975    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:08.372312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.372264    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:20:08.372947 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.372898    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:20:08.392885 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.392831    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c8j5g" podStartSLOduration=3.472920084 podStartE2EDuration="24.392813102s" totalImagesPullingTime="20.919893018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:07.570433532 +0000 UTC m=+23.782977335" watchObservedRunningTime="2026-09-11 13:20:08.392813102 +0000 UTC m=+24.605356902"
Sep 11 13:20:08.522238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.522142    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"0dd2d647de1ea407436733a1cfad78962a2cbb5e178b294ddf13d213af4e5a58"}
Sep 11 13:20:08.522684 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.522500    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:20:08.522979 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:08.522960    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mljf5"
Sep 11 13:20:09.242463 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:09.242420    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:09.242651 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:09.242424    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:09.242651 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:09.242555    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:09.242651 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:09.242625    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:10.242346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:10.242310    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:10.242800 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:10.242461    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:11.243323 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.243149    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:11.243753 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.243149    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:11.243753 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:11.243397    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:11.243753 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:11.243503    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:11.531260 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.531171    2547 generic.go:356] "Generic (PLEG): container finished" podID="a96da024-eefc-457c-affa-ea6a20c48011" containerID="dc22a321c49a0e082b10f99b9baa976cc52b45a9c168b77d03b38278d8e88622" exitCode=0
Sep 11 13:20:11.531437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.531262    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerDied","Data":"dc22a321c49a0e082b10f99b9baa976cc52b45a9c168b77d03b38278d8e88622"}
Sep 11 13:20:11.535231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.535205    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" event={"ID":"d2f680ef-2d0d-492e-9620-91150a3a477c","Type":"ContainerStarted","Data":"ac997a93aeda2d06249aadb0b17216f3ee23631e03ed45a7c78347dc9537a518"}
Sep 11 13:20:11.535502 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.535486    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:20:11.535591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.535580    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:20:11.535644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.535617    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:20:11.551649 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.551618    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:20:11.551953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:11.551936    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:20:12.243060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.243031    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:12.243386 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:12.243178    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:12.625338 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.625274    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf" podStartSLOduration=9.225788069 podStartE2EDuration="28.625251124s" totalImagesPullingTime="19.399463055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:11.677146733 +0000 UTC m=+27.889690533" watchObservedRunningTime="2026-09-11 13:20:12.625251124 +0000 UTC m=+28.837794924"
Sep 11 13:20:12.626023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.625647    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cxcf7"]
Sep 11 13:20:12.626023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.625765    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:12.626023 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:12.625885    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:12.639056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.637653    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76vfp"]
Sep 11 13:20:12.639056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.637759    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zzf9j"]
Sep 11 13:20:12.639056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.637858    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:12.639056 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:12.638004    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:12.639056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:12.638077    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:12.639056 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:12.638140    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:13.541736 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:13.541700    2547 generic.go:356] "Generic (PLEG): container finished" podID="a96da024-eefc-457c-affa-ea6a20c48011" containerID="60229c810132782d69dde78c366a6a0fa084f07e9f3fffd15a0b24a95172aaaa" exitCode=0
Sep 11 13:20:13.542362 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:13.541790    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerDied","Data":"60229c810132782d69dde78c366a6a0fa084f07e9f3fffd15a0b24a95172aaaa"}
Sep 11 13:20:14.244048 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:14.243847    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:14.244253 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:14.243944    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:14.244253 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:14.244111    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:14.244253 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:14.244217    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:14.244253 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:14.243951    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:14.244448 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:14.244335    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:14.547074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:14.546943    2547 generic.go:356] "Generic (PLEG): container finished" podID="a96da024-eefc-457c-affa-ea6a20c48011" containerID="9a9b2e77ba981b7d37a285e3004ae373baff6684cb4a608f3d15084cd0e06776" exitCode=0
Sep 11 13:20:14.547074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:14.547019    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerDied","Data":"9a9b2e77ba981b7d37a285e3004ae373baff6684cb4a608f3d15084cd0e06776"}
Sep 11 13:20:16.243465 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:16.243374    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:16.243465 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:16.243423    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:16.243890 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:16.243378    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:16.243890 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.243515    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76vfp" podUID="69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d"
Sep 11 13:20:16.243890 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.243624    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxcf7" podUID="d3fc972e-a8f3-435e-82ae-f1d703a6c534"
Sep 11 13:20:16.243890 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.243729    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzf9j" podUID="90de78bd-4709-4ea2-879f-1178fcecf024"
Sep 11 13:20:16.878999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:16.878962    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:16.879204 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:16.879029    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:16.879204 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.879134    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:16.879204 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.879204    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:48.879183801 +0000 UTC m=+65.091727595 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 13:20:16.879431 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.879136    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:16.879431 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.879290    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret podName:d3fc972e-a8f3-435e-82ae-f1d703a6c534 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:48.879265347 +0000 UTC m=+65.091809127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret") pod "global-pull-secret-syncer-cxcf7" (UID: "d3fc972e-a8f3-435e-82ae-f1d703a6c534") : object "kube-system"/"original-pull-secret" not registered
Sep 11 13:20:16.979798 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:16.979765    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:16.980040 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.979938    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 13:20:16.980040 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.979959    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 13:20:16.980040 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.979972    2547 projected.go:196] Error preparing data for projected volume kube-api-access-p456c for pod openshift-network-diagnostics/network-check-target-76vfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:16.980040 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:16.980033    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c podName:69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d nodeName:}" failed. No retries permitted until 2026-09-11 13:20:48.980015727 +0000 UTC m=+65.192559519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p456c" (UniqueName: "kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c") pod "network-check-target-76vfp" (UID: "69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 13:20:17.588400 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.588320    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeReady"
Sep 11 13:20:17.588965 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.588471    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 13:20:17.663853 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.663819    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pffhb"]
Sep 11 13:20:17.667494 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.667461    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.667494 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.667493    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lnpjd"]
Sep 11 13:20:17.670667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.670637    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 13:20:17.670819 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.670747    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-flkcx\""
Sep 11 13:20:17.670900 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.670877    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 13:20:17.671114 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.671096    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.673576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.673559    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 13:20:17.674103 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.674087    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 13:20:17.674399 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.674385    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 13:20:17.674485 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.674400    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rsfmf\""
Sep 11 13:20:17.682455 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.682429    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnpjd"]
Sep 11 13:20:17.687237 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.687070    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pffhb"]
Sep 11 13:20:17.784822 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.784777    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbmw\" (UniqueName: \"kubernetes.io/projected/6c845ef0-180c-4ff1-b233-28c59f946cf4-kube-api-access-hqbmw\") pod \"ingress-canary-lnpjd\" (UID: \"6c845ef0-180c-4ff1-b233-28c59f946cf4\") " pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.785049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.784839    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-config-volume\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.785049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.784898    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c845ef0-180c-4ff1-b233-28c59f946cf4-cert\") pod \"ingress-canary-lnpjd\" (UID: \"6c845ef0-180c-4ff1-b233-28c59f946cf4\") " pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.785049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.784994    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc5j5\" (UniqueName: \"kubernetes.io/projected/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-kube-api-access-mc5j5\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.785049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.785041    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.785212 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.785067    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-tmp-dir\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.885976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.885931    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc5j5\" (UniqueName: \"kubernetes.io/projected/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-kube-api-access-mc5j5\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.886165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.885996    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.886165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.886045    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-tmp-dir\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.886165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.886073    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbmw\" (UniqueName: \"kubernetes.io/projected/6c845ef0-180c-4ff1-b233-28c59f946cf4-kube-api-access-hqbmw\") pod \"ingress-canary-lnpjd\" (UID: \"6c845ef0-180c-4ff1-b233-28c59f946cf4\") " pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.886165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.886100    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-config-volume\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.886165 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.886145    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c845ef0-180c-4ff1-b233-28c59f946cf4-cert\") pod \"ingress-canary-lnpjd\" (UID: \"6c845ef0-180c-4ff1-b233-28c59f946cf4\") " pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.886371 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:17.886195    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:17.886371 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:17.886274    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:18.38625002 +0000 UTC m=+34.598793818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:17.886738 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.886710    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-tmp-dir\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.887095 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.887076    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-config-volume\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.891641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.891612    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c845ef0-180c-4ff1-b233-28c59f946cf4-cert\") pod \"ingress-canary-lnpjd\" (UID: \"6c845ef0-180c-4ff1-b233-28c59f946cf4\") " pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.898722 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.898691    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc5j5\" (UniqueName: \"kubernetes.io/projected/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-kube-api-access-mc5j5\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:17.898875 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.898770    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbmw\" (UniqueName: \"kubernetes.io/projected/6c845ef0-180c-4ff1-b233-28c59f946cf4-kube-api-access-hqbmw\") pod \"ingress-canary-lnpjd\" (UID: \"6c845ef0-180c-4ff1-b233-28c59f946cf4\") " pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:17.989009 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:17.988971    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnpjd"
Sep 11 13:20:18.243025 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.242946    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:18.243025 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.242967    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:18.243025 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.242975    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:18.245993 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.245970    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2xgs9\""
Sep 11 13:20:18.246142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.246017    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 13:20:18.247249 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.247224    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 13:20:18.247386 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.247224    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4k5\""
Sep 11 13:20:18.247386 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.247224    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 13:20:18.247386 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.247291    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 13:20:18.390135 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:18.390093    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:18.390330 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:18.390225    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:18.390330 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:18.390314    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:19.390293851 +0000 UTC m=+35.602837643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:19.397488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:19.397449    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:19.397968 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:19.397605    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:19.397968 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:19.397676    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:21.397657444 +0000 UTC m=+37.610201247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:19.585037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:19.584895    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnpjd"]
Sep 11 13:20:19.587965 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:20:19.587941    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c845ef0_180c_4ff1_b233_28c59f946cf4.slice/crio-963d5fe23d937777b328a4ba7776a3154ede365259df301a2ad1044f26c5993d WatchSource:0}: Error finding container 963d5fe23d937777b328a4ba7776a3154ede365259df301a2ad1044f26c5993d: Status 404 returned error can't find the container with id 963d5fe23d937777b328a4ba7776a3154ede365259df301a2ad1044f26c5993d
Sep 11 13:20:20.563611 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:20.563570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnpjd" event={"ID":"6c845ef0-180c-4ff1-b233-28c59f946cf4","Type":"ContainerStarted","Data":"963d5fe23d937777b328a4ba7776a3154ede365259df301a2ad1044f26c5993d"}
Sep 11 13:20:20.567213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:20.567172    2547 generic.go:356] "Generic (PLEG): container finished" podID="a96da024-eefc-457c-affa-ea6a20c48011" containerID="de13d8671f8a78677bf7dcbd7055d372087e7bcd661aae024ccd0e0c14ec4f42" exitCode=0
Sep 11 13:20:20.567365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:20.567247    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerDied","Data":"de13d8671f8a78677bf7dcbd7055d372087e7bcd661aae024ccd0e0c14ec4f42"}
Sep 11 13:20:21.413725 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:21.413687    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:21.413885 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:21.413845    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:21.413956 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:21.413940    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:25.413907115 +0000 UTC m=+41.626450906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:21.573713 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:21.573672    2547 generic.go:356] "Generic (PLEG): container finished" podID="a96da024-eefc-457c-affa-ea6a20c48011" containerID="42ff0fe33ff5cbd0754b80ef0033cff06fdfe86203103b192a4ed4c2e06f146b" exitCode=0
Sep 11 13:20:21.574163 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:21.573709    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerDied","Data":"42ff0fe33ff5cbd0754b80ef0033cff06fdfe86203103b192a4ed4c2e06f146b"}
Sep 11 13:20:22.578648 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:22.578318    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnpjd" event={"ID":"6c845ef0-180c-4ff1-b233-28c59f946cf4","Type":"ContainerStarted","Data":"7a337ec03f0d8bb4ba1a5bdf2c994930d297ffe6441578743ae9ec54539a5507"}
Sep 11 13:20:22.581805 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:22.581772    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pknmv" event={"ID":"a96da024-eefc-457c-affa-ea6a20c48011","Type":"ContainerStarted","Data":"c688fddec4cd8dc1548f65de61926319b59e1b8c3e5ba5196b97a8b397f2016c"}
Sep 11 13:20:22.603436 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:22.603380    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lnpjd" podStartSLOduration=2.908607572 podStartE2EDuration="5.603364427s" totalImagesPullingTime="2.694756855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:22.602893182 +0000 UTC m=+38.815436995" watchObservedRunningTime="2026-09-11 13:20:22.603364427 +0000 UTC m=+38.815908226"
Sep 11 13:20:22.637369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:22.637321    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pknmv" podStartSLOduration=7.638211083 podStartE2EDuration="38.637305954s" totalImagesPullingTime="30.999094871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:22.637121075 +0000 UTC m=+38.849664874" watchObservedRunningTime="2026-09-11 13:20:22.637305954 +0000 UTC m=+38.849849754"
Sep 11 13:20:25.445436 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:25.445393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:25.445839 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:25.445553    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:25.445839 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:25.445634    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:33.445614952 +0000 UTC m=+49.658158731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:33.498021 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:33.497982    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:33.498451 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:33.498145    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:33.498451 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:33.498226    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:20:49.498210235 +0000 UTC m=+65.710754028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:43.552454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:43.552426    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rsvqf"
Sep 11 13:20:48.902278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:48.902226    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:48.902669 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:48.902321    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:20:48.907321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:48.907296    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 13:20:48.907375 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:48.907334    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 13:20:48.913217 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:48.913190    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 13:20:48.913275 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:48.913264    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs podName:90de78bd-4709-4ea2-879f-1178fcecf024 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:52.913244208 +0000 UTC m=+129.125787985 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs") pod "network-metrics-daemon-zzf9j" (UID: "90de78bd-4709-4ea2-879f-1178fcecf024") : secret "metrics-daemon-secret" not found
Sep 11 13:20:48.916428 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:48.916394    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3fc972e-a8f3-435e-82ae-f1d703a6c534-original-pull-secret\") pod \"global-pull-secret-syncer-cxcf7\" (UID: \"d3fc972e-a8f3-435e-82ae-f1d703a6c534\") " pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:49.003679 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.003634    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:49.007346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.007324    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 13:20:49.016924 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.016892    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 13:20:49.027317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.027285    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p456c\" (UniqueName: \"kubernetes.io/projected/69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d-kube-api-access-p456c\") pod \"network-check-target-76vfp\" (UID: \"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d\") " pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:49.154576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.154494    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxcf7"
Sep 11 13:20:49.164545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.164522    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4k5\""
Sep 11 13:20:49.172563 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.172534    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:49.465090 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.465005    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cxcf7"]
Sep 11 13:20:49.468305 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:20:49.468280    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fc972e_a8f3_435e_82ae_f1d703a6c534.slice/crio-03beec693f250becaeb49635619105933460b6eb9c67c1d2da9601aac6b53df7 WatchSource:0}: Error finding container 03beec693f250becaeb49635619105933460b6eb9c67c1d2da9601aac6b53df7: Status 404 returned error can't find the container with id 03beec693f250becaeb49635619105933460b6eb9c67c1d2da9601aac6b53df7
Sep 11 13:20:49.499731 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.499696    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76vfp"]
Sep 11 13:20:49.503158 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:20:49.503129    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fae49f_8aad_4f28_b8f1_ae78cfcf3e7d.slice/crio-4fe32c5b0774ab71a67f529ff22f43b4095063d54a2fba013db3dda2705594b5 WatchSource:0}: Error finding container 4fe32c5b0774ab71a67f529ff22f43b4095063d54a2fba013db3dda2705594b5: Status 404 returned error can't find the container with id 4fe32c5b0774ab71a67f529ff22f43b4095063d54a2fba013db3dda2705594b5
Sep 11 13:20:49.506773 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.506748    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:20:49.506976 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:49.506955    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:20:49.507060 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:20:49.507046    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:21.507022343 +0000 UTC m=+97.719566126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:20:49.645211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.645173    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76vfp" event={"ID":"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d","Type":"ContainerStarted","Data":"4fe32c5b0774ab71a67f529ff22f43b4095063d54a2fba013db3dda2705594b5"}
Sep 11 13:20:49.646371 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:49.646349    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cxcf7" event={"ID":"d3fc972e-a8f3-435e-82ae-f1d703a6c534","Type":"ContainerStarted","Data":"03beec693f250becaeb49635619105933460b6eb9c67c1d2da9601aac6b53df7"}
Sep 11 13:20:54.661835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:54.661798    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cxcf7" event={"ID":"d3fc972e-a8f3-435e-82ae-f1d703a6c534","Type":"ContainerStarted","Data":"c4ae2fe51bddb20da32a2b1f24f410aea932feb7094c62cd5c4ad8ab72aead35"}
Sep 11 13:20:54.663417 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:54.663386    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76vfp" event={"ID":"69fae49f-8aad-4f28-b8f1-ae78cfcf3e7d","Type":"ContainerStarted","Data":"72064a222fcf8917535333675d37bd46f1e426428bbbe7e038799f02343c474a"}
Sep 11 13:20:54.663542 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:54.663525    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:20:54.685160 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:54.685107    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cxcf7" podStartSLOduration=65.806244496 podStartE2EDuration="1m10.685091559s" totalImagesPullingTime="4.878847063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:54.684941155 +0000 UTC m=+70.897484949" watchObservedRunningTime="2026-09-11 13:20:54.685091559 +0000 UTC m=+70.897635337"
Sep 11 13:20:54.723174 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:20:54.723119    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-76vfp" podStartSLOduration=65.88365637 podStartE2EDuration="1m10.723104055s" totalImagesPullingTime="4.839447685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:54.722956292 +0000 UTC m=+70.935500091" watchObservedRunningTime="2026-09-11 13:20:54.723104055 +0000 UTC m=+70.935647855"
Sep 11 13:21:12.443051 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.442904    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"]
Sep 11 13:21:12.446864 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.446839    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"
Sep 11 13:21:12.449834 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.449813    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q58fk\""
Sep 11 13:21:12.450972 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.450836    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.450972 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.450872    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.457691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.457666    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"]
Sep 11 13:21:12.568584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.568550    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqxxz\" (UniqueName: \"kubernetes.io/projected/b31efd14-0e4f-411a-9009-4caeaa96a381-kube-api-access-fqxxz\") pod \"volume-data-source-validator-86695b7cc7-6n9rj\" (UID: \"b31efd14-0e4f-411a-9009-4caeaa96a381\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"
Sep 11 13:21:12.605936 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.605879    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-t9t97"]
Sep 11 13:21:12.609607 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.609572    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"]
Sep 11 13:21:12.610708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.610659    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.612866 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.612842    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"]
Sep 11 13:21:12.613013 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.612992    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.613906 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.613885    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.614127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.614112    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 13:21:12.614181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.614126    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 13:21:12.614291 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.614270    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-tjtdk\""
Sep 11 13:21:12.614346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.614339    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.616083 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.616057    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"]
Sep 11 13:21:12.616186 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.616174    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:12.619693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.619667    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.620478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.620453    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.620597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.620453    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 13:21:12.622461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.622440    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 13:21:12.622461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.622455    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.623751 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.623733    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.623874 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.623735    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lg7rh\""
Sep 11 13:21:12.623874 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.623735    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.624015 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.623737    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pdzd4\""
Sep 11 13:21:12.624015 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.623891    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 13:21:12.627669 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.627654    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 13:21:12.627904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.627879    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 13:21:12.628037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.627995    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 13:21:12.628861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.628695    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:21:12.628861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.628706    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ntqg7\""
Sep 11 13:21:12.629450 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.629430    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-t9t97"]
Sep 11 13:21:12.630114 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.630094    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 13:21:12.630477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.630457    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"]
Sep 11 13:21:12.631083 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.631063    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"]
Sep 11 13:21:12.648992 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.648961    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"]
Sep 11 13:21:12.668959 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.668904    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/873492b7-136a-499c-aa69-244a4fafcec9-config\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.669142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.668972    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8150f5a9-fdfa-49ba-931d-1916f3fcceac-trusted-ca\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.669142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.668997    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:12.669142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbbs\" (UniqueName: \"kubernetes.io/projected/6a21b9e9-524e-4767-9a39-99a8a657ab6b-kube-api-access-6rbbs\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.669142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669038    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzf5c\" (UniqueName: \"kubernetes.io/projected/873492b7-136a-499c-aa69-244a4fafcec9-kube-api-access-qzf5c\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.669142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669056    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8150f5a9-fdfa-49ba-931d-1916f3fcceac-serving-cert\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.669142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669111    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfjj\" (UniqueName: \"kubernetes.io/projected/8150f5a9-fdfa-49ba-931d-1916f3fcceac-kube-api-access-mqfjj\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.669361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669145    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a21b9e9-524e-4767-9a39-99a8a657ab6b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.669361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669176    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.669361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669197    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/873492b7-136a-499c-aa69-244a4fafcec9-serving-cert\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.669361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669226    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqxxz\" (UniqueName: \"kubernetes.io/projected/b31efd14-0e4f-411a-9009-4caeaa96a381-kube-api-access-fqxxz\") pod \"volume-data-source-validator-86695b7cc7-6n9rj\" (UID: \"b31efd14-0e4f-411a-9009-4caeaa96a381\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"
Sep 11 13:21:12.669361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669252    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8150f5a9-fdfa-49ba-931d-1916f3fcceac-config\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.669361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.669269    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmnc\" (UniqueName: \"kubernetes.io/projected/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-kube-api-access-jfmnc\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:12.681749 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.681719    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqxxz\" (UniqueName: \"kubernetes.io/projected/b31efd14-0e4f-411a-9009-4caeaa96a381-kube-api-access-fqxxz\") pod \"volume-data-source-validator-86695b7cc7-6n9rj\" (UID: \"b31efd14-0e4f-411a-9009-4caeaa96a381\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"
Sep 11 13:21:12.722672 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.722586    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-867778758f-9xvdz"]
Sep 11 13:21:12.725589 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.725567    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.755326 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.755288    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"
Sep 11 13:21:12.755571 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.755348    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 13:21:12.755641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.755603    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 13:21:12.755641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.755647    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 13:21:12.755787 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.755769    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g6rbf\""
Sep 11 13:21:12.770175 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770145    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-certificates\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.770344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770227    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b5025b-29a8-4ac6-aa36-994dc6aea436-ca-trust-extracted\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.770344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770271    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-installation-pull-secrets\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.770344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770311    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/873492b7-136a-499c-aa69-244a4fafcec9-config\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.770501 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770354    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwm7d\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-kube-api-access-mwm7d\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.770501 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770397    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8150f5a9-fdfa-49ba-931d-1916f3fcceac-trusted-ca\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.770501 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770441    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:12.770501 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770472    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbbs\" (UniqueName: \"kubernetes.io/projected/6a21b9e9-524e-4767-9a39-99a8a657ab6b-kube-api-access-6rbbs\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.770689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770509    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzf5c\" (UniqueName: \"kubernetes.io/projected/873492b7-136a-499c-aa69-244a4fafcec9-kube-api-access-qzf5c\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.770689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770542    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-bound-sa-token\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.770689 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.770579    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 13:21:12.770689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770624    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8150f5a9-fdfa-49ba-931d-1916f3fcceac-serving-cert\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.770887 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.770690    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls podName:43569d2e-e251-4bf1-b5d8-e8fc8a5152d2 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:13.27066641 +0000 UTC m=+89.483210200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l6vkg" (UID: "43569d2e-e251-4bf1-b5d8-e8fc8a5152d2") : secret "samples-operator-tls" not found
Sep 11 13:21:12.770887 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770734    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfjj\" (UniqueName: \"kubernetes.io/projected/8150f5a9-fdfa-49ba-931d-1916f3fcceac-kube-api-access-mqfjj\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.770887 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770768    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a21b9e9-524e-4767-9a39-99a8a657ab6b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.770887 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770796    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.770887 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770835    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/873492b7-136a-499c-aa69-244a4fafcec9-serving-cert\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.770887 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770864    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-image-registry-private-configuration\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770894    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-trusted-ca\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770959    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8150f5a9-fdfa-49ba-931d-1916f3fcceac-config\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.770988    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmnc\" (UniqueName: \"kubernetes.io/projected/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-kube-api-access-jfmnc\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.771014    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/873492b7-136a-499c-aa69-244a4fafcec9-config\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.771021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.771180    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.771240    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls podName:6a21b9e9-524e-4767-9a39-99a8a657ab6b nodeName:}" failed. No retries permitted until 2026-09-11 13:21:13.271218649 +0000 UTC m=+89.483762443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-mqlhz" (UID: "6a21b9e9-524e-4767-9a39-99a8a657ab6b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.771747    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8150f5a9-fdfa-49ba-931d-1916f3fcceac-config\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.771829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.771822    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a21b9e9-524e-4767-9a39-99a8a657ab6b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.772153 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.772047    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8150f5a9-fdfa-49ba-931d-1916f3fcceac-trusted-ca\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.773312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.773282    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/873492b7-136a-499c-aa69-244a4fafcec9-serving-cert\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.773410 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.773286    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8150f5a9-fdfa-49ba-931d-1916f3fcceac-serving-cert\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.815091 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.815016    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzf5c\" (UniqueName: \"kubernetes.io/projected/873492b7-136a-499c-aa69-244a4fafcec9-kube-api-access-qzf5c\") pod \"service-ca-operator-cf7c776b7-5nggc\" (UID: \"873492b7-136a-499c-aa69-244a4fafcec9\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:12.841687 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.839965    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfjj\" (UniqueName: \"kubernetes.io/projected/8150f5a9-fdfa-49ba-931d-1916f3fcceac-kube-api-access-mqfjj\") pod \"console-operator-696884fb9c-t9t97\" (UID: \"8150f5a9-fdfa-49ba-931d-1916f3fcceac\") " pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.847746 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.846589    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867778758f-9xvdz"]
Sep 11 13:21:12.847746 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.847226    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 13:21:12.848655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.848632    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbbs\" (UniqueName: \"kubernetes.io/projected/6a21b9e9-524e-4767-9a39-99a8a657ab6b-kube-api-access-6rbbs\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:12.848780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.848763    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmnc\" (UniqueName: \"kubernetes.io/projected/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-kube-api-access-jfmnc\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:12.871879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.871838    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-installation-pull-secrets\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.871879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.871884    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwm7d\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-kube-api-access-mwm7d\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872105 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.871969    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-bound-sa-token\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872184 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-image-registry-private-configuration\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872240 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-trusted-ca\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872251    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872284    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-certificates\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872407 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872320    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b5025b-29a8-4ac6-aa36-994dc6aea436-ca-trust-extracted\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872407 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.872381    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 13:21:12.872407 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.872402    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867778758f-9xvdz: secret "image-registry-tls" not found
Sep 11 13:21:12.872512 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:12.872485    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls podName:85b5025b-29a8-4ac6-aa36-994dc6aea436 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:13.372463826 +0000 UTC m=+89.585007623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls") pod "image-registry-867778758f-9xvdz" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436") : secret "image-registry-tls" not found
Sep 11 13:21:12.872755 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872731    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b5025b-29a8-4ac6-aa36-994dc6aea436-ca-trust-extracted\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.872929 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.872882    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-certificates\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.873230 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.873206    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-trusted-ca\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.874814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.874786    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-installation-pull-secrets\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.874924 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.874797    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-image-registry-private-configuration\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.886826 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.886795    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-bound-sa-token\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.886985 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.886963    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwm7d\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-kube-api-access-mwm7d\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:12.921889 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.921844    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:12.943378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:12.943348    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"
Sep 11 13:21:13.037319 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.037282    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj"]
Sep 11 13:21:13.040639 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:13.040613    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31efd14_0e4f_411a_9009_4caeaa96a381.slice/crio-50999a74bd283ddcb0f3215a636d9506126debf54c982ad2fd1f0532eb7c1808 WatchSource:0}: Error finding container 50999a74bd283ddcb0f3215a636d9506126debf54c982ad2fd1f0532eb7c1808: Status 404 returned error can't find the container with id 50999a74bd283ddcb0f3215a636d9506126debf54c982ad2fd1f0532eb7c1808
Sep 11 13:21:13.199283 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.199244    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-t9t97"]
Sep 11 13:21:13.202241 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:13.202212    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8150f5a9_fdfa_49ba_931d_1916f3fcceac.slice/crio-201fc9aaa4a113910a935bf0c0754b689f3aca7f87aa9c743a2d3ea63e3121b7 WatchSource:0}: Error finding container 201fc9aaa4a113910a935bf0c0754b689f3aca7f87aa9c743a2d3ea63e3121b7: Status 404 returned error can't find the container with id 201fc9aaa4a113910a935bf0c0754b689f3aca7f87aa9c743a2d3ea63e3121b7
Sep 11 13:21:13.221068 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.221034    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc"]
Sep 11 13:21:13.224345 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:13.224275    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873492b7_136a_499c_aa69_244a4fafcec9.slice/crio-f412d6865fd17b4ce86471e23a6d6a06da536e16102715dc3a7920e3a6a820ea WatchSource:0}: Error finding container f412d6865fd17b4ce86471e23a6d6a06da536e16102715dc3a7920e3a6a820ea: Status 404 returned error can't find the container with id f412d6865fd17b4ce86471e23a6d6a06da536e16102715dc3a7920e3a6a820ea
Sep 11 13:21:13.275263 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.275225    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:13.275457 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.275377    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:13.275526 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.275462    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 13:21:13.275526 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.275482    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:13.275642 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.275539    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls podName:43569d2e-e251-4bf1-b5d8-e8fc8a5152d2 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:14.275520612 +0000 UTC m=+90.488064405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l6vkg" (UID: "43569d2e-e251-4bf1-b5d8-e8fc8a5152d2") : secret "samples-operator-tls" not found
Sep 11 13:21:13.275642 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.275555    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls podName:6a21b9e9-524e-4767-9a39-99a8a657ab6b nodeName:}" failed. No retries permitted until 2026-09-11 13:21:14.275548842 +0000 UTC m=+90.488092636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-mqlhz" (UID: "6a21b9e9-524e-4767-9a39-99a8a657ab6b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:13.376347 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.376303    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:13.376514 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.376468    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 13:21:13.376514 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.376486    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867778758f-9xvdz: secret "image-registry-tls" not found
Sep 11 13:21:13.376586 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:13.376541    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls podName:85b5025b-29a8-4ac6-aa36-994dc6aea436 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:14.376526218 +0000 UTC m=+90.589070013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls") pod "image-registry-867778758f-9xvdz" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436") : secret "image-registry-tls" not found
Sep 11 13:21:13.713051 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.713013    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc" event={"ID":"873492b7-136a-499c-aa69-244a4fafcec9","Type":"ContainerStarted","Data":"f412d6865fd17b4ce86471e23a6d6a06da536e16102715dc3a7920e3a6a820ea"}
Sep 11 13:21:13.714562 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.714529    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" event={"ID":"8150f5a9-fdfa-49ba-931d-1916f3fcceac","Type":"ContainerStarted","Data":"201fc9aaa4a113910a935bf0c0754b689f3aca7f87aa9c743a2d3ea63e3121b7"}
Sep 11 13:21:13.715793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:13.715760    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj" event={"ID":"b31efd14-0e4f-411a-9009-4caeaa96a381","Type":"ContainerStarted","Data":"50999a74bd283ddcb0f3215a636d9506126debf54c982ad2fd1f0532eb7c1808"}
Sep 11 13:21:14.285387 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:14.285343    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:14.285591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:14.285422    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:14.285804 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.285772    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:14.285945 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.285863    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls podName:6a21b9e9-524e-4767-9a39-99a8a657ab6b nodeName:}" failed. No retries permitted until 2026-09-11 13:21:16.285842471 +0000 UTC m=+92.498386266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-mqlhz" (UID: "6a21b9e9-524e-4767-9a39-99a8a657ab6b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:14.285945 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.285775    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 13:21:14.286067 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.285987    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls podName:43569d2e-e251-4bf1-b5d8-e8fc8a5152d2 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:16.285966943 +0000 UTC m=+92.498510735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l6vkg" (UID: "43569d2e-e251-4bf1-b5d8-e8fc8a5152d2") : secret "samples-operator-tls" not found
Sep 11 13:21:14.386252 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:14.386208    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:14.386445 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.386357    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 13:21:14.386445 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.386373    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867778758f-9xvdz: secret "image-registry-tls" not found
Sep 11 13:21:14.386445 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:14.386439    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls podName:85b5025b-29a8-4ac6-aa36-994dc6aea436 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:16.386419244 +0000 UTC m=+92.598963024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls") pod "image-registry-867778758f-9xvdz" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436") : secret "image-registry-tls" not found
Sep 11 13:21:14.720731 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:14.720689    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj" event={"ID":"b31efd14-0e4f-411a-9009-4caeaa96a381","Type":"ContainerStarted","Data":"d318d0f2d68693397226009350ccbba7136016d7c3802da22246d31e5dde9ff7"}
Sep 11 13:21:14.746737 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:14.746679    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6n9rj" podStartSLOduration=1.251582627 podStartE2EDuration="2.746659853s" totalImagesPullingTime="1.495077226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:14.746358967 +0000 UTC m=+90.958902762" watchObservedRunningTime="2026-09-11 13:21:14.746659853 +0000 UTC m=+90.959203652"
Sep 11 13:21:15.726589 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.726549    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc" event={"ID":"873492b7-136a-499c-aa69-244a4fafcec9","Type":"ContainerStarted","Data":"bb6b853f5d19a2c592c6f763f35c2ddf50d8e1ccbe341bf760984d2358c0a501"}
Sep 11 13:21:15.728238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.728206    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" event={"ID":"8150f5a9-fdfa-49ba-931d-1916f3fcceac","Type":"ContainerStarted","Data":"cafe252e3ebf40d054884717944f209f56b8b34d7e45bf1a8083549aaef53c1f"}
Sep 11 13:21:15.728367 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.728331    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:15.729924 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.729879    2547 patch_prober.go:28] interesting pod/console-operator-696884fb9c-t9t97 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body=
Sep 11 13:21:15.730049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.729946    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" podUID="8150f5a9-fdfa-49ba-931d-1916f3fcceac" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused"
Sep 11 13:21:15.772940 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.772292    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" podStartSLOduration=1.327265116 podStartE2EDuration="3.772268872s" totalImagesPullingTime="2.445003756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:15.771555065 +0000 UTC m=+91.984098865" watchObservedRunningTime="2026-09-11 13:21:15.772268872 +0000 UTC m=+91.984812672"
Sep 11 13:21:15.772940 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:15.772726    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc" podStartSLOduration=1.346172092 podStartE2EDuration="3.772713018s" totalImagesPullingTime="2.426540926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:15.747309462 +0000 UTC m=+91.959853263" watchObservedRunningTime="2026-09-11 13:21:15.772713018 +0000 UTC m=+91.985256825"
Sep 11 13:21:16.301242 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.301205    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:16.301434 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.301261    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:16.301434 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.301356    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:16.301434 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.301359    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 13:21:16.301434 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.301418    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls podName:6a21b9e9-524e-4767-9a39-99a8a657ab6b nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.301403556 +0000 UTC m=+96.513947333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-mqlhz" (UID: "6a21b9e9-524e-4767-9a39-99a8a657ab6b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:16.301434 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.301432    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls podName:43569d2e-e251-4bf1-b5d8-e8fc8a5152d2 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.30142504 +0000 UTC m=+96.513968818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l6vkg" (UID: "43569d2e-e251-4bf1-b5d8-e8fc8a5152d2") : secret "samples-operator-tls" not found
Sep 11 13:21:16.401940 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.401868    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:16.402095 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.402034    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 13:21:16.402095 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.402059    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867778758f-9xvdz: secret "image-registry-tls" not found
Sep 11 13:21:16.402179 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:16.402115    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls podName:85b5025b-29a8-4ac6-aa36-994dc6aea436 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.402100082 +0000 UTC m=+96.614643859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls") pod "image-registry-867778758f-9xvdz" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436") : secret "image-registry-tls" not found
Sep 11 13:21:16.732756 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.732728    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/0.log"
Sep 11 13:21:16.733213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.732771    2547 generic.go:356] "Generic (PLEG): container finished" podID="8150f5a9-fdfa-49ba-931d-1916f3fcceac" containerID="cafe252e3ebf40d054884717944f209f56b8b34d7e45bf1a8083549aaef53c1f" exitCode=255
Sep 11 13:21:16.733213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.732861    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" event={"ID":"8150f5a9-fdfa-49ba-931d-1916f3fcceac","Type":"ContainerDied","Data":"cafe252e3ebf40d054884717944f209f56b8b34d7e45bf1a8083549aaef53c1f"}
Sep 11 13:21:16.733213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.733106    2547 scope.go:117] "RemoveContainer" containerID="cafe252e3ebf40d054884717944f209f56b8b34d7e45bf1a8083549aaef53c1f"
Sep 11 13:21:16.903665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.903629    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zx8wz"]
Sep 11 13:21:16.906719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.906694    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:16.916738 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.916715    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ndm9r\""
Sep 11 13:21:16.917402 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.917387    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 13:21:16.917813 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.917801    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 13:21:16.918647 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.918632    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 13:21:16.918687 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.918637    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 13:21:16.938473 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:16.938442    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zx8wz"]
Sep 11 13:21:17.007829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.007723    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.007829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.007770    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.008041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.007975    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39638151-daec-4a22-aae7-4c237951def4-data-volume\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.008041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.008018    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39638151-daec-4a22-aae7-4c237951def4-crio-socket\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.008041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.008035    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvcc\" (UniqueName: \"kubernetes.io/projected/39638151-daec-4a22-aae7-4c237951def4-kube-api-access-pbvcc\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.112884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.112838    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39638151-daec-4a22-aae7-4c237951def4-data-volume\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.113074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.112892    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39638151-daec-4a22-aae7-4c237951def4-crio-socket\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.113074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.112938    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvcc\" (UniqueName: \"kubernetes.io/projected/39638151-daec-4a22-aae7-4c237951def4-kube-api-access-pbvcc\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.113074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.112976    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.113074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.112998    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39638151-daec-4a22-aae7-4c237951def4-crio-socket\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.113074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.113012    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.113074 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.113070    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.113469 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.113110    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.113469 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.113156    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:17.613126375 +0000 UTC m=+93.825670174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.113469 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.113175    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:17.613166463 +0000 UTC m=+93.825710241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.113469 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.113293    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39638151-daec-4a22-aae7-4c237951def4-data-volume\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.135642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.135605    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvcc\" (UniqueName: \"kubernetes.io/projected/39638151-daec-4a22-aae7-4c237951def4-kube-api-access-pbvcc\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.617278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.617230    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.617278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.617283    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:17.617557 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.617422    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.617557 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.617505    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:18.617485073 +0000 UTC m=+94.830028851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:17.617557 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.617438    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.617706 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.617578    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:18.617564069 +0000 UTC m=+94.830107862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:17.737893 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.737864    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:21:17.738328 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.738318    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/0.log"
Sep 11 13:21:17.738370 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.738353    2547 generic.go:356] "Generic (PLEG): container finished" podID="8150f5a9-fdfa-49ba-931d-1916f3fcceac" containerID="a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80" exitCode=255
Sep 11 13:21:17.738402 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.738387    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" event={"ID":"8150f5a9-fdfa-49ba-931d-1916f3fcceac","Type":"ContainerDied","Data":"a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80"}
Sep 11 13:21:17.738491 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.738477    2547 scope.go:117] "RemoveContainer" containerID="cafe252e3ebf40d054884717944f209f56b8b34d7e45bf1a8083549aaef53c1f"
Sep 11 13:21:17.738679 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:17.738659    2547 scope.go:117] "RemoveContainer" containerID="a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80"
Sep 11 13:21:17.738869 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:17.738850    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9t97_openshift-console-operator(8150f5a9-fdfa-49ba-931d-1916f3fcceac)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" podUID="8150f5a9-fdfa-49ba-931d-1916f3fcceac"
Sep 11 13:21:18.433954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:18.433928    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2vxd_d54940d9-3814-41a3-b61c-9bc85f85106e/dns-node-resolver/0.log"
Sep 11 13:21:18.626106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:18.626067    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:18.626106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:18.626113    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:18.626318 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:18.626227    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:18.626318 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:18.626229    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:18.626318 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:18.626283    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.626266997 +0000 UTC m=+96.838810788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:18.626318 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:18.626296    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:20.62628971 +0000 UTC m=+96.838833488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:18.743088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:18.743011    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:21:18.743441 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:18.743353    2547 scope.go:117] "RemoveContainer" containerID="a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80"
Sep 11 13:21:18.743517 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:18.743498    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9t97_openshift-console-operator(8150f5a9-fdfa-49ba-931d-1916f3fcceac)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" podUID="8150f5a9-fdfa-49ba-931d-1916f3fcceac"
Sep 11 13:21:19.453408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.453378    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-hwrjr"]
Sep 11 13:21:19.457354 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.457337    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.460050 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.460024    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 13:21:19.461251 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.461230    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 13:21:19.461368 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.461264    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 13:21:19.461368 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.461271    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 13:21:19.461368 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.461322    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vrvdp\""
Sep 11 13:21:19.468277 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.468252    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-hwrjr"]
Sep 11 13:21:19.532707 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.532671    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wxnt\" (UniqueName: \"kubernetes.io/projected/35668cbf-37e2-4acd-acbd-c637a487b4ab-kube-api-access-6wxnt\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.532985 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.532718    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35668cbf-37e2-4acd-acbd-c637a487b4ab-signing-key\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.532985 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.532747    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35668cbf-37e2-4acd-acbd-c637a487b4ab-signing-cabundle\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.633426 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.633388    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wxnt\" (UniqueName: \"kubernetes.io/projected/35668cbf-37e2-4acd-acbd-c637a487b4ab-kube-api-access-6wxnt\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.633619 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.633452    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35668cbf-37e2-4acd-acbd-c637a487b4ab-signing-key\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.633619 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.633480    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35668cbf-37e2-4acd-acbd-c637a487b4ab-signing-cabundle\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.633963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.633842    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vn8ph_49ce5973-5472-4798-aaac-5fcf1913ff49/node-ca/0.log"
Sep 11 13:21:19.634260 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.634238    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35668cbf-37e2-4acd-acbd-c637a487b4ab-signing-cabundle\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.635982 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.635964    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35668cbf-37e2-4acd-acbd-c637a487b4ab-signing-key\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.652365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.652338    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wxnt\" (UniqueName: \"kubernetes.io/projected/35668cbf-37e2-4acd-acbd-c637a487b4ab-kube-api-access-6wxnt\") pod \"service-ca-568869fdc5-hwrjr\" (UID: \"35668cbf-37e2-4acd-acbd-c637a487b4ab\") " pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:19.766558 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:19.766463    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-hwrjr"
Sep 11 13:21:20.054933 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.054839    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-hwrjr"]
Sep 11 13:21:20.058089 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:20.058062    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35668cbf_37e2_4acd_acbd_c637a487b4ab.slice/crio-7f7e328e0f6a204dc07c14987e01520385a025aeea4be1f950510b92f7859a60 WatchSource:0}: Error finding container 7f7e328e0f6a204dc07c14987e01520385a025aeea4be1f950510b92f7859a60: Status 404 returned error can't find the container with id 7f7e328e0f6a204dc07c14987e01520385a025aeea4be1f950510b92f7859a60
Sep 11 13:21:20.339303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.339220    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:20.339434 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.339337    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:20.339434 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.339422    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 13:21:20.339551 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.339422    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:20.339551 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.339477    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls podName:43569d2e-e251-4bf1-b5d8-e8fc8a5152d2 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:28.339461328 +0000 UTC m=+104.552005127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-l6vkg" (UID: "43569d2e-e251-4bf1-b5d8-e8fc8a5152d2") : secret "samples-operator-tls" not found
Sep 11 13:21:20.339551 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.339490    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls podName:6a21b9e9-524e-4767-9a39-99a8a657ab6b nodeName:}" failed. No retries permitted until 2026-09-11 13:21:28.339484156 +0000 UTC m=+104.552027934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-mqlhz" (UID: "6a21b9e9-524e-4767-9a39-99a8a657ab6b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:20.440274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.440234    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:20.440451 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.440412    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 13:21:20.440451 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.440434    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867778758f-9xvdz: secret "image-registry-tls" not found
Sep 11 13:21:20.440523 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.440504    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls podName:85b5025b-29a8-4ac6-aa36-994dc6aea436 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:28.440481948 +0000 UTC m=+104.653025730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls") pod "image-registry-867778758f-9xvdz" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436") : secret "image-registry-tls" not found
Sep 11 13:21:20.634741 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.634703    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnpjd_6c845ef0-180c-4ff1-b233-28c59f946cf4/serve-healthcheck-canary/0.log"
Sep 11 13:21:20.641893 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.641867    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:20.642046 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.641906    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:20.642046 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.642010    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:20.642149 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.642011    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:20.642149 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.642056    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:24.642043311 +0000 UTC m=+100.854587088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:20.642149 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:20.642086    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:24.642075534 +0000 UTC m=+100.854619330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:20.750723 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.750690    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-hwrjr" event={"ID":"35668cbf-37e2-4acd-acbd-c637a487b4ab","Type":"ContainerStarted","Data":"5dc97ddc7622ee9618449d3cefa48a18e7a0a79222940618b34ed8ae23037826"}
Sep 11 13:21:20.750893 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.750739    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-hwrjr" event={"ID":"35668cbf-37e2-4acd-acbd-c637a487b4ab","Type":"ContainerStarted","Data":"7f7e328e0f6a204dc07c14987e01520385a025aeea4be1f950510b92f7859a60"}
Sep 11 13:21:20.776844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:20.776786    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-hwrjr" podStartSLOduration=1.776768455 podStartE2EDuration="1.776768455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:20.776150728 +0000 UTC m=+96.988694530" watchObservedRunningTime="2026-09-11 13:21:20.776768455 +0000 UTC m=+96.989312260"
Sep 11 13:21:21.550665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:21.550619    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:21:21.550838 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:21.550808    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 13:21:21.550908 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:21.550891    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls podName:c9f10b3c-8ff1-4961-bcce-3a61421a0c62 nodeName:}" failed. No retries permitted until 2026-09-11 13:22:25.550867897 +0000 UTC m=+161.763411694 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls") pod "dns-default-pffhb" (UID: "c9f10b3c-8ff1-4961-bcce-3a61421a0c62") : secret "dns-default-metrics-tls" not found
Sep 11 13:21:22.922578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:22.922538    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:22.923026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:22.922949    2547 scope.go:117] "RemoveContainer" containerID="a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80"
Sep 11 13:21:22.923116 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:22.923098    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9t97_openshift-console-operator(8150f5a9-fdfa-49ba-931d-1916f3fcceac)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" podUID="8150f5a9-fdfa-49ba-931d-1916f3fcceac"
Sep 11 13:21:24.675527 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:24.675482    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:24.675527 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:24.675530    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:24.676042 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:24.675604    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 13:21:24.676042 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:24.675659    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:32.675644786 +0000 UTC m=+108.888188577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : configmap "kube-rbac-proxy" not found
Sep 11 13:21:24.676042 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:24.675656    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:24.676042 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:24.675711    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls podName:39638151-daec-4a22-aae7-4c237951def4 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:32.675697297 +0000 UTC m=+108.888241093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zx8wz" (UID: "39638151-daec-4a22-aae7-4c237951def4") : secret "insights-runtime-extractor-tls" not found
Sep 11 13:21:25.670663 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:25.670632    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-76vfp"
Sep 11 13:21:25.729376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:25.729328    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:25.729799 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:25.729752    2547 scope.go:117] "RemoveContainer" containerID="a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80"
Sep 11 13:21:25.729941 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:25.729905    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-t9t97_openshift-console-operator(8150f5a9-fdfa-49ba-931d-1916f3fcceac)\"" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" podUID="8150f5a9-fdfa-49ba-931d-1916f3fcceac"
Sep 11 13:21:28.408317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.408277    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:28.408317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.408331    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:28.408868 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:28.408463    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:28.408868 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:28.408544    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls podName:6a21b9e9-524e-4767-9a39-99a8a657ab6b nodeName:}" failed. No retries permitted until 2026-09-11 13:21:44.408520693 +0000 UTC m=+120.621064484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-mqlhz" (UID: "6a21b9e9-524e-4767-9a39-99a8a657ab6b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 13:21:28.410824 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.410786    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/43569d2e-e251-4bf1-b5d8-e8fc8a5152d2-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-l6vkg\" (UID: \"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:28.509427 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.509388    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:28.511853 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.511824    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"image-registry-867778758f-9xvdz\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") " pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:28.538871 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.538829    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"
Sep 11 13:21:28.634509 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.634379    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:28.846790 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.846757    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg"]
Sep 11 13:21:28.940195 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:28.937821    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867778758f-9xvdz"]
Sep 11 13:21:28.940622 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:28.940519    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b5025b_29a8_4ac6_aa36_994dc6aea436.slice/crio-4d6827a0123a9be56fc886c3013b490e8734154ddc5ab10a8e19554ec115fad9 WatchSource:0}: Error finding container 4d6827a0123a9be56fc886c3013b490e8734154ddc5ab10a8e19554ec115fad9: Status 404 returned error can't find the container with id 4d6827a0123a9be56fc886c3013b490e8734154ddc5ab10a8e19554ec115fad9
Sep 11 13:21:29.780212 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:29.780173    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867778758f-9xvdz" event={"ID":"85b5025b-29a8-4ac6-aa36-994dc6aea436","Type":"ContainerStarted","Data":"923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f"}
Sep 11 13:21:29.780711 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:29.780247    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867778758f-9xvdz" event={"ID":"85b5025b-29a8-4ac6-aa36-994dc6aea436","Type":"ContainerStarted","Data":"4d6827a0123a9be56fc886c3013b490e8734154ddc5ab10a8e19554ec115fad9"}
Sep 11 13:21:29.780711 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:29.780328    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:29.781520 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:29.781496    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg" event={"ID":"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2","Type":"ContainerStarted","Data":"c8325301204cb0626b4798c07185076236792daca6d8b48520cc7627dc02acc5"}
Sep 11 13:21:29.810213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:29.810151    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-867778758f-9xvdz" podStartSLOduration=17.810125983 podStartE2EDuration="17.810125983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:29.809073397 +0000 UTC m=+106.021617197" watchObservedRunningTime="2026-09-11 13:21:29.810125983 +0000 UTC m=+106.022669784"
Sep 11 13:21:30.786774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:30.786734    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg" event={"ID":"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2","Type":"ContainerStarted","Data":"abf16d2afeb20e4fc7f2323dc44c5364991e4c9aa1da048e0a629a5a5b0678c7"}
Sep 11 13:21:30.787265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:30.786799    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg" event={"ID":"43569d2e-e251-4bf1-b5d8-e8fc8a5152d2","Type":"ContainerStarted","Data":"bb16a692c564cce62e42ad2006d0094c6f09d14ac02786bd9c27348f6b274362"}
Sep 11 13:21:30.807167 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:30.807051    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-l6vkg" podStartSLOduration=17.18176003 podStartE2EDuration="18.807030912s" totalImagesPullingTime="1.625270882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:30.806168583 +0000 UTC m=+107.018712395" watchObservedRunningTime="2026-09-11 13:21:30.807030912 +0000 UTC m=+107.019574711"
Sep 11 13:21:32.745973 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:32.745937    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:32.745973 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:32.745981    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:32.746482 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:32.746464    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39638151-daec-4a22-aae7-4c237951def4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:32.748368 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:32.748335    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39638151-daec-4a22-aae7-4c237951def4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zx8wz\" (UID: \"39638151-daec-4a22-aae7-4c237951def4\") " pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:32.815474 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:32.815436    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zx8wz"
Sep 11 13:21:33.092000 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:33.091927    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zx8wz"]
Sep 11 13:21:33.095343 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:33.095306    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39638151_daec_4a22_aae7_4c237951def4.slice/crio-040f4f936ce2b96394d58dff6b053a9cf42916031204f497afdcbdcffb65a52e WatchSource:0}: Error finding container 040f4f936ce2b96394d58dff6b053a9cf42916031204f497afdcbdcffb65a52e: Status 404 returned error can't find the container with id 040f4f936ce2b96394d58dff6b053a9cf42916031204f497afdcbdcffb65a52e
Sep 11 13:21:33.797613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:33.797585    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zx8wz" event={"ID":"39638151-daec-4a22-aae7-4c237951def4","Type":"ContainerStarted","Data":"f4f3cca41196d6615699d79bce9c401236273d6fb6a59623f2c7d4d98a9f4ac5"}
Sep 11 13:21:33.797946 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:33.797638    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zx8wz" event={"ID":"39638151-daec-4a22-aae7-4c237951def4","Type":"ContainerStarted","Data":"040f4f936ce2b96394d58dff6b053a9cf42916031204f497afdcbdcffb65a52e"}
Sep 11 13:21:34.803408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:34.803372    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zx8wz" event={"ID":"39638151-daec-4a22-aae7-4c237951def4","Type":"ContainerStarted","Data":"97ecd0cdbf134117af1d0c86e273094ef79dd7f5a40f6860fec6a189460beb49"}
Sep 11 13:21:35.808658 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:35.808622    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zx8wz" event={"ID":"39638151-daec-4a22-aae7-4c237951def4","Type":"ContainerStarted","Data":"f9f5313e162a2bc0b67f33d5e8049bfc47c7ce8b0e27e9a0d816eb02e29c1f2b"}
Sep 11 13:21:35.835054 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:35.835000    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zx8wz" podStartSLOduration=17.81021205 podStartE2EDuration="19.834982363s" totalImagesPullingTime="2.024770313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:21:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:35.834379478 +0000 UTC m=+112.046923282" watchObservedRunningTime="2026-09-11 13:21:35.834982363 +0000 UTC m=+112.047526162"
Sep 11 13:21:41.243376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:41.243341    2547 scope.go:117] "RemoveContainer" containerID="a41507b3e2d85879e1b037f88c41628f1f47b4d9b609608888dc7d45e6c4cd80"
Sep 11 13:21:41.473272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:41.473239    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-867778758f-9xvdz"]
Sep 11 13:21:41.830239 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:41.830209    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:21:41.830438 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:41.830307    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-t9t97" event={"ID":"8150f5a9-fdfa-49ba-931d-1916f3fcceac","Type":"ContainerStarted","Data":"b270f4e2094df6b7860f3a813c6381bb6ca5198bcaf6bd4ffc27bc77df47f71e"}
Sep 11 13:21:41.830611 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:41.830590    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:42.191067 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.191040    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-t9t97"
Sep 11 13:21:42.567362 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.567273    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-lz5vp"]
Sep 11 13:21:42.570532 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.570506    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:21:42.577037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.577016    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 13:21:42.577173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.577084    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 13:21:42.577173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.577131    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4pdnt\""
Sep 11 13:21:42.603616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.603582    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-lz5vp"]
Sep 11 13:21:42.722282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.722249    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8kcp\" (UniqueName: \"kubernetes.io/projected/41868a76-73de-4cb6-955a-218c8377876e-kube-api-access-x8kcp\") pod \"downloads-76f99584f4-lz5vp\" (UID: \"41868a76-73de-4cb6-955a-218c8377876e\") " pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:21:42.823321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.823247    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8kcp\" (UniqueName: \"kubernetes.io/projected/41868a76-73de-4cb6-955a-218c8377876e-kube-api-access-x8kcp\") pod \"downloads-76f99584f4-lz5vp\" (UID: \"41868a76-73de-4cb6-955a-218c8377876e\") " pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:21:42.866224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.866190    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8kcp\" (UniqueName: \"kubernetes.io/projected/41868a76-73de-4cb6-955a-218c8377876e-kube-api-access-x8kcp\") pod \"downloads-76f99584f4-lz5vp\" (UID: \"41868a76-73de-4cb6-955a-218c8377876e\") " pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:21:42.879076 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:42.879044    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:21:43.164168 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:43.164134    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-lz5vp"]
Sep 11 13:21:43.166927 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:43.166888    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41868a76_73de_4cb6_955a_218c8377876e.slice/crio-a9e8e3e4b58cd2033ea0482278cb9f16fd5e1656a223eaf962c520e79cbf2b23 WatchSource:0}: Error finding container a9e8e3e4b58cd2033ea0482278cb9f16fd5e1656a223eaf962c520e79cbf2b23: Status 404 returned error can't find the container with id a9e8e3e4b58cd2033ea0482278cb9f16fd5e1656a223eaf962c520e79cbf2b23
Sep 11 13:21:43.842136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:43.842101    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-lz5vp" event={"ID":"41868a76-73de-4cb6-955a-218c8377876e","Type":"ContainerStarted","Data":"a9e8e3e4b58cd2033ea0482278cb9f16fd5e1656a223eaf962c520e79cbf2b23"}
Sep 11 13:21:44.436613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:44.436576    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:44.439276 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:44.439241    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a21b9e9-524e-4767-9a39-99a8a657ab6b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-mqlhz\" (UID: \"6a21b9e9-524e-4767-9a39-99a8a657ab6b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:44.733870 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:44.733792    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pdzd4\""
Sep 11 13:21:44.741670 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:44.741632    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"
Sep 11 13:21:45.022662 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:45.022584    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz"]
Sep 11 13:21:45.026556 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:45.026518    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a21b9e9_524e_4767_9a39_99a8a657ab6b.slice/crio-832a3ae0bc7da8fe6e97699b8ad7e1ea2b6da1eb7316fb031fac1f577fb8c053 WatchSource:0}: Error finding container 832a3ae0bc7da8fe6e97699b8ad7e1ea2b6da1eb7316fb031fac1f577fb8c053: Status 404 returned error can't find the container with id 832a3ae0bc7da8fe6e97699b8ad7e1ea2b6da1eb7316fb031fac1f577fb8c053
Sep 11 13:21:45.851844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:45.851804    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz" event={"ID":"6a21b9e9-524e-4767-9a39-99a8a657ab6b","Type":"ContainerStarted","Data":"832a3ae0bc7da8fe6e97699b8ad7e1ea2b6da1eb7316fb031fac1f577fb8c053"}
Sep 11 13:21:47.862612 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.862538    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz" event={"ID":"6a21b9e9-524e-4767-9a39-99a8a657ab6b","Type":"ContainerStarted","Data":"e0cba59ab5b35cf0ffb9b1b96338f79cb276e4b8942b8733c34499dd855edfbb"}
Sep 11 13:21:47.883676 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.883613    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-mqlhz" podStartSLOduration=33.553746916 podStartE2EDuration="35.883583772s" totalImagesPullingTime="2.329836856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:47.8832343 +0000 UTC m=+124.095778101" watchObservedRunningTime="2026-09-11 13:21:47.883583772 +0000 UTC m=+124.096127575"
Sep 11 13:21:47.888512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.888478    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"]
Sep 11 13:21:47.890696 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.890671    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:47.894180 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.894151    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 13:21:47.894810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.894782    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p7chx\""
Sep 11 13:21:47.908678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:47.908643    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"]
Sep 11 13:21:48.068313 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:48.068271    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97984e7c-dde8-42d1-883a-4d89fde373b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-4wkjz\" (UID: \"97984e7c-dde8-42d1-883a-4d89fde373b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:48.169448 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:48.169404    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97984e7c-dde8-42d1-883a-4d89fde373b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-4wkjz\" (UID: \"97984e7c-dde8-42d1-883a-4d89fde373b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:48.172157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:48.172133    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97984e7c-dde8-42d1-883a-4d89fde373b3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-4wkjz\" (UID: \"97984e7c-dde8-42d1-883a-4d89fde373b3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:48.203091 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:48.203054    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:48.481480 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:48.481398    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"]
Sep 11 13:21:48.484428 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:48.484387    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97984e7c_dde8_42d1_883a_4d89fde373b3.slice/crio-c2b25a19623c559a245f7a619958c62d7158697343a01f2474e6fd66098ae056 WatchSource:0}: Error finding container c2b25a19623c559a245f7a619958c62d7158697343a01f2474e6fd66098ae056: Status 404 returned error can't find the container with id c2b25a19623c559a245f7a619958c62d7158697343a01f2474e6fd66098ae056
Sep 11 13:21:48.868383 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:48.868288    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz" event={"ID":"97984e7c-dde8-42d1-883a-4d89fde373b3","Type":"ContainerStarted","Data":"c2b25a19623c559a245f7a619958c62d7158697343a01f2474e6fd66098ae056"}
Sep 11 13:21:50.878058 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:50.878018    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz" event={"ID":"97984e7c-dde8-42d1-883a-4d89fde373b3","Type":"ContainerStarted","Data":"801938bf4142567012b05c097eb243633776410f8a452f2f8ce126e04fb00ba0"}
Sep 11 13:21:50.878523 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:50.878279    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:50.885607 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:50.885572    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz"
Sep 11 13:21:50.922458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:50.922391    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-4wkjz" podStartSLOduration=2.525271161 podStartE2EDuration="3.922370346s" totalImagesPullingTime="1.397099185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:50.899540385 +0000 UTC m=+127.112084184" watchObservedRunningTime="2026-09-11 13:21:50.922370346 +0000 UTC m=+127.134914145"
Sep 11 13:21:51.479446 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.479419    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:21:51.569943 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.569874    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665ff95794-wdswr"]
Sep 11 13:21:51.573270 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.573246    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.579488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.579267    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 13:21:51.579488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.579267    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 13:21:51.579488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.579311    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 13:21:51.579488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.579276    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 13:21:51.579488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.579437    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 13:21:51.580359 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.580338    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6dnkk\""
Sep 11 13:21:51.594213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.594178    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665ff95794-wdswr"]
Sep 11 13:21:51.697349 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.697314    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-serving-cert\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.697349 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.697361    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-oauth-config\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.697610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.697399    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-service-ca\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.697610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.697442    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-oauth-serving-cert\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.697610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.697526    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-config\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.697610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.697592    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2x7f\" (UniqueName: \"kubernetes.io/projected/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-kube-api-access-z2x7f\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.798785 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.798691    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-oauth-config\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.798785 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.798749    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-service-ca\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.799017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.798788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-oauth-serving-cert\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.799017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.798934    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-config\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.799439 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.799398    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2x7f\" (UniqueName: \"kubernetes.io/projected/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-kube-api-access-z2x7f\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.799546 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.799482    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-serving-cert\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.800109 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.800089    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-oauth-serving-cert\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.800702 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.800681    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-config\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.804433 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.801485    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-service-ca\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.804433 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.802464    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-serving-cert\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.806117 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.806096    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-oauth-config\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.810744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.810718    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2x7f\" (UniqueName: \"kubernetes.io/projected/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-kube-api-access-z2x7f\") pod \"console-665ff95794-wdswr\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") " pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:51.884304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:51.884260    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:21:52.234982 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:52.234948    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665ff95794-wdswr"]
Sep 11 13:21:52.238712 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:21:52.238681    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefb1805_f5cf_4b0a_b547_22dc6d8ca74b.slice/crio-12e17a9133b84a54c5b99838a9aa95f9c142c05f57adc9f961741655d334fa99 WatchSource:0}: Error finding container 12e17a9133b84a54c5b99838a9aa95f9c142c05f57adc9f961741655d334fa99: Status 404 returned error can't find the container with id 12e17a9133b84a54c5b99838a9aa95f9c142c05f57adc9f961741655d334fa99
Sep 11 13:21:52.887300 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:52.887259    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ff95794-wdswr" event={"ID":"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b","Type":"ContainerStarted","Data":"12e17a9133b84a54c5b99838a9aa95f9c142c05f57adc9f961741655d334fa99"}
Sep 11 13:21:53.010240 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:53.010197    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:21:53.012870 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:53.012833    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/90de78bd-4709-4ea2-879f-1178fcecf024-metrics-certs\") pod \"network-metrics-daemon-zzf9j\" (UID: \"90de78bd-4709-4ea2-879f-1178fcecf024\") " pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:21:53.069491 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:53.069453    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2xgs9\""
Sep 11 13:21:53.077001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:53.076967    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzf9j"
Sep 11 13:21:56.505921 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.505869    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"]
Sep 11 13:21:56.509781 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.509719    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.518303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.518073    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 13:21:56.518970 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.518762    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 13:21:56.519536 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.519364    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 13:21:56.519536 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.519396    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m6r25\""
Sep 11 13:21:56.534521 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.534433    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"]
Sep 11 13:21:56.537976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.537570    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9597m\" (UniqueName: \"kubernetes.io/projected/5b6901dc-911f-4a02-977d-c93e223fba18-kube-api-access-9597m\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.537976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.537659    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b6901dc-911f-4a02-977d-c93e223fba18-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.537976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.537689    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b6901dc-911f-4a02-977d-c93e223fba18-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.537976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.537770    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b6901dc-911f-4a02-977d-c93e223fba18-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.549454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.545812    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"]
Sep 11 13:21:56.554236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.554204    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.558787 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.558759    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 13:21:56.559071 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.559051    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 13:21:56.559368 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.558899    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 13:21:56.562578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.562541    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-srnm6\""
Sep 11 13:21:56.581783 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.581751    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4rkx"]
Sep 11 13:21:56.585828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.585804    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.595643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.593219    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 13:21:56.595643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.593381    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t4pnf\""
Sep 11 13:21:56.595643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.593439    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 13:21:56.595643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.593525    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 13:21:56.595643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.595511    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"]
Sep 11 13:21:56.639001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.638957    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.639198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639025    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b6901dc-911f-4a02-977d-c93e223fba18-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.639198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639059    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.639198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639088    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-tls\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639172    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-sys\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639215    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d0f8b4-5c38-46dd-9663-d78b106b9754-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.639425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639241    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639303    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns667\" (UniqueName: \"kubernetes.io/projected/8262aaaf-99c7-4470-bef0-4d59274cb45a-kube-api-access-ns667\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639337    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639402    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-textfile\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8262aaaf-99c7-4470-bef0-4d59274cb45a-metrics-client-ca\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639461    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9597m\" (UniqueName: \"kubernetes.io/projected/5b6901dc-911f-4a02-977d-c93e223fba18-kube-api-access-9597m\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639514    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b6901dc-911f-4a02-977d-c93e223fba18-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639539    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b6901dc-911f-4a02-977d-c93e223fba18-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639566    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7vd\" (UniqueName: \"kubernetes.io/projected/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-api-access-kh7vd\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639596    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44d0f8b4-5c38-46dd-9663-d78b106b9754-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639634    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.639667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639662    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-wtmp\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.640070 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.639693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-root\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.640755 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.640719    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b6901dc-911f-4a02-977d-c93e223fba18-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.642555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.642523    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b6901dc-911f-4a02-977d-c93e223fba18-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.643493 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.643461    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b6901dc-911f-4a02-977d-c93e223fba18-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.662258 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.662229    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9597m\" (UniqueName: \"kubernetes.io/projected/5b6901dc-911f-4a02-977d-c93e223fba18-kube-api-access-9597m\") pod \"openshift-state-metrics-67dcf8c979-wb5c6\" (UID: \"5b6901dc-911f-4a02-977d-c93e223fba18\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.740743    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-sys\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.740806    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d0f8b4-5c38-46dd-9663-d78b106b9754-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.740834    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.740862    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns667\" (UniqueName: \"kubernetes.io/projected/8262aaaf-99c7-4470-bef0-4d59274cb45a-kube-api-access-ns667\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.740891    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.740961    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-textfile\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741013    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8262aaaf-99c7-4470-bef0-4d59274cb45a-metrics-client-ca\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741066    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7vd\" (UniqueName: \"kubernetes.io/projected/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-api-access-kh7vd\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44d0f8b4-5c38-46dd-9663-d78b106b9754-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741132    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741163    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-wtmp\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741190    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-root\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741267    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.741486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-tls\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.742384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.741621    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-wtmp\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.742384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.742303    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/44d0f8b4-5c38-46dd-9663-d78b106b9754-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.743075 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:56.742610    2547 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 13:21:56.743075 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:21:56.742683    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-tls podName:44d0f8b4-5c38-46dd-9663-d78b106b9754 nodeName:}" failed. No retries permitted until 2026-09-11 13:21:57.242664192 +0000 UTC m=+133.455207981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-jjfhh" (UID: "44d0f8b4-5c38-46dd-9663-d78b106b9754") : secret "kube-state-metrics-tls" not found
Sep 11 13:21:56.743075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.742738    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-root\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.743075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.742621    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8262aaaf-99c7-4470-bef0-4d59274cb45a-sys\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.743075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.743028    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.743422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.743322    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44d0f8b4-5c38-46dd-9663-d78b106b9754-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.744316 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.743817    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8262aaaf-99c7-4470-bef0-4d59274cb45a-metrics-client-ca\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.744316 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.744107    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-textfile\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.744316 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.744275    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.744541 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.744469    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-tls\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.745928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.745871    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.746894 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.746744    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8262aaaf-99c7-4470-bef0-4d59274cb45a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.754986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.754951    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7vd\" (UniqueName: \"kubernetes.io/projected/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-api-access-kh7vd\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:56.756764 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.756695    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns667\" (UniqueName: \"kubernetes.io/projected/8262aaaf-99c7-4470-bef0-4d59274cb45a-kube-api-access-ns667\") pod \"node-exporter-s4rkx\" (UID: \"8262aaaf-99c7-4470-bef0-4d59274cb45a\") " pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:56.824562 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.824522    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"
Sep 11 13:21:56.901895 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:56.901860    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4rkx"
Sep 11 13:21:57.245478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:57.245438    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:57.248702 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:57.248675    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/44d0f8b4-5c38-46dd-9663-d78b106b9754-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-jjfhh\" (UID: \"44d0f8b4-5c38-46dd-9663-d78b106b9754\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:57.467425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:57.467387    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"
Sep 11 13:21:59.920477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.920438    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f785f5df4-w6x2d"]
Sep 11 13:21:59.924136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.924114    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.946688 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.946647    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 13:21:59.967925 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.967857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-trusted-ca-bundle\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.968098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.967938    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghn7\" (UniqueName: \"kubernetes.io/projected/2aaf459c-880b-4ba4-b4b3-5d61e6794354-kube-api-access-wghn7\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.968098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.967992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-service-ca\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.968098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.968040    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-serving-cert\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.968275 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.968116    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-oauth-serving-cert\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.968275 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.968176    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-oauth-config\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:21:59.968275 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:21:59.968199    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-config\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.011501 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.011415    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f785f5df4-w6x2d"]
Sep 11 13:22:00.069079 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069036    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-service-ca\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-serving-cert\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069133    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-oauth-serving-cert\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069186    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-oauth-config\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069207    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-config\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069255    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-trusted-ca-bundle\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069526 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069299    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghn7\" (UniqueName: \"kubernetes.io/projected/2aaf459c-880b-4ba4-b4b3-5d61e6794354-kube-api-access-wghn7\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.069982 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.069893    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-service-ca\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.070101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.070003    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-oauth-serving-cert\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.070101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.070062    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-config\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.070322 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.070300    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-trusted-ca-bundle\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.071923 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.071887    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-serving-cert\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.072082 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.072057    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-oauth-config\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.092616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.092581    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghn7\" (UniqueName: \"kubernetes.io/projected/2aaf459c-880b-4ba4-b4b3-5d61e6794354-kube-api-access-wghn7\") pod \"console-5f785f5df4-w6x2d\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") " pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:00.236018 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:00.235894    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:01.256611 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.256575    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"]
Sep 11 13:22:01.265290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.265247    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.277615 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.277582    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"]
Sep 11 13:22:01.280548 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.280522    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d73f034f-bd45-4b8b-8814-8d88c2a9b943-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8lqlf\" (UID: \"d73f034f-bd45-4b8b-8814-8d88c2a9b943\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.280691 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.280575    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl8tc\" (UniqueName: \"kubernetes.io/projected/d73f034f-bd45-4b8b-8814-8d88c2a9b943-kube-api-access-tl8tc\") pod \"monitoring-plugin-5d85778b9d-8lqlf\" (UID: \"d73f034f-bd45-4b8b-8814-8d88c2a9b943\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.281136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.281112    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5pqbc\""
Sep 11 13:22:01.282502 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.282478    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 13:22:01.381967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.381927    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d73f034f-bd45-4b8b-8814-8d88c2a9b943-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8lqlf\" (UID: \"d73f034f-bd45-4b8b-8814-8d88c2a9b943\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.381967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.381972    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl8tc\" (UniqueName: \"kubernetes.io/projected/d73f034f-bd45-4b8b-8814-8d88c2a9b943-kube-api-access-tl8tc\") pod \"monitoring-plugin-5d85778b9d-8lqlf\" (UID: \"d73f034f-bd45-4b8b-8814-8d88c2a9b943\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.384390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.384360    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d73f034f-bd45-4b8b-8814-8d88c2a9b943-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8lqlf\" (UID: \"d73f034f-bd45-4b8b-8814-8d88c2a9b943\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.392881 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.392850    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl8tc\" (UniqueName: \"kubernetes.io/projected/d73f034f-bd45-4b8b-8814-8d88c2a9b943-kube-api-access-tl8tc\") pod \"monitoring-plugin-5d85778b9d-8lqlf\" (UID: \"d73f034f-bd45-4b8b-8814-8d88c2a9b943\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.408944 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:01.408888    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8262aaaf_99c7_4470_bef0_4d59274cb45a.slice/crio-26bb526831ed8efc5a3200f3c9e73a53cfb14bae03f299b85d0f766e1762127c WatchSource:0}: Error finding container 26bb526831ed8efc5a3200f3c9e73a53cfb14bae03f299b85d0f766e1762127c: Status 404 returned error can't find the container with id 26bb526831ed8efc5a3200f3c9e73a53cfb14bae03f299b85d0f766e1762127c
Sep 11 13:22:01.577883 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.577837    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:01.717585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.717544    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6"]
Sep 11 13:22:01.730242 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.730195    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zzf9j"]
Sep 11 13:22:01.732689 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:01.732654    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90de78bd_4709_4ea2_879f_1178fcecf024.slice/crio-8f929fbd9aa1242d627453cf8c991e4616f2a1ac97a57b54c5d5effcde7bf919 WatchSource:0}: Error finding container 8f929fbd9aa1242d627453cf8c991e4616f2a1ac97a57b54c5d5effcde7bf919: Status 404 returned error can't find the container with id 8f929fbd9aa1242d627453cf8c991e4616f2a1ac97a57b54c5d5effcde7bf919
Sep 11 13:22:01.733719 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:01.733672    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6901dc_911f_4a02_977d_c93e223fba18.slice/crio-e462db2af14d118958284f8bf87414357319b2feba067bac6634aacb7ec0e1cf WatchSource:0}: Error finding container e462db2af14d118958284f8bf87414357319b2feba067bac6634aacb7ec0e1cf: Status 404 returned error can't find the container with id e462db2af14d118958284f8bf87414357319b2feba067bac6634aacb7ec0e1cf
Sep 11 13:22:01.742342 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.742027    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh"]
Sep 11 13:22:01.746948 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:01.746899    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d0f8b4_5c38_46dd_9663_d78b106b9754.slice/crio-aebc4914a1af516d7c8f64a84987c29382a0ca938c60da45440e1b03815069cb WatchSource:0}: Error finding container aebc4914a1af516d7c8f64a84987c29382a0ca938c60da45440e1b03815069cb: Status 404 returned error can't find the container with id aebc4914a1af516d7c8f64a84987c29382a0ca938c60da45440e1b03815069cb
Sep 11 13:22:01.753549 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.753520    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f785f5df4-w6x2d"]
Sep 11 13:22:01.758172 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:01.758144    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aaf459c_880b_4ba4_b4b3_5d61e6794354.slice/crio-962afdcaafae62b5b834a7d52b0243f3f710f91984229ee8047a2aa4d81df4b7 WatchSource:0}: Error finding container 962afdcaafae62b5b834a7d52b0243f3f710f91984229ee8047a2aa4d81df4b7: Status 404 returned error can't find the container with id 962afdcaafae62b5b834a7d52b0243f3f710f91984229ee8047a2aa4d81df4b7
Sep 11 13:22:01.883531 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.883489    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"]
Sep 11 13:22:01.888890 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:01.888818    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73f034f_bd45_4b8b_8814_8d88c2a9b943.slice/crio-fa4daa74ba3a7ce61a6886c22308bfefa7198ca0392d763f324555c3e2c524c2 WatchSource:0}: Error finding container fa4daa74ba3a7ce61a6886c22308bfefa7198ca0392d763f324555c3e2c524c2: Status 404 returned error can't find the container with id fa4daa74ba3a7ce61a6886c22308bfefa7198ca0392d763f324555c3e2c524c2
Sep 11 13:22:01.930023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.929895    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzf9j" event={"ID":"90de78bd-4709-4ea2-879f-1178fcecf024","Type":"ContainerStarted","Data":"8f929fbd9aa1242d627453cf8c991e4616f2a1ac97a57b54c5d5effcde7bf919"}
Sep 11 13:22:01.933016 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.932719    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ff95794-wdswr" event={"ID":"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b","Type":"ContainerStarted","Data":"426e87859226bd4480e4d7bfee2888e999e5db07c4d9e6b333b12ed88295addf"}
Sep 11 13:22:01.938751 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.938634    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-lz5vp" event={"ID":"41868a76-73de-4cb6-955a-218c8377876e","Type":"ContainerStarted","Data":"56d1e7da76f7d24bda7de789daa76abc9d36af2c7d52517a3755a1224e5959d0"}
Sep 11 13:22:01.939750 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.939726    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:22:01.942422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.942280    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6" event={"ID":"5b6901dc-911f-4a02-977d-c93e223fba18","Type":"ContainerStarted","Data":"5c83063f5d3153130e1ce8613a728dbbd599f50966f33e86f3d05befac58df6a"}
Sep 11 13:22:01.942422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.942359    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6" event={"ID":"5b6901dc-911f-4a02-977d-c93e223fba18","Type":"ContainerStarted","Data":"b59aac620f1183d9005e817c7eb6f319a74b15c3f3f3ae0f7da12c4617a3b4a0"}
Sep 11 13:22:01.942422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.942390    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6" event={"ID":"5b6901dc-911f-4a02-977d-c93e223fba18","Type":"ContainerStarted","Data":"e462db2af14d118958284f8bf87414357319b2feba067bac6634aacb7ec0e1cf"}
Sep 11 13:22:01.943850 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.943788    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf" event={"ID":"d73f034f-bd45-4b8b-8814-8d88c2a9b943","Type":"ContainerStarted","Data":"fa4daa74ba3a7ce61a6886c22308bfefa7198ca0392d763f324555c3e2c524c2"}
Sep 11 13:22:01.944589 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.944546    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-lz5vp"
Sep 11 13:22:01.947159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.946546    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f785f5df4-w6x2d" event={"ID":"2aaf459c-880b-4ba4-b4b3-5d61e6794354","Type":"ContainerStarted","Data":"75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7"}
Sep 11 13:22:01.947159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.946587    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f785f5df4-w6x2d" event={"ID":"2aaf459c-880b-4ba4-b4b3-5d61e6794354","Type":"ContainerStarted","Data":"962afdcaafae62b5b834a7d52b0243f3f710f91984229ee8047a2aa4d81df4b7"}
Sep 11 13:22:01.948776 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.948726    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh" event={"ID":"44d0f8b4-5c38-46dd-9663-d78b106b9754","Type":"ContainerStarted","Data":"aebc4914a1af516d7c8f64a84987c29382a0ca938c60da45440e1b03815069cb"}
Sep 11 13:22:01.950886 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:01.950858    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4rkx" event={"ID":"8262aaaf-99c7-4470-bef0-4d59274cb45a","Type":"ContainerStarted","Data":"26bb526831ed8efc5a3200f3c9e73a53cfb14bae03f299b85d0f766e1762127c"}
Sep 11 13:22:02.004187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:02.004128    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-lz5vp" podStartSLOduration=1.7196519449999998 podStartE2EDuration="20.004104675s" totalImagesPullingTime="18.28445273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:02.004097527 +0000 UTC m=+138.216641328" watchObservedRunningTime="2026-09-11 13:22:02.004104675 +0000 UTC m=+138.216648477"
Sep 11 13:22:02.004751 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:02.004714    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665ff95794-wdswr" podStartSLOduration=1.830674278 podStartE2EDuration="11.004700296s" totalImagesPullingTime="9.174026018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:01.964489687 +0000 UTC m=+138.177033490" watchObservedRunningTime="2026-09-11 13:22:02.004700296 +0000 UTC m=+138.217244096"
Sep 11 13:22:02.962936 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:02.962771    2547 generic.go:356] "Generic (PLEG): container finished" podID="8262aaaf-99c7-4470-bef0-4d59274cb45a" containerID="65a734e44174451665e073fe38dbaef0e29f08f002a747486ea660f8ee7d7f40" exitCode=0
Sep 11 13:22:02.963644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:02.963487    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4rkx" event={"ID":"8262aaaf-99c7-4470-bef0-4d59274cb45a","Type":"ContainerDied","Data":"65a734e44174451665e073fe38dbaef0e29f08f002a747486ea660f8ee7d7f40"}
Sep 11 13:22:02.995392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:02.993156    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f785f5df4-w6x2d" podStartSLOduration=3.993126039 podStartE2EDuration="3.993126039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:02.045295904 +0000 UTC m=+138.257839707" watchObservedRunningTime="2026-09-11 13:22:02.993126039 +0000 UTC m=+139.205669841"
Sep 11 13:22:03.976314 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:03.976272    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4rkx" event={"ID":"8262aaaf-99c7-4470-bef0-4d59274cb45a","Type":"ContainerStarted","Data":"b09f5d02cd282a15ba67f17d94587d2ce25856b8bdecd17acb686fd2e6734615"}
Sep 11 13:22:03.976849 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:03.976334    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4rkx" event={"ID":"8262aaaf-99c7-4470-bef0-4d59274cb45a","Type":"ContainerStarted","Data":"3130a5186db9fde8985a2946360e66920f8661052795a17b05810ccf0d955d37"}
Sep 11 13:22:04.758905 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:04.758842    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4rkx" podStartSLOduration=7.613459412 podStartE2EDuration="8.758825973s" totalImagesPullingTime="1.064556176s" totalInitContainerRuntime="80.810385ms" isStatefulPod=true podCreationTimestamp="2026-09-11 13:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:04.744711273 +0000 UTC m=+140.957255079" watchObservedRunningTime="2026-09-11 13:22:04.758825973 +0000 UTC m=+140.971369772"
Sep 11 13:22:06.492588 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.492480    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-867778758f-9xvdz" podUID="85b5025b-29a8-4ac6-aa36-994dc6aea436" containerName="registry" containerID="cri-o://923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f" gracePeriod=30
Sep 11 13:22:06.775430 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.775397    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:22:06.846775 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.846732    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b5025b-29a8-4ac6-aa36-994dc6aea436-ca-trust-extracted\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.846984 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.846810    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwm7d\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-kube-api-access-mwm7d\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.846984 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.846874    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.846984 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.846902    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-image-registry-private-configuration\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.846984 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.846968    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-trusted-ca\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.847214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.846994    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-bound-sa-token\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.847214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.847028    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-installation-pull-secrets\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.847214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.847067    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-certificates\") pod \"85b5025b-29a8-4ac6-aa36-994dc6aea436\" (UID: \"85b5025b-29a8-4ac6-aa36-994dc6aea436\") "
Sep 11 13:22:06.847409 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.847379    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:06.847848 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.847625    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:06.849940 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.849851    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:22:06.850169 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.850137    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:22:06.850271 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.850216    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:06.850838 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.850809    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:06.852109 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.852075    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-kube-api-access-mwm7d" (OuterVolumeSpecName: "kube-api-access-mwm7d") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "kube-api-access-mwm7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:06.858754 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.858714    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85b5025b-29a8-4ac6-aa36-994dc6aea436-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "85b5025b-29a8-4ac6-aa36-994dc6aea436" (UID: "85b5025b-29a8-4ac6-aa36-994dc6aea436"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:22:06.948824 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948779    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-certificates\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.948824 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948812    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85b5025b-29a8-4ac6-aa36-994dc6aea436-ca-trust-extracted\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.948824 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948822    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwm7d\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-kube-api-access-mwm7d\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.948824 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948830    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-registry-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.949131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948841    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-image-registry-private-configuration\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.949131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948850    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85b5025b-29a8-4ac6-aa36-994dc6aea436-trusted-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.949131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948858    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85b5025b-29a8-4ac6-aa36-994dc6aea436-bound-sa-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.949131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.948865    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85b5025b-29a8-4ac6-aa36-994dc6aea436-installation-pull-secrets\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:06.970274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:06.970241    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665ff95794-wdswr"]
Sep 11 13:22:07.002749 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.002705    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6" event={"ID":"5b6901dc-911f-4a02-977d-c93e223fba18","Type":"ContainerStarted","Data":"d46364f55dcd955c89e52a2f33fe88fcdf6f1453729102484f1d5f9aeb3717ad"}
Sep 11 13:22:07.004617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.004582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf" event={"ID":"d73f034f-bd45-4b8b-8814-8d88c2a9b943","Type":"ContainerStarted","Data":"5cae1270dfb560ced2c903b51f175c5f32a3c6e7e63a33b563b48fda3bc572ca"}
Sep 11 13:22:07.004801 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.004770    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:07.007549 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.007470    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh" event={"ID":"44d0f8b4-5c38-46dd-9663-d78b106b9754","Type":"ContainerStarted","Data":"9643e13ef54ac8cd298b26a242e65ad8d536c4571de4f63b09662dc0883195b3"}
Sep 11 13:22:07.007549 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.007545    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh" event={"ID":"44d0f8b4-5c38-46dd-9663-d78b106b9754","Type":"ContainerStarted","Data":"068e896e60928097f13a2f5682cc21996e135a10331d994958750a7786019bb5"}
Sep 11 13:22:07.007723 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.007575    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh" event={"ID":"44d0f8b4-5c38-46dd-9663-d78b106b9754","Type":"ContainerStarted","Data":"de0aa41c0298a424b45d8912ac4a15faabcb231a2ab5c4e4326cddc3007e1614"}
Sep 11 13:22:07.009786 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.009757    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzf9j" event={"ID":"90de78bd-4709-4ea2-879f-1178fcecf024","Type":"ContainerStarted","Data":"d3e38bfe83e5c1609f8b38ad406563bfccd38bc90b85c3b4bcd721566ae2b9a0"}
Sep 11 13:22:07.009931 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.009813    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzf9j" event={"ID":"90de78bd-4709-4ea2-879f-1178fcecf024","Type":"ContainerStarted","Data":"125ca0455ee0f85e8d140ef719cc5a4083615dba95e213b11e1d1ec5073f1dab"}
Sep 11 13:22:07.011024 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.011001    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf"
Sep 11 13:22:07.011612 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.011587    2547 generic.go:356] "Generic (PLEG): container finished" podID="85b5025b-29a8-4ac6-aa36-994dc6aea436" containerID="923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f" exitCode=0
Sep 11 13:22:07.011703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.011623    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867778758f-9xvdz" event={"ID":"85b5025b-29a8-4ac6-aa36-994dc6aea436","Type":"ContainerDied","Data":"923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f"}
Sep 11 13:22:07.011703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.011640    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867778758f-9xvdz"
Sep 11 13:22:07.011703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.011660    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867778758f-9xvdz" event={"ID":"85b5025b-29a8-4ac6-aa36-994dc6aea436","Type":"ContainerDied","Data":"4d6827a0123a9be56fc886c3013b490e8734154ddc5ab10a8e19554ec115fad9"}
Sep 11 13:22:07.011703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.011686    2547 scope.go:117] "RemoveContainer" containerID="923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f"
Sep 11 13:22:07.018780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.018092    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65676f58bb-gc9wb"]
Sep 11 13:22:07.018780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.018508    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b5025b-29a8-4ac6-aa36-994dc6aea436" containerName="registry"
Sep 11 13:22:07.018780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.018527    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b5025b-29a8-4ac6-aa36-994dc6aea436" containerName="registry"
Sep 11 13:22:07.018780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.018619    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b5025b-29a8-4ac6-aa36-994dc6aea436" containerName="registry"
Sep 11 13:22:07.032928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.032881    2547 scope.go:117] "RemoveContainer" containerID="923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f"
Sep 11 13:22:07.033760 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:22:07.033724    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f\": container with ID starting with 923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f not found: ID does not exist" containerID="923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f"
Sep 11 13:22:07.033864 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.033768    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f"} err="failed to get container status \"923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f\": rpc error: code = NotFound desc = could not find container \"923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f\": container with ID starting with 923452d1f78c00066db0dacec667e29872b5003a26cf47c0badfa28fa89d7f9f not found: ID does not exist"
Sep 11 13:22:07.043670 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.043601    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-jjfhh" podStartSLOduration=6.873275541 podStartE2EDuration="11.043580306s" totalImagesPullingTime="4.170304765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:07.041963911 +0000 UTC m=+143.254507713" watchObservedRunningTime="2026-09-11 13:22:07.043580306 +0000 UTC m=+143.256124110"
Sep 11 13:22:07.044052 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.044029    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65676f58bb-gc9wb"]
Sep 11 13:22:07.044159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.044146    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.097578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.097497    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8lqlf" podStartSLOduration=2.071756998 podStartE2EDuration="6.097471423s" totalImagesPullingTime="4.025714425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:07.071156317 +0000 UTC m=+143.283700119" watchObservedRunningTime="2026-09-11 13:22:07.097471423 +0000 UTC m=+143.310015224"
Sep 11 13:22:07.098107 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.098073    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-wb5c6" podStartSLOduration=7.089909377 podStartE2EDuration="11.098059508s" totalImagesPullingTime="4.008150131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:07.096316839 +0000 UTC m=+143.308860654" watchObservedRunningTime="2026-09-11 13:22:07.098059508 +0000 UTC m=+143.310603325"
Sep 11 13:22:07.119537 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.119469    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zzf9j" podStartSLOduration=138.939890897 podStartE2EDuration="2m23.119451877s" totalImagesPullingTime="4.17956098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:07.118100986 +0000 UTC m=+143.330644798" watchObservedRunningTime="2026-09-11 13:22:07.119451877 +0000 UTC m=+143.331995677"
Sep 11 13:22:07.144310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.144272    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-867778758f-9xvdz"]
Sep 11 13:22:07.147963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.147933    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-867778758f-9xvdz"]
Sep 11 13:22:07.151650 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151627    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-service-ca\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.151796 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151655    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-oauth-serving-cert\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.151796 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151692    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm7ds\" (UniqueName: \"kubernetes.io/projected/cbba1da6-9ea0-4573-91b9-618f83fe0e11-kube-api-access-wm7ds\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.151955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151828    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-serving-cert\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.151955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151872    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-config\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.152064 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151965    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-oauth-config\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.152064 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.151996    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-trusted-ca-bundle\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253291    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm7ds\" (UniqueName: \"kubernetes.io/projected/cbba1da6-9ea0-4573-91b9-618f83fe0e11-kube-api-access-wm7ds\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253395    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-serving-cert\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-config\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253479    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-oauth-config\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253504    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-trusted-ca-bundle\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253743 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253547    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-service-ca\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.253743 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.253571    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-oauth-serving-cert\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.254442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.254411    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-oauth-serving-cert\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.254580 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.254550    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-config\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.255141 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.255111    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-service-ca\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.255336 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.255318    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-trusted-ca-bundle\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.256504 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.256480    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-serving-cert\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.256659 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.256630    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-oauth-config\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.274113 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.274042    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm7ds\" (UniqueName: \"kubernetes.io/projected/cbba1da6-9ea0-4573-91b9-618f83fe0e11-kube-api-access-wm7ds\") pod \"console-65676f58bb-gc9wb\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") " pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.357258 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.357217    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:07.722078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:07.722047    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65676f58bb-gc9wb"]
Sep 11 13:22:07.724261 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:07.724222    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbba1da6_9ea0_4573_91b9_618f83fe0e11.slice/crio-ed008f4aab25adbe3d0a5d351216464d24834666ae7de6b32b694ffff69a6024 WatchSource:0}: Error finding container ed008f4aab25adbe3d0a5d351216464d24834666ae7de6b32b694ffff69a6024: Status 404 returned error can't find the container with id ed008f4aab25adbe3d0a5d351216464d24834666ae7de6b32b694ffff69a6024
Sep 11 13:22:08.020194 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:08.020060    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65676f58bb-gc9wb" event={"ID":"cbba1da6-9ea0-4573-91b9-618f83fe0e11","Type":"ContainerStarted","Data":"a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0"}
Sep 11 13:22:08.020194 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:08.020122    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65676f58bb-gc9wb" event={"ID":"cbba1da6-9ea0-4573-91b9-618f83fe0e11","Type":"ContainerStarted","Data":"ed008f4aab25adbe3d0a5d351216464d24834666ae7de6b32b694ffff69a6024"}
Sep 11 13:22:08.061739 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:08.061665    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65676f58bb-gc9wb" podStartSLOduration=2.061639365 podStartE2EDuration="2.061639365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:08.06120737 +0000 UTC m=+144.273751173" watchObservedRunningTime="2026-09-11 13:22:08.061639365 +0000 UTC m=+144.274183165"
Sep 11 13:22:08.249689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:08.249650    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b5025b-29a8-4ac6-aa36-994dc6aea436" path="/var/lib/kubelet/pods/85b5025b-29a8-4ac6-aa36-994dc6aea436/volumes"
Sep 11 13:22:10.236177 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:10.236133    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:10.236748 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:10.236253    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:10.248310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:10.248253    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:11.038074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:11.038041    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:11.884980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:11.884933    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:22:17.358289 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:17.358248    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:17.358950 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:17.358317    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:17.363016 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:17.362994    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:18.066166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:18.066138    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:22:18.117601 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:18.117566    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f785f5df4-w6x2d"]
Sep 11 13:22:20.680495 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:22:20.680440    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pffhb" podUID="c9f10b3c-8ff1-4961-bcce-3a61421a0c62"
Sep 11 13:22:21.075215 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:21.075117    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pffhb"
Sep 11 13:22:25.620393 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:25.620354    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:22:25.622714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:25.622689    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9f10b3c-8ff1-4961-bcce-3a61421a0c62-metrics-tls\") pod \"dns-default-pffhb\" (UID: \"c9f10b3c-8ff1-4961-bcce-3a61421a0c62\") " pod="openshift-dns/dns-default-pffhb"
Sep 11 13:22:25.878599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:25.878570    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-flkcx\""
Sep 11 13:22:25.886779 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:25.886754    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pffhb"
Sep 11 13:22:26.163217 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:26.163133    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pffhb"]
Sep 11 13:22:26.166139 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:22:26.166108    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f10b3c_8ff1_4961_bcce_3a61421a0c62.slice/crio-021175821f95478526e8df46bb9c1bdfa12db34466bc7d0f66357cb9dfb5c0f6 WatchSource:0}: Error finding container 021175821f95478526e8df46bb9c1bdfa12db34466bc7d0f66357cb9dfb5c0f6: Status 404 returned error can't find the container with id 021175821f95478526e8df46bb9c1bdfa12db34466bc7d0f66357cb9dfb5c0f6
Sep 11 13:22:27.099458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:27.099422    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pffhb" event={"ID":"c9f10b3c-8ff1-4961-bcce-3a61421a0c62","Type":"ContainerStarted","Data":"021175821f95478526e8df46bb9c1bdfa12db34466bc7d0f66357cb9dfb5c0f6"}
Sep 11 13:22:28.105638 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:28.105605    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pffhb" event={"ID":"c9f10b3c-8ff1-4961-bcce-3a61421a0c62","Type":"ContainerStarted","Data":"dc471863dae172e9ba629c549b6831830cb95a16b1391981f473d1d2387d8200"}
Sep 11 13:22:28.106019 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:28.105688    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pffhb" event={"ID":"c9f10b3c-8ff1-4961-bcce-3a61421a0c62","Type":"ContainerStarted","Data":"32063572b2a93138342089f145159dfaafc64a4b7c1fa19ca9056159f7bbebe0"}
Sep 11 13:22:28.106019 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:28.105774    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pffhb"
Sep 11 13:22:28.129491 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:28.129430    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pffhb" podStartSLOduration=129.38250579 podStartE2EDuration="2m11.129412946s" totalImagesPullingTime="1.746907156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:28.126767638 +0000 UTC m=+164.339311441" watchObservedRunningTime="2026-09-11 13:22:28.129412946 +0000 UTC m=+164.341956746"
Sep 11 13:22:31.993423 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:31.993376    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-665ff95794-wdswr" podUID="cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" containerName="console" containerID="cri-o://426e87859226bd4480e4d7bfee2888e999e5db07c4d9e6b333b12ed88295addf" gracePeriod=15
Sep 11 13:22:32.125369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.125335    2547 generic.go:356] "Generic (PLEG): container finished" podID="cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" containerID="426e87859226bd4480e4d7bfee2888e999e5db07c4d9e6b333b12ed88295addf" exitCode=0
Sep 11 13:22:32.125533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.125384    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ff95794-wdswr" event={"ID":"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b","Type":"ContainerDied","Data":"426e87859226bd4480e4d7bfee2888e999e5db07c4d9e6b333b12ed88295addf"}
Sep 11 13:22:32.236656 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.236624    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pffhb_c9f10b3c-8ff1-4961-bcce-3a61421a0c62/dns/0.log"
Sep 11 13:22:32.250088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.250060    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pffhb_c9f10b3c-8ff1-4961-bcce-3a61421a0c62/kube-rbac-proxy/0.log"
Sep 11 13:22:32.278860 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.278825    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:22:32.380086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380044    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-oauth-serving-cert\") pod \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") "
Sep 11 13:22:32.380302 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380090    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-service-ca\") pod \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") "
Sep 11 13:22:32.380302 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380124    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-oauth-config\") pod \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") "
Sep 11 13:22:32.380302 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380157    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-config\") pod \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") "
Sep 11 13:22:32.380302 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380188    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-serving-cert\") pod \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") "
Sep 11 13:22:32.380302 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380260    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2x7f\" (UniqueName: \"kubernetes.io/projected/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-kube-api-access-z2x7f\") pod \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\" (UID: \"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b\") "
Sep 11 13:22:32.380618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380546    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" (UID: "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:32.380618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380558    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-service-ca" (OuterVolumeSpecName: "service-ca") pod "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" (UID: "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:32.380802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.380775    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-config" (OuterVolumeSpecName: "console-config") pod "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" (UID: "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:32.382693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.382650    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" (UID: "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:22:32.382693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.382649    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-kube-api-access-z2x7f" (OuterVolumeSpecName: "kube-api-access-z2x7f") pod "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" (UID: "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b"). InnerVolumeSpecName "kube-api-access-z2x7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:32.382853 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.382689    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" (UID: "cefb1805-f5cf-4b0a-b547-22dc6d8ca74b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:22:32.395461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.395434    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2vxd_d54940d9-3814-41a3-b61c-9bc85f85106e/dns-node-resolver/0.log"
Sep 11 13:22:32.481307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.481267    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:32.481307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.481302    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-oauth-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:32.481307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.481312    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:32.481525 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.481321    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-console-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:32.481525 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.481330    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2x7f\" (UniqueName: \"kubernetes.io/projected/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-kube-api-access-z2x7f\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:32.481525 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:32.481340    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b-oauth-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:33.130447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:33.130402    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665ff95794-wdswr" event={"ID":"cefb1805-f5cf-4b0a-b547-22dc6d8ca74b","Type":"ContainerDied","Data":"12e17a9133b84a54c5b99838a9aa95f9c142c05f57adc9f961741655d334fa99"}
Sep 11 13:22:33.130447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:33.130448    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665ff95794-wdswr"
Sep 11 13:22:33.137210 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:33.130508    2547 scope.go:117] "RemoveContainer" containerID="426e87859226bd4480e4d7bfee2888e999e5db07c4d9e6b333b12ed88295addf"
Sep 11 13:22:33.174058 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:33.174018    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665ff95794-wdswr"]
Sep 11 13:22:33.182271 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:33.182234    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665ff95794-wdswr"]
Sep 11 13:22:34.247862 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:34.247829    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" path="/var/lib/kubelet/pods/cefb1805-f5cf-4b0a-b547-22dc6d8ca74b/volumes"
Sep 11 13:22:38.113742 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:38.113656    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pffhb"
Sep 11 13:22:42.167975 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:42.167940    2547 generic.go:356] "Generic (PLEG): container finished" podID="873492b7-136a-499c-aa69-244a4fafcec9" containerID="bb6b853f5d19a2c592c6f763f35c2ddf50d8e1ccbe341bf760984d2358c0a501" exitCode=0
Sep 11 13:22:42.168367 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:42.168020    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc" event={"ID":"873492b7-136a-499c-aa69-244a4fafcec9","Type":"ContainerDied","Data":"bb6b853f5d19a2c592c6f763f35c2ddf50d8e1ccbe341bf760984d2358c0a501"}
Sep 11 13:22:42.168461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:42.168443    2547 scope.go:117] "RemoveContainer" containerID="bb6b853f5d19a2c592c6f763f35c2ddf50d8e1ccbe341bf760984d2358c0a501"
Sep 11 13:22:43.138141 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.138092    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f785f5df4-w6x2d" podUID="2aaf459c-880b-4ba4-b4b3-5d61e6794354" containerName="console" containerID="cri-o://75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7" gracePeriod=15
Sep 11 13:22:43.174413 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.174382    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5nggc" event={"ID":"873492b7-136a-499c-aa69-244a4fafcec9","Type":"ContainerStarted","Data":"32b9ebf13a0b0fa38368f4467f9f786344e95220a47e4a8947426eed9f6c9d2f"}
Sep 11 13:22:43.425474 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.425427    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:43.574696 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574650    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-trusted-ca-bundle\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.574879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574720    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-oauth-serving-cert\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.574879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574752    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-service-ca\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.574879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574780    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-serving-cert\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.574879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574809    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-config\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.574879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574839    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-oauth-config\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.575161 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.574894    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wghn7\" (UniqueName: \"kubernetes.io/projected/2aaf459c-880b-4ba4-b4b3-5d61e6794354-kube-api-access-wghn7\") pod \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\" (UID: \"2aaf459c-880b-4ba4-b4b3-5d61e6794354\") "
Sep 11 13:22:43.575272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.575234    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:43.575406 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.575373    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-service-ca" (OuterVolumeSpecName: "service-ca") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:43.575478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.575384    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-config" (OuterVolumeSpecName: "console-config") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:43.575604 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.575580    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:43.577477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.577447    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aaf459c-880b-4ba4-b4b3-5d61e6794354-kube-api-access-wghn7" (OuterVolumeSpecName: "kube-api-access-wghn7") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "kube-api-access-wghn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:43.577590 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.577468    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:22:43.577590 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.577526    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2aaf459c-880b-4ba4-b4b3-5d61e6794354" (UID: "2aaf459c-880b-4ba4-b4b3-5d61e6794354"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:22:43.675767 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675682    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wghn7\" (UniqueName: \"kubernetes.io/projected/2aaf459c-880b-4ba4-b4b3-5d61e6794354-kube-api-access-wghn7\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:43.675767 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675721    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-trusted-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:43.675767 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675732    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-oauth-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:43.675767 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675744    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:43.675767 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675760    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:43.676050 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675771    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:43.676050 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:43.675784    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2aaf459c-880b-4ba4-b4b3-5d61e6794354-console-oauth-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:22:44.180169 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.180132    2547 generic.go:356] "Generic (PLEG): container finished" podID="2aaf459c-880b-4ba4-b4b3-5d61e6794354" containerID="75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7" exitCode=0
Sep 11 13:22:44.180554 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.180205    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f785f5df4-w6x2d"
Sep 11 13:22:44.180554 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.180209    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f785f5df4-w6x2d" event={"ID":"2aaf459c-880b-4ba4-b4b3-5d61e6794354","Type":"ContainerDied","Data":"75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7"}
Sep 11 13:22:44.180554 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.180296    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f785f5df4-w6x2d" event={"ID":"2aaf459c-880b-4ba4-b4b3-5d61e6794354","Type":"ContainerDied","Data":"962afdcaafae62b5b834a7d52b0243f3f710f91984229ee8047a2aa4d81df4b7"}
Sep 11 13:22:44.180554 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.180322    2547 scope.go:117] "RemoveContainer" containerID="75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7"
Sep 11 13:22:44.189725 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.189705    2547 scope.go:117] "RemoveContainer" containerID="75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7"
Sep 11 13:22:44.190131 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:22:44.190113    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7\": container with ID starting with 75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7 not found: ID does not exist" containerID="75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7"
Sep 11 13:22:44.190208 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.190141    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7"} err="failed to get container status \"75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7\": rpc error: code = NotFound desc = could not find container \"75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7\": container with ID starting with 75dfa67a9decc5c43cc4dd11d0b02ff213d6ec5ab74155c8999f4419d786e6d7 not found: ID does not exist"
Sep 11 13:22:44.205581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.205543    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f785f5df4-w6x2d"]
Sep 11 13:22:44.210854 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.210824    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f785f5df4-w6x2d"]
Sep 11 13:22:44.251264 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:22:44.251230    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aaf459c-880b-4ba4-b4b3-5d61e6794354" path="/var/lib/kubelet/pods/2aaf459c-880b-4ba4-b4b3-5d61e6794354/volumes"
Sep 11 13:23:21.988522 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988490    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"]
Sep 11 13:23:21.989037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988771    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aaf459c-880b-4ba4-b4b3-5d61e6794354" containerName="console"
Sep 11 13:23:21.989037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988781    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aaf459c-880b-4ba4-b4b3-5d61e6794354" containerName="console"
Sep 11 13:23:21.989037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988796    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" containerName="console"
Sep 11 13:23:21.989037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988802    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" containerName="console"
Sep 11 13:23:21.989037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988857    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cefb1805-f5cf-4b0a-b547-22dc6d8ca74b" containerName="console"
Sep 11 13:23:21.989037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.988866    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aaf459c-880b-4ba4-b4b3-5d61e6794354" containerName="console"
Sep 11 13:23:21.990993 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.990975    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:21.995946 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.995887    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 13:23:21.996096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.995987    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 13:23:21.996096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.996023    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 13:23:21.996800 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.996778    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 13:23:21.996867 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.996807    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kz9zt\""
Sep 11 13:23:21.999867 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:21.999846    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 13:23:22.004004 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.003981    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 13:23:22.036892 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.036860    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"]
Sep 11 13:23:22.055797 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.055756    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.055816    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-telemeter-client-tls\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.055943    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-secret-telemeter-client\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.056003    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcj2\" (UniqueName: \"kubernetes.io/projected/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-kube-api-access-4dcj2\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056178 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.056061    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-metrics-client-ca\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056178 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.056085    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-federate-client-tls\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056178 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.056103    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-serving-certs-ca-bundle\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.056178 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.056122    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157008    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-secret-telemeter-client\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157056    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcj2\" (UniqueName: \"kubernetes.io/projected/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-kube-api-access-4dcj2\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157086    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-metrics-client-ca\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-federate-client-tls\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157125    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-serving-certs-ca-bundle\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157148    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157399 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157229    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.157399 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.157297    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-telemeter-client-tls\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.158061 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.158032    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-metrics-client-ca\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.158235 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.158081    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.158397 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.158370    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-serving-certs-ca-bundle\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.160036 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.160002    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.160146 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.160088    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-federate-client-tls\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.160146 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.160136    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-secret-telemeter-client\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.160373 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.160353    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-telemeter-client-tls\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.171999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.171966    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcj2\" (UniqueName: \"kubernetes.io/projected/6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce-kube-api-access-4dcj2\") pod \"telemeter-client-fb9b6b4d8-z2cjt\" (UID: \"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce\") " pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.300441 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.300345    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"
Sep 11 13:23:22.589221 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:22.589195    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt"]
Sep 11 13:23:22.591117 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:23:22.591092    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd9ee2a_c672_4b4e_8ddd_9ab4d221cbce.slice/crio-33c53e5777da8268e911408b682d87c06ef206a3a7d206b3817fa546cb62ce7a WatchSource:0}: Error finding container 33c53e5777da8268e911408b682d87c06ef206a3a7d206b3817fa546cb62ce7a: Status 404 returned error can't find the container with id 33c53e5777da8268e911408b682d87c06ef206a3a7d206b3817fa546cb62ce7a
Sep 11 13:23:23.334851 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:23.334815    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt" event={"ID":"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce","Type":"ContainerStarted","Data":"33c53e5777da8268e911408b682d87c06ef206a3a7d206b3817fa546cb62ce7a"}
Sep 11 13:23:25.344986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:25.344943    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt" event={"ID":"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce","Type":"ContainerStarted","Data":"41f5b72c6c6000387f1b4f8eec2af790d0266861769036e3c2c2ad098420ff5d"}
Sep 11 13:23:26.351150 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.351110    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt" event={"ID":"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce","Type":"ContainerStarted","Data":"d9450994361723a1daf94ddbfee5ef7e2771a19ad801c6208095e460e43dbc46"}
Sep 11 13:23:26.351528 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.351183    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt" event={"ID":"6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce","Type":"ContainerStarted","Data":"2cfdb7d3ac5039aeb65237d2a8e556363c542e8cee7a34575c3a233d375e855e"}
Sep 11 13:23:26.380541 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.380484    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fb9b6b4d8-z2cjt" podStartSLOduration=2.327850719 podStartE2EDuration="5.380464374s" totalImagesPullingTime="3.052613655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:23:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:23:26.37790622 +0000 UTC m=+222.590450020" watchObservedRunningTime="2026-09-11 13:23:26.380464374 +0000 UTC m=+222.593008173"
Sep 11 13:23:26.489805 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.489766    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798875bc98-2hfxw"]
Sep 11 13:23:26.492267 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.492237    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.514794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.514748    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798875bc98-2hfxw"]
Sep 11 13:23:26.596860 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.596817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zz2k\" (UniqueName: \"kubernetes.io/projected/b8efc536-17c8-4736-97fa-c62d4982abe1-kube-api-access-7zz2k\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.596860 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.596857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-trusted-ca-bundle\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.597120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.596878    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-serving-cert\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.597120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.596991    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-console-config\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.597120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.597034    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-oauth-config\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.597120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.597066    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-oauth-serving-cert\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.597120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.597082    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-service-ca\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.697985 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.697946    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-oauth-config\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698205 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.697997    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-oauth-serving-cert\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698205 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698019    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-service-ca\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698205 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698072    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zz2k\" (UniqueName: \"kubernetes.io/projected/b8efc536-17c8-4736-97fa-c62d4982abe1-kube-api-access-7zz2k\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698205 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-trusted-ca-bundle\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698223    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-serving-cert\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698289    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-console-config\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698834 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698806    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-oauth-serving-cert\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698883    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-service-ca\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698943    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-trusted-ca-bundle\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.698980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.698974    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-console-config\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.700609 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.700584    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-oauth-config\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.700844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.700820    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-serving-cert\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.708116 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.708093    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zz2k\" (UniqueName: \"kubernetes.io/projected/b8efc536-17c8-4736-97fa-c62d4982abe1-kube-api-access-7zz2k\") pod \"console-798875bc98-2hfxw\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") " pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:26.802858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:26.802815    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:27.080891 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:23:27.080706    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8efc536_17c8_4736_97fa_c62d4982abe1.slice/crio-b653f8c08b56d3d3a80cbf74c7c8d9602a8a8c2dfb594bc8d9a827b6cfa93745 WatchSource:0}: Error finding container b653f8c08b56d3d3a80cbf74c7c8d9602a8a8c2dfb594bc8d9a827b6cfa93745: Status 404 returned error can't find the container with id b653f8c08b56d3d3a80cbf74c7c8d9602a8a8c2dfb594bc8d9a827b6cfa93745
Sep 11 13:23:27.083148 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:27.083121    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798875bc98-2hfxw"]
Sep 11 13:23:27.357306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:27.357201    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798875bc98-2hfxw" event={"ID":"b8efc536-17c8-4736-97fa-c62d4982abe1","Type":"ContainerStarted","Data":"a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d"}
Sep 11 13:23:27.357306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:27.357264    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798875bc98-2hfxw" event={"ID":"b8efc536-17c8-4736-97fa-c62d4982abe1","Type":"ContainerStarted","Data":"b653f8c08b56d3d3a80cbf74c7c8d9602a8a8c2dfb594bc8d9a827b6cfa93745"}
Sep 11 13:23:27.378590 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:27.378532    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798875bc98-2hfxw" podStartSLOduration=1.3785134540000001 podStartE2EDuration="1.378513454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:23:27.377120145 +0000 UTC m=+223.589663945" watchObservedRunningTime="2026-09-11 13:23:27.378513454 +0000 UTC m=+223.591057327"
Sep 11 13:23:36.803558 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:36.803506    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:36.804098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:36.803574    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:36.808601 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:36.808565    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:37.403993 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:37.403962    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:23:37.453423 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:23:37.453385    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65676f58bb-gc9wb"]
Sep 11 13:24:02.474619 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.474557    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65676f58bb-gc9wb" podUID="cbba1da6-9ea0-4573-91b9-618f83fe0e11" containerName="console" containerID="cri-o://a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0" gracePeriod=15
Sep 11 13:24:02.709936 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.709887    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:24:02.816454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816362    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-oauth-serving-cert\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816406    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-oauth-config\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816433    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-serving-cert\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816458    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-trusted-ca-bundle\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816783 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816485    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm7ds\" (UniqueName: \"kubernetes.io/projected/cbba1da6-9ea0-4573-91b9-618f83fe0e11-kube-api-access-wm7ds\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816783 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816542    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-service-ca\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816783 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816573    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-config\") pod \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\" (UID: \"cbba1da6-9ea0-4573-91b9-618f83fe0e11\") "
Sep 11 13:24:02.816963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.816903    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:02.817174 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.817100    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-config" (OuterVolumeSpecName: "console-config") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:02.817310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.817176    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-service-ca" (OuterVolumeSpecName: "service-ca") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:02.817380 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.817304    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:02.818809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.818786    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:24:02.818943 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.818806    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:24:02.819222 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.819198    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbba1da6-9ea0-4573-91b9-618f83fe0e11-kube-api-access-wm7ds" (OuterVolumeSpecName: "kube-api-access-wm7ds") pod "cbba1da6-9ea0-4573-91b9-618f83fe0e11" (UID: "cbba1da6-9ea0-4573-91b9-618f83fe0e11"). InnerVolumeSpecName "kube-api-access-wm7ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:02.917752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917714    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:02.917752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917745    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-trusted-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:02.917752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917754    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm7ds\" (UniqueName: \"kubernetes.io/projected/cbba1da6-9ea0-4573-91b9-618f83fe0e11-kube-api-access-wm7ds\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:02.917752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917763    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:02.918054 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917772    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:02.918054 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917780    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba1da6-9ea0-4573-91b9-618f83fe0e11-oauth-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:02.918054 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:02.917789    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba1da6-9ea0-4573-91b9-618f83fe0e11-console-oauth-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:24:03.499897 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.499851    2547 generic.go:356] "Generic (PLEG): container finished" podID="cbba1da6-9ea0-4573-91b9-618f83fe0e11" containerID="a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0" exitCode=0
Sep 11 13:24:03.500336 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.499905    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65676f58bb-gc9wb"
Sep 11 13:24:03.500336 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.499941    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65676f58bb-gc9wb" event={"ID":"cbba1da6-9ea0-4573-91b9-618f83fe0e11","Type":"ContainerDied","Data":"a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0"}
Sep 11 13:24:03.500336 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.500072    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65676f58bb-gc9wb" event={"ID":"cbba1da6-9ea0-4573-91b9-618f83fe0e11","Type":"ContainerDied","Data":"ed008f4aab25adbe3d0a5d351216464d24834666ae7de6b32b694ffff69a6024"}
Sep 11 13:24:03.500336 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.500100    2547 scope.go:117] "RemoveContainer" containerID="a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0"
Sep 11 13:24:03.509003 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.508983    2547 scope.go:117] "RemoveContainer" containerID="a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0"
Sep 11 13:24:03.509365 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:24:03.509340    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0\": container with ID starting with a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0 not found: ID does not exist" containerID="a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0"
Sep 11 13:24:03.509416 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.509377    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0"} err="failed to get container status \"a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0\": rpc error: code = NotFound desc = could not find container \"a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0\": container with ID starting with a438371759477dfd967a1be933539d87d2fc7d95fafb5aa2b2e79e3de6ac3de0 not found: ID does not exist"
Sep 11 13:24:03.522417 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.522372    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65676f58bb-gc9wb"]
Sep 11 13:24:03.528545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:03.528514    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65676f58bb-gc9wb"]
Sep 11 13:24:04.247933 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:04.247884    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbba1da6-9ea0-4573-91b9-618f83fe0e11" path="/var/lib/kubelet/pods/cbba1da6-9ea0-4573-91b9-618f83fe0e11/volumes"
Sep 11 13:24:33.529668 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.529634    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b44cb474f-45frk"]
Sep 11 13:24:33.530217 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.529971    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbba1da6-9ea0-4573-91b9-618f83fe0e11" containerName="console"
Sep 11 13:24:33.530217 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.529985    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbba1da6-9ea0-4573-91b9-618f83fe0e11" containerName="console"
Sep 11 13:24:33.530217 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.530050    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbba1da6-9ea0-4573-91b9-618f83fe0e11" containerName="console"
Sep 11 13:24:33.532063 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.532035    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.553545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.553511    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b44cb474f-45frk"]
Sep 11 13:24:33.657392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657355    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-trusted-ca-bundle\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.657392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657401    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-config\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.657600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657435    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-serving-cert\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.657600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657489    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-oauth-serving-cert\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.657600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fp2\" (UniqueName: \"kubernetes.io/projected/f41b2e72-0e30-4e87-9b4f-776b73e540ce-kube-api-access-b9fp2\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.657600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657585    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-oauth-config\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.657733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.657611    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-service-ca\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758233 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758191    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-trusted-ca-bundle\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758233 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758236    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-config\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758266    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-serving-cert\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758282    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-oauth-serving-cert\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758301    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fp2\" (UniqueName: \"kubernetes.io/projected/f41b2e72-0e30-4e87-9b4f-776b73e540ce-kube-api-access-b9fp2\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758329    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-oauth-config\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.758471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.758346    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-service-ca\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.759200 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.759139    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-config\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.759310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.759193    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-oauth-serving-cert\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.759310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.759213    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-service-ca\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.759381 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.759352    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-trusted-ca-bundle\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.760880 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.760855    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-serving-cert\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.760981 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.760864    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-oauth-config\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.768146 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.768121    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fp2\" (UniqueName: \"kubernetes.io/projected/f41b2e72-0e30-4e87-9b4f-776b73e540ce-kube-api-access-b9fp2\") pod \"console-6b44cb474f-45frk\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") " pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:33.842304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:33.842210    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:34.139756 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:34.139719    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b44cb474f-45frk"]
Sep 11 13:24:34.148560 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:24:34.148533    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41b2e72_0e30_4e87_9b4f_776b73e540ce.slice/crio-e47ec23d774fe9359bb1506bfee4f333ab38433f268c3577b400e228dc90b2ed WatchSource:0}: Error finding container e47ec23d774fe9359bb1506bfee4f333ab38433f268c3577b400e228dc90b2ed: Status 404 returned error can't find the container with id e47ec23d774fe9359bb1506bfee4f333ab38433f268c3577b400e228dc90b2ed
Sep 11 13:24:34.619895 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:34.619804    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b44cb474f-45frk" event={"ID":"f41b2e72-0e30-4e87-9b4f-776b73e540ce","Type":"ContainerStarted","Data":"6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d"}
Sep 11 13:24:34.619895 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:34.619859    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b44cb474f-45frk" event={"ID":"f41b2e72-0e30-4e87-9b4f-776b73e540ce","Type":"ContainerStarted","Data":"e47ec23d774fe9359bb1506bfee4f333ab38433f268c3577b400e228dc90b2ed"}
Sep 11 13:24:34.642567 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:34.642511    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b44cb474f-45frk" podStartSLOduration=1.6424937160000002 podStartE2EDuration="1.642493716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:24:34.641369136 +0000 UTC m=+290.853912964" watchObservedRunningTime="2026-09-11 13:24:34.642493716 +0000 UTC m=+290.855037515"
Sep 11 13:24:43.842431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:43.842386    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:43.842833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:43.842470    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:43.847584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:43.847554    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:44.128935 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:44.128891    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:24:44.131355 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:44.131319    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:24:44.140976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:44.140954    2547 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 13:24:44.661791 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:44.661760    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:24:44.714667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:24:44.714623    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798875bc98-2hfxw"]
Sep 11 13:25:09.736726 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:09.736676    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-798875bc98-2hfxw" podUID="b8efc536-17c8-4736-97fa-c62d4982abe1" containerName="console" containerID="cri-o://a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d" gracePeriod=15
Sep 11 13:25:09.976007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:09.975973    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:25:10.051312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051223    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-oauth-serving-cert\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051269    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zz2k\" (UniqueName: \"kubernetes.io/projected/b8efc536-17c8-4736-97fa-c62d4982abe1-kube-api-access-7zz2k\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051302    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-trusted-ca-bundle\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051319    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-console-config\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051348    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-serving-cert\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051374    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-oauth-config\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051420    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-service-ca\") pod \"b8efc536-17c8-4736-97fa-c62d4982abe1\" (UID: \"b8efc536-17c8-4736-97fa-c62d4982abe1\") "
Sep 11 13:25:10.051965 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051848    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:25:10.052070 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051937    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-console-config" (OuterVolumeSpecName: "console-config") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:25:10.052070 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.051980    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:25:10.052070 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.052038    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:25:10.053724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.053691    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:25:10.054062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.054040    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8efc536-17c8-4736-97fa-c62d4982abe1-kube-api-access-7zz2k" (OuterVolumeSpecName: "kube-api-access-7zz2k") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "kube-api-access-7zz2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:25:10.054138 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.054041    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8efc536-17c8-4736-97fa-c62d4982abe1" (UID: "b8efc536-17c8-4736-97fa-c62d4982abe1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:25:10.152437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152394    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-trusted-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.152437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152426    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-console-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.152437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152437    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.152437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152446    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8efc536-17c8-4736-97fa-c62d4982abe1-console-oauth-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.152692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152454    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.152692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152464    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8efc536-17c8-4736-97fa-c62d4982abe1-oauth-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.152692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.152472    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zz2k\" (UniqueName: \"kubernetes.io/projected/b8efc536-17c8-4736-97fa-c62d4982abe1-kube-api-access-7zz2k\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:25:10.764053 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.764017    2547 generic.go:356] "Generic (PLEG): container finished" podID="b8efc536-17c8-4736-97fa-c62d4982abe1" containerID="a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d" exitCode=0
Sep 11 13:25:10.764449 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.764082    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798875bc98-2hfxw"
Sep 11 13:25:10.764449 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.764104    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798875bc98-2hfxw" event={"ID":"b8efc536-17c8-4736-97fa-c62d4982abe1","Type":"ContainerDied","Data":"a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d"}
Sep 11 13:25:10.764449 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.764164    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798875bc98-2hfxw" event={"ID":"b8efc536-17c8-4736-97fa-c62d4982abe1","Type":"ContainerDied","Data":"b653f8c08b56d3d3a80cbf74c7c8d9602a8a8c2dfb594bc8d9a827b6cfa93745"}
Sep 11 13:25:10.764449 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.764192    2547 scope.go:117] "RemoveContainer" containerID="a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d"
Sep 11 13:25:10.772485 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.772461    2547 scope.go:117] "RemoveContainer" containerID="a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d"
Sep 11 13:25:10.772806 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:25:10.772783    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d\": container with ID starting with a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d not found: ID does not exist" containerID="a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d"
Sep 11 13:25:10.772883 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.772814    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d"} err="failed to get container status \"a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d\": rpc error: code = NotFound desc = could not find container \"a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d\": container with ID starting with a83872c85f7022a8b6f9263c282ca8a83fa563514399acdfb399c254a7fb152d not found: ID does not exist"
Sep 11 13:25:10.784443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.784402    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798875bc98-2hfxw"]
Sep 11 13:25:10.788442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:10.788413    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798875bc98-2hfxw"]
Sep 11 13:25:12.248276 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:12.248244    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8efc536-17c8-4736-97fa-c62d4982abe1" path="/var/lib/kubelet/pods/b8efc536-17c8-4736-97fa-c62d4982abe1/volumes"
Sep 11 13:25:59.248285 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.248244    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"]
Sep 11 13:25:59.248784 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.248677    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8efc536-17c8-4736-97fa-c62d4982abe1" containerName="console"
Sep 11 13:25:59.248784 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.248696    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8efc536-17c8-4736-97fa-c62d4982abe1" containerName="console"
Sep 11 13:25:59.248899 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.248794    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8efc536-17c8-4736-97fa-c62d4982abe1" containerName="console"
Sep 11 13:25:59.251366 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.251345    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.254384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.254361    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:25:59.254502 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.254418    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:25:59.255278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.255260    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6drkt\""
Sep 11 13:25:59.262639 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.262618    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"]
Sep 11 13:25:59.341136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.341100    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d6vz\" (UniqueName: \"kubernetes.io/projected/c02f581c-8774-463d-82ba-190386785b37-kube-api-access-2d6vz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.341136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.341140    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.341376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.341224    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.442078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.442039    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d6vz\" (UniqueName: \"kubernetes.io/projected/c02f581c-8774-463d-82ba-190386785b37-kube-api-access-2d6vz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.442078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.442080    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.442317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.442146    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.442490 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.442466    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.442567 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.442539    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.451711 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.451685    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d6vz\" (UniqueName: \"kubernetes.io/projected/c02f581c-8774-463d-82ba-190386785b37-kube-api-access-2d6vz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.561023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.560894    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:25:59.832153 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.832021    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"]
Sep 11 13:25:59.834845 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:25:59.834816    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02f581c_8774_463d_82ba_190386785b37.slice/crio-966d14a6212be8abdc6c3979cde7e55988de6aef83e7658e27f9c6353f6c5f6e WatchSource:0}: Error finding container 966d14a6212be8abdc6c3979cde7e55988de6aef83e7658e27f9c6353f6c5f6e: Status 404 returned error can't find the container with id 966d14a6212be8abdc6c3979cde7e55988de6aef83e7658e27f9c6353f6c5f6e
Sep 11 13:25:59.836765 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.836748    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:25:59.961058 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:25:59.961022    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6" event={"ID":"c02f581c-8774-463d-82ba-190386785b37","Type":"ContainerStarted","Data":"966d14a6212be8abdc6c3979cde7e55988de6aef83e7658e27f9c6353f6c5f6e"}
Sep 11 13:26:06.990566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:06.990527    2547 generic.go:356] "Generic (PLEG): container finished" podID="c02f581c-8774-463d-82ba-190386785b37" containerID="b8dfe845872a5f2e615b228a471a8361cc010e412d33b11750d118f9a0e2d92d" exitCode=0
Sep 11 13:26:06.990976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:06.990617    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6" event={"ID":"c02f581c-8774-463d-82ba-190386785b37","Type":"ContainerDied","Data":"b8dfe845872a5f2e615b228a471a8361cc010e412d33b11750d118f9a0e2d92d"}
Sep 11 13:26:10.006427 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:10.006395    2547 generic.go:356] "Generic (PLEG): container finished" podID="c02f581c-8774-463d-82ba-190386785b37" containerID="04122cf6293235e6f8f0bd25e455ebaeac8c2af78a484be1db3960d4c8493d81" exitCode=0
Sep 11 13:26:10.006889 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:10.006484    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6" event={"ID":"c02f581c-8774-463d-82ba-190386785b37","Type":"ContainerDied","Data":"04122cf6293235e6f8f0bd25e455ebaeac8c2af78a484be1db3960d4c8493d81"}
Sep 11 13:26:18.045576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:18.045538    2547 generic.go:356] "Generic (PLEG): container finished" podID="c02f581c-8774-463d-82ba-190386785b37" containerID="6c30e89cca720c50aac4c253502f3ebd592c99b78308373eb80010cf0ee1e769" exitCode=0
Sep 11 13:26:18.045999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:18.045586    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6" event={"ID":"c02f581c-8774-463d-82ba-190386785b37","Type":"ContainerDied","Data":"6c30e89cca720c50aac4c253502f3ebd592c99b78308373eb80010cf0ee1e769"}
Sep 11 13:26:19.176030 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.176003    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:26:19.216429 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.216395    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d6vz\" (UniqueName: \"kubernetes.io/projected/c02f581c-8774-463d-82ba-190386785b37-kube-api-access-2d6vz\") pod \"c02f581c-8774-463d-82ba-190386785b37\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") "
Sep 11 13:26:19.216617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.216448    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-util\") pod \"c02f581c-8774-463d-82ba-190386785b37\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") "
Sep 11 13:26:19.216617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.216509    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-bundle\") pod \"c02f581c-8774-463d-82ba-190386785b37\" (UID: \"c02f581c-8774-463d-82ba-190386785b37\") "
Sep 11 13:26:19.217242 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.217210    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-bundle" (OuterVolumeSpecName: "bundle") pod "c02f581c-8774-463d-82ba-190386785b37" (UID: "c02f581c-8774-463d-82ba-190386785b37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:19.218729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.218693    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c02f581c-8774-463d-82ba-190386785b37-kube-api-access-2d6vz" (OuterVolumeSpecName: "kube-api-access-2d6vz") pod "c02f581c-8774-463d-82ba-190386785b37" (UID: "c02f581c-8774-463d-82ba-190386785b37"). InnerVolumeSpecName "kube-api-access-2d6vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:26:19.221447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.221413    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-util" (OuterVolumeSpecName: "util") pod "c02f581c-8774-463d-82ba-190386785b37" (UID: "c02f581c-8774-463d-82ba-190386785b37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:19.317524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.317428    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d6vz\" (UniqueName: \"kubernetes.io/projected/c02f581c-8774-463d-82ba-190386785b37-kube-api-access-2d6vz\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:26:19.317524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.317466    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:26:19.317524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:19.317477    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c02f581c-8774-463d-82ba-190386785b37-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:26:20.056154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:20.056121    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6" event={"ID":"c02f581c-8774-463d-82ba-190386785b37","Type":"ContainerDied","Data":"966d14a6212be8abdc6c3979cde7e55988de6aef83e7658e27f9c6353f6c5f6e"}
Sep 11 13:26:20.056317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:20.056168    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bl9r6"
Sep 11 13:26:20.056317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:20.056172    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="966d14a6212be8abdc6c3979cde7e55988de6aef83e7658e27f9c6353f6c5f6e"
Sep 11 13:26:27.555604 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555566    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"]
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555871    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="util"
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555882    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="util"
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555893    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="pull"
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555898    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="pull"
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555906    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="extract"
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555926    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="extract"
Sep 11 13:26:27.556094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.555982    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c02f581c-8774-463d-82ba-190386785b37" containerName="extract"
Sep 11 13:26:27.560155 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.560133    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.563033 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.563008    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:26:27.563120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.563009    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 13:26:27.563120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.563068    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gmd2x\""
Sep 11 13:26:27.572003 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.571978    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"]
Sep 11 13:26:27.687458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.687416    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g6tmx\" (UID: \"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.687644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.687488    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgvk\" (UniqueName: \"kubernetes.io/projected/0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5-kube-api-access-4lgvk\") pod \"cert-manager-operator-controller-manager-55c444bf86-g6tmx\" (UID: \"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.788077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.788032    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgvk\" (UniqueName: \"kubernetes.io/projected/0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5-kube-api-access-4lgvk\") pod \"cert-manager-operator-controller-manager-55c444bf86-g6tmx\" (UID: \"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.788242 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.788095    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g6tmx\" (UID: \"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.788457 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.788439    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g6tmx\" (UID: \"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.797809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.797768    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgvk\" (UniqueName: \"kubernetes.io/projected/0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5-kube-api-access-4lgvk\") pod \"cert-manager-operator-controller-manager-55c444bf86-g6tmx\" (UID: \"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:27.869871 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:27.869771    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"
Sep 11 13:26:28.152104 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:28.152065    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx"]
Sep 11 13:26:28.155367 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:26:28.155335    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5b4bd1_c478_48cc_a8c1_6732d2fc4dd5.slice/crio-fa7cef848c7939602818032e850130d05eb0491d2a11f33b6fd1a1f2dbac040d WatchSource:0}: Error finding container fa7cef848c7939602818032e850130d05eb0491d2a11f33b6fd1a1f2dbac040d: Status 404 returned error can't find the container with id fa7cef848c7939602818032e850130d05eb0491d2a11f33b6fd1a1f2dbac040d
Sep 11 13:26:29.093690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:29.093644    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx" event={"ID":"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5","Type":"ContainerStarted","Data":"fa7cef848c7939602818032e850130d05eb0491d2a11f33b6fd1a1f2dbac040d"}
Sep 11 13:26:30.100968 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:30.100857    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx" event={"ID":"0c5b4bd1-c478-48cc-a8c1-6732d2fc4dd5","Type":"ContainerStarted","Data":"c2c640adfd4ac8b0677f4ffa6632e6251c0f1b9ac14b2947d79eb7cc082634d1"}
Sep 11 13:26:30.126663 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:30.126604    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g6tmx" podStartSLOduration=1.576850431 podStartE2EDuration="3.126586827s" totalImagesPullingTime="1.549736396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:26:30.125824495 +0000 UTC m=+406.338368294" watchObservedRunningTime="2026-09-11 13:26:30.126586827 +0000 UTC m=+406.339130626"
Sep 11 13:26:31.411084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.411052    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"]
Sep 11 13:26:31.414683 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.414659    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.418636 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.418613    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6drkt\""
Sep 11 13:26:31.418766 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.418670    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:26:31.419533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.419518    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:26:31.449063 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.449032    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"]
Sep 11 13:26:31.520643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.520603    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.520828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.520659    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxqv5\" (UniqueName: \"kubernetes.io/projected/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-kube-api-access-kxqv5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.520828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.520741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.622136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.622089    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.622335 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.622158    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.622335 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.622205    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxqv5\" (UniqueName: \"kubernetes.io/projected/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-kube-api-access-kxqv5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.622514 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.622491    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.622587 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.622519    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.634378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.634342    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxqv5\" (UniqueName: \"kubernetes.io/projected/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-kube-api-access-kxqv5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.725109 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.725021    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:31.799867 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.799771    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-z55cz"]
Sep 11 13:26:31.803770 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.803744    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:31.807963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.806741    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 13:26:31.807963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.806993    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 13:26:31.807963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.807165    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jr2cb\""
Sep 11 13:26:31.815644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.815606    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-z55cz"]
Sep 11 13:26:31.924927 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.924878    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2nkc\" (UniqueName: \"kubernetes.io/projected/3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4-kube-api-access-r2nkc\") pod \"cert-manager-webhook-6486ffd997-z55cz\" (UID: \"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:31.925168 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:31.925012    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-z55cz\" (UID: \"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:32.000426 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.000323    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"]
Sep 11 13:26:32.004330 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:26:32.004295    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd9fed5_6f3e_462d_8cc7_28d0a64a7511.slice/crio-b2e46715bee48d3467d369730d574060f188353748ba2e8bca31455e9cbd18eb WatchSource:0}: Error finding container b2e46715bee48d3467d369730d574060f188353748ba2e8bca31455e9cbd18eb: Status 404 returned error can't find the container with id b2e46715bee48d3467d369730d574060f188353748ba2e8bca31455e9cbd18eb
Sep 11 13:26:32.026476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.026447    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2nkc\" (UniqueName: \"kubernetes.io/projected/3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4-kube-api-access-r2nkc\") pod \"cert-manager-webhook-6486ffd997-z55cz\" (UID: \"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:32.026608 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.026510    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-z55cz\" (UID: \"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:32.035884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.035854    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-z55cz\" (UID: \"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:32.036084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.036065    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2nkc\" (UniqueName: \"kubernetes.io/projected/3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4-kube-api-access-r2nkc\") pod \"cert-manager-webhook-6486ffd997-z55cz\" (UID: \"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:32.112753 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.112719    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg" event={"ID":"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511","Type":"ContainerStarted","Data":"6b2033e2d9ee7cb266519256524ce24f701cc0693dfd4aab537fcf3432653e9e"}
Sep 11 13:26:32.112951 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.112776    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg" event={"ID":"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511","Type":"ContainerStarted","Data":"b2e46715bee48d3467d369730d574060f188353748ba2e8bca31455e9cbd18eb"}
Sep 11 13:26:32.130464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.130431    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:32.405272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:32.405239    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-z55cz"]
Sep 11 13:26:32.407875 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:26:32.407834    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d0aa21b_52f1_44d8_8aa8_cfd97abff3f4.slice/crio-818d17c4acd5a7c6cbe1bc46b38e8fceb3f45de1d6a008804f3b5495a5f5320a WatchSource:0}: Error finding container 818d17c4acd5a7c6cbe1bc46b38e8fceb3f45de1d6a008804f3b5495a5f5320a: Status 404 returned error can't find the container with id 818d17c4acd5a7c6cbe1bc46b38e8fceb3f45de1d6a008804f3b5495a5f5320a
Sep 11 13:26:33.119285 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:33.119245    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz" event={"ID":"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4","Type":"ContainerStarted","Data":"818d17c4acd5a7c6cbe1bc46b38e8fceb3f45de1d6a008804f3b5495a5f5320a"}
Sep 11 13:26:33.121181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:33.121144    2547 generic.go:356] "Generic (PLEG): container finished" podID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerID="6b2033e2d9ee7cb266519256524ce24f701cc0693dfd4aab537fcf3432653e9e" exitCode=0
Sep 11 13:26:33.121181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:33.121182    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg" event={"ID":"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511","Type":"ContainerDied","Data":"6b2033e2d9ee7cb266519256524ce24f701cc0693dfd4aab537fcf3432653e9e"}
Sep 11 13:26:36.137883 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:36.137841    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz" event={"ID":"3d0aa21b-52f1-44d8-8aa8-cfd97abff3f4","Type":"ContainerStarted","Data":"d039898e282482cba326ebbfc92f77dab2ff8289b687d3b07afd89d6578cd195"}
Sep 11 13:26:36.138335 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:36.137906    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:36.139854 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:36.139822    2547 generic.go:356] "Generic (PLEG): container finished" podID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerID="244955bfbf7b6094e6e33cef26de29917df7566b81e9441207d6c5d14e04e168" exitCode=0
Sep 11 13:26:36.139988 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:36.139877    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg" event={"ID":"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511","Type":"ContainerDied","Data":"244955bfbf7b6094e6e33cef26de29917df7566b81e9441207d6c5d14e04e168"}
Sep 11 13:26:36.156028 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:36.155972    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz" podStartSLOduration=1.87491775 podStartE2EDuration="5.155953408s" totalImagesPullingTime="3.281035658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:26:36.154883521 +0000 UTC m=+412.367427324" watchObservedRunningTime="2026-09-11 13:26:36.155953408 +0000 UTC m=+412.368497208"
Sep 11 13:26:37.146363 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:37.146329    2547 generic.go:356] "Generic (PLEG): container finished" podID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerID="2b7d6256e7c56ff363028a1038c9ccfb88b289b879d07cec457c260089daa03d" exitCode=0
Sep 11 13:26:37.146733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:37.146416    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg" event={"ID":"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511","Type":"ContainerDied","Data":"2b7d6256e7c56ff363028a1038c9ccfb88b289b879d07cec457c260089daa03d"}
Sep 11 13:26:38.181281 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.181238    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"]
Sep 11 13:26:38.185408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.185379    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.188074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.188051    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lj59r\""
Sep 11 13:26:38.193827 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.193797    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"]
Sep 11 13:26:38.281572 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.281545    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffb2adfd-9995-45f0-900e-531478de93db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q8k9s\" (UID: \"ffb2adfd-9995-45f0-900e-531478de93db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.281717 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.281609    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tnjb\" (UniqueName: \"kubernetes.io/projected/ffb2adfd-9995-45f0-900e-531478de93db-kube-api-access-4tnjb\") pod \"cert-manager-cainjector-559cdd8c87-q8k9s\" (UID: \"ffb2adfd-9995-45f0-900e-531478de93db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.287223 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.287195    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:38.382130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.382095    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-bundle\") pod \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") "
Sep 11 13:26:38.382331 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.382170    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxqv5\" (UniqueName: \"kubernetes.io/projected/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-kube-api-access-kxqv5\") pod \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") "
Sep 11 13:26:38.382331 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.382218    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-util\") pod \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\" (UID: \"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511\") "
Sep 11 13:26:38.382331 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.382306    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffb2adfd-9995-45f0-900e-531478de93db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q8k9s\" (UID: \"ffb2adfd-9995-45f0-900e-531478de93db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.382498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.382357    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tnjb\" (UniqueName: \"kubernetes.io/projected/ffb2adfd-9995-45f0-900e-531478de93db-kube-api-access-4tnjb\") pod \"cert-manager-cainjector-559cdd8c87-q8k9s\" (UID: \"ffb2adfd-9995-45f0-900e-531478de93db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.382702 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.382671    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-bundle" (OuterVolumeSpecName: "bundle") pod "1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" (UID: "1cd9fed5-6f3e-462d-8cc7-28d0a64a7511"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:38.384386 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.384359    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-kube-api-access-kxqv5" (OuterVolumeSpecName: "kube-api-access-kxqv5") pod "1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" (UID: "1cd9fed5-6f3e-462d-8cc7-28d0a64a7511"). InnerVolumeSpecName "kube-api-access-kxqv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:26:38.386645 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.386617    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-util" (OuterVolumeSpecName: "util") pod "1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" (UID: "1cd9fed5-6f3e-462d-8cc7-28d0a64a7511"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:26:38.391068 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.391037    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffb2adfd-9995-45f0-900e-531478de93db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q8k9s\" (UID: \"ffb2adfd-9995-45f0-900e-531478de93db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.392690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.392664    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tnjb\" (UniqueName: \"kubernetes.io/projected/ffb2adfd-9995-45f0-900e-531478de93db-kube-api-access-4tnjb\") pod \"cert-manager-cainjector-559cdd8c87-q8k9s\" (UID: \"ffb2adfd-9995-45f0-900e-531478de93db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.482981 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.482876    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:26:38.482981 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.482950    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxqv5\" (UniqueName: \"kubernetes.io/projected/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-kube-api-access-kxqv5\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:26:38.482981 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.482959    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cd9fed5-6f3e-462d-8cc7-28d0a64a7511-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:26:38.495845 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.495813    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"
Sep 11 13:26:38.769365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:38.769337    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s"]
Sep 11 13:26:38.771727 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:26:38.771700    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffb2adfd_9995_45f0_900e_531478de93db.slice/crio-e46d166555c87d84de0cd85be516e2c1bb4166f727b4d1de4a56bd3a57a418a0 WatchSource:0}: Error finding container e46d166555c87d84de0cd85be516e2c1bb4166f727b4d1de4a56bd3a57a418a0: Status 404 returned error can't find the container with id e46d166555c87d84de0cd85be516e2c1bb4166f727b4d1de4a56bd3a57a418a0
Sep 11 13:26:39.158094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:39.158063    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg"
Sep 11 13:26:39.158290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:39.158059    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs77wg" event={"ID":"1cd9fed5-6f3e-462d-8cc7-28d0a64a7511","Type":"ContainerDied","Data":"b2e46715bee48d3467d369730d574060f188353748ba2e8bca31455e9cbd18eb"}
Sep 11 13:26:39.158290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:39.158203    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2e46715bee48d3467d369730d574060f188353748ba2e8bca31455e9cbd18eb"
Sep 11 13:26:39.160074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:39.160034    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s" event={"ID":"ffb2adfd-9995-45f0-900e-531478de93db","Type":"ContainerStarted","Data":"e2f10235fc436c5d7efb0d516878faf0070c0ad65856860888490c09ab18ea8d"}
Sep 11 13:26:39.160210 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:39.160083    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s" event={"ID":"ffb2adfd-9995-45f0-900e-531478de93db","Type":"ContainerStarted","Data":"e46d166555c87d84de0cd85be516e2c1bb4166f727b4d1de4a56bd3a57a418a0"}
Sep 11 13:26:39.178680 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:39.178624    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8k9s" podStartSLOduration=1.178605516 podStartE2EDuration="1.178605516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:26:39.177271304 +0000 UTC m=+415.389815474" watchObservedRunningTime="2026-09-11 13:26:39.178605516 +0000 UTC m=+415.391149315"
Sep 11 13:26:42.148817 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:42.148786    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-z55cz"
Sep 11 13:26:49.645682 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.645639    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"]
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.645951    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="extract"
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.645962    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="extract"
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.645988    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="util"
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.645993    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="util"
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.645999    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="pull"
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.646005    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="pull"
Sep 11 13:26:49.646164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.646058    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd9fed5-6f3e-462d-8cc7-28d0a64a7511" containerName="extract"
Sep 11 13:26:49.692875 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.692837    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"]
Sep 11 13:26:49.693041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.692956    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:49.695675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.695655    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rr729\""
Sep 11 13:26:49.696867 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.696842    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 13:26:49.697003 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.696846    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 13:26:49.784250 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.784209    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8th6\" (UniqueName: \"kubernetes.io/projected/3666b526-0605-4228-89a2-a4ff2892033b-kube-api-access-g8th6\") pod \"openshift-lws-operator-fd8ccff4c-h9jw5\" (UID: \"3666b526-0605-4228-89a2-a4ff2892033b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:49.784426 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.784336    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3666b526-0605-4228-89a2-a4ff2892033b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h9jw5\" (UID: \"3666b526-0605-4228-89a2-a4ff2892033b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:49.885228 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.885183    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3666b526-0605-4228-89a2-a4ff2892033b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h9jw5\" (UID: \"3666b526-0605-4228-89a2-a4ff2892033b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:49.885397 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.885246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8th6\" (UniqueName: \"kubernetes.io/projected/3666b526-0605-4228-89a2-a4ff2892033b-kube-api-access-g8th6\") pod \"openshift-lws-operator-fd8ccff4c-h9jw5\" (UID: \"3666b526-0605-4228-89a2-a4ff2892033b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:49.885574 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.885553    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3666b526-0605-4228-89a2-a4ff2892033b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h9jw5\" (UID: \"3666b526-0605-4228-89a2-a4ff2892033b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:49.894023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:49.893995    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8th6\" (UniqueName: \"kubernetes.io/projected/3666b526-0605-4228-89a2-a4ff2892033b-kube-api-access-g8th6\") pod \"openshift-lws-operator-fd8ccff4c-h9jw5\" (UID: \"3666b526-0605-4228-89a2-a4ff2892033b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:50.001793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:50.001712    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"
Sep 11 13:26:50.290537 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:50.290447    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5"]
Sep 11 13:26:50.292822 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:26:50.292788    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3666b526_0605_4228_89a2_a4ff2892033b.slice/crio-8e1da9be9c39ff2c472e0795d0ca8cf02e7b8b26db9c9081033f8189190d58b0 WatchSource:0}: Error finding container 8e1da9be9c39ff2c472e0795d0ca8cf02e7b8b26db9c9081033f8189190d58b0: Status 404 returned error can't find the container with id 8e1da9be9c39ff2c472e0795d0ca8cf02e7b8b26db9c9081033f8189190d58b0
Sep 11 13:26:51.216794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:51.216761    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5" event={"ID":"3666b526-0605-4228-89a2-a4ff2892033b","Type":"ContainerStarted","Data":"8e1da9be9c39ff2c472e0795d0ca8cf02e7b8b26db9c9081033f8189190d58b0"}
Sep 11 13:26:54.120115 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.120078    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d54d858c9-xkhrn"]
Sep 11 13:26:54.123547 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.123517    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.135218 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.135187    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d54d858c9-xkhrn"]
Sep 11 13:26:54.219228 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219188    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxkvr\" (UniqueName: \"kubernetes.io/projected/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-kube-api-access-zxkvr\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.219228 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219230    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-config\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.219447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219300    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-oauth-config\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.219447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219326    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-oauth-serving-cert\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.219447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219432    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-serving-cert\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.219560 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219466    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-trusted-ca-bundle\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.219560 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.219485    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-service-ca\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320402 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320346    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxkvr\" (UniqueName: \"kubernetes.io/projected/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-kube-api-access-zxkvr\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320402 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-config\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320444    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-oauth-config\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320464    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-oauth-serving-cert\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320517    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-serving-cert\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320551    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-trusted-ca-bundle\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.320665 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.320584    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-service-ca\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.321483 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.321459    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-oauth-serving-cert\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.321710 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.321488    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-service-ca\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.321710 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.321479    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-config\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.321886 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.321614    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-trusted-ca-bundle\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.323251 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.323226    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-serving-cert\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.323340 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.323236    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-console-oauth-config\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.329288 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.329266    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxkvr\" (UniqueName: \"kubernetes.io/projected/ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c-kube-api-access-zxkvr\") pod \"console-5d54d858c9-xkhrn\" (UID: \"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c\") " pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.434598 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.434557    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:26:54.707714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:54.707687    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d54d858c9-xkhrn"]
Sep 11 13:26:54.709248 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:26:54.709224    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbfa30e_cd56_4bcc_8a0f_cb30dd10071c.slice/crio-8da6e708631bd310311c4276ab394837032b1144f6f48e55a106a97f107b2e5f WatchSource:0}: Error finding container 8da6e708631bd310311c4276ab394837032b1144f6f48e55a106a97f107b2e5f: Status 404 returned error can't find the container with id 8da6e708631bd310311c4276ab394837032b1144f6f48e55a106a97f107b2e5f
Sep 11 13:26:55.241286 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:55.241242    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d54d858c9-xkhrn" event={"ID":"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c","Type":"ContainerStarted","Data":"a4b2409fcfe034f383f2cfc4adcf3b5f45e4872e94c8d02fb13ca0ff76d5ca05"}
Sep 11 13:26:55.241679 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:55.241305    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d54d858c9-xkhrn" event={"ID":"ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c","Type":"ContainerStarted","Data":"8da6e708631bd310311c4276ab394837032b1144f6f48e55a106a97f107b2e5f"}
Sep 11 13:26:55.266692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:26:55.266587    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d54d858c9-xkhrn" podStartSLOduration=1.266565621 podStartE2EDuration="1.266565621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:26:55.263335629 +0000 UTC m=+431.475879430" watchObservedRunningTime="2026-09-11 13:26:55.266565621 +0000 UTC m=+431.479109421"
Sep 11 13:27:02.275677 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:02.275643    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5" event={"ID":"3666b526-0605-4228-89a2-a4ff2892033b","Type":"ContainerStarted","Data":"c88584afe3bfe30c1a012552926d8e8bf199015fd317c69a6f158e8eb187f5e6"}
Sep 11 13:27:02.296109 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:02.296060    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h9jw5" podStartSLOduration=1.939058264 podStartE2EDuration="13.296043498s" totalImagesPullingTime="11.356985234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:02.294354745 +0000 UTC m=+438.506898560" watchObservedRunningTime="2026-09-11 13:27:02.296043498 +0000 UTC m=+438.508587354"
Sep 11 13:27:04.435493 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.435441    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:27:04.435873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.435543    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:27:04.440573 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.440540    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:27:04.845353 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.845263    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"]
Sep 11 13:27:04.849004 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.848983    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:04.862674 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.862645    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:27:04.863127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.863106    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:27:04.863181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.863124    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6drkt\""
Sep 11 13:27:04.880814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.880770    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"]
Sep 11 13:27:04.910627 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.910591    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:04.910627 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.910626    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:04.910836 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:04.910660    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7brl\" (UniqueName: \"kubernetes.io/projected/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-kube-api-access-d7brl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.012170 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.012132    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.012170 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.012173    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.012463 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.012209    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7brl\" (UniqueName: \"kubernetes.io/projected/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-kube-api-access-d7brl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.012586 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.012567    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.012627 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.012598    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.021656 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.021625    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7brl\" (UniqueName: \"kubernetes.io/projected/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-kube-api-access-d7brl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.158339 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.158306    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:05.302305 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.302275    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d54d858c9-xkhrn"
Sep 11 13:27:05.387408 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.387374    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b44cb474f-45frk"]
Sep 11 13:27:05.476583 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:05.476560    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"]
Sep 11 13:27:05.479294 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:27:05.479224    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cbacd0_5881_46a5_bd84_3442c6abd9bd.slice/crio-849662ea57a857b84f8da36116da83b8b97089ebf3fb6b7ecab6b344ec359f80 WatchSource:0}: Error finding container 849662ea57a857b84f8da36116da83b8b97089ebf3fb6b7ecab6b344ec359f80: Status 404 returned error can't find the container with id 849662ea57a857b84f8da36116da83b8b97089ebf3fb6b7ecab6b344ec359f80
Sep 11 13:27:06.304478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:06.304387    2547 generic.go:356] "Generic (PLEG): container finished" podID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerID="d1ef359f34cdd2fa62e5f59a1fc250782a09551b37e74d578cbe8060a3a036f1" exitCode=0
Sep 11 13:27:06.304649 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:06.304470    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2" event={"ID":"a6cbacd0-5881-46a5-bd84-3442c6abd9bd","Type":"ContainerDied","Data":"d1ef359f34cdd2fa62e5f59a1fc250782a09551b37e74d578cbe8060a3a036f1"}
Sep 11 13:27:06.304649 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:06.304523    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2" event={"ID":"a6cbacd0-5881-46a5-bd84-3442c6abd9bd","Type":"ContainerStarted","Data":"849662ea57a857b84f8da36116da83b8b97089ebf3fb6b7ecab6b344ec359f80"}
Sep 11 13:27:07.310967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:07.310849    2547 generic.go:356] "Generic (PLEG): container finished" podID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerID="d3cf6ccd86452447d32a9405c81b6c6a18462c02a5dfc6a4964d6f7b053592e0" exitCode=0
Sep 11 13:27:07.310967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:07.310941    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2" event={"ID":"a6cbacd0-5881-46a5-bd84-3442c6abd9bd","Type":"ContainerDied","Data":"d3cf6ccd86452447d32a9405c81b6c6a18462c02a5dfc6a4964d6f7b053592e0"}
Sep 11 13:27:08.318014 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:08.317979    2547 generic.go:356] "Generic (PLEG): container finished" podID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerID="d7b63d4b16d1f2774dab7ebbd10becb92f6f05d586b0f031d6a92244e88cec9f" exitCode=0
Sep 11 13:27:08.318472 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:08.318062    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2" event={"ID":"a6cbacd0-5881-46a5-bd84-3442c6abd9bd","Type":"ContainerDied","Data":"d7b63d4b16d1f2774dab7ebbd10becb92f6f05d586b0f031d6a92244e88cec9f"}
Sep 11 13:27:09.449622 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.449585    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:09.553443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.553404    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7brl\" (UniqueName: \"kubernetes.io/projected/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-kube-api-access-d7brl\") pod \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") "
Sep 11 13:27:09.553650 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.553476    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-util\") pod \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") "
Sep 11 13:27:09.553650 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.553578    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-bundle\") pod \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\" (UID: \"a6cbacd0-5881-46a5-bd84-3442c6abd9bd\") "
Sep 11 13:27:09.554286 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.554262    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-bundle" (OuterVolumeSpecName: "bundle") pod "a6cbacd0-5881-46a5-bd84-3442c6abd9bd" (UID: "a6cbacd0-5881-46a5-bd84-3442c6abd9bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:09.555708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.555681    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-kube-api-access-d7brl" (OuterVolumeSpecName: "kube-api-access-d7brl") pod "a6cbacd0-5881-46a5-bd84-3442c6abd9bd" (UID: "a6cbacd0-5881-46a5-bd84-3442c6abd9bd"). InnerVolumeSpecName "kube-api-access-d7brl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:27:09.559585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.559550    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-util" (OuterVolumeSpecName: "util") pod "a6cbacd0-5881-46a5-bd84-3442c6abd9bd" (UID: "a6cbacd0-5881-46a5-bd84-3442c6abd9bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:09.655078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.655042    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:09.655078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.655072    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7brl\" (UniqueName: \"kubernetes.io/projected/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-kube-api-access-d7brl\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:09.655078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:09.655083    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6cbacd0-5881-46a5-bd84-3442c6abd9bd-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:10.330095 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:10.330060    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2" event={"ID":"a6cbacd0-5881-46a5-bd84-3442c6abd9bd","Type":"ContainerDied","Data":"849662ea57a857b84f8da36116da83b8b97089ebf3fb6b7ecab6b344ec359f80"}
Sep 11 13:27:10.330095 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:10.330096    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af97hf2"
Sep 11 13:27:10.330301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:10.330115    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="849662ea57a857b84f8da36116da83b8b97089ebf3fb6b7ecab6b344ec359f80"
Sep 11 13:27:16.013032 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.012987    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"]
Sep 11 13:27:16.013524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013456    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="pull"
Sep 11 13:27:16.013524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013474    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="pull"
Sep 11 13:27:16.013524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013497    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="util"
Sep 11 13:27:16.013524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013505    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="util"
Sep 11 13:27:16.013740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013526    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="extract"
Sep 11 13:27:16.013740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013537    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="extract"
Sep 11 13:27:16.013740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.013627    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6cbacd0-5881-46a5-bd84-3442c6abd9bd" containerName="extract"
Sep 11 13:27:16.017199 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.017171    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.020623 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.020574    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:27:16.020774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.020742    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6drkt\""
Sep 11 13:27:16.021677 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.021659    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:27:16.027173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.027142    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"]
Sep 11 13:27:16.112761 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.112722    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fbf8\" (UniqueName: \"kubernetes.io/projected/ce162dca-d99c-4cd6-b33e-91cd0882993a-kube-api-access-6fbf8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.112953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.112770    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.112953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.112850    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.214158 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.214117    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.214351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.214175    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fbf8\" (UniqueName: \"kubernetes.io/projected/ce162dca-d99c-4cd6-b33e-91cd0882993a-kube-api-access-6fbf8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.214351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.214303    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.214653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.214629    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.214692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.214640    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.223255 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.223215    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fbf8\" (UniqueName: \"kubernetes.io/projected/ce162dca-d99c-4cd6-b33e-91cd0882993a-kube-api-access-6fbf8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.327385 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.327279    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:16.605725 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:16.605670    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"]
Sep 11 13:27:16.607954 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:27:16.607900    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce162dca_d99c_4cd6_b33e_91cd0882993a.slice/crio-c2bd41ec762e2dbaf4c14224f1ae6bfd4ee9e1806570554fa11d4e13c1032000 WatchSource:0}: Error finding container c2bd41ec762e2dbaf4c14224f1ae6bfd4ee9e1806570554fa11d4e13c1032000: Status 404 returned error can't find the container with id c2bd41ec762e2dbaf4c14224f1ae6bfd4ee9e1806570554fa11d4e13c1032000
Sep 11 13:27:17.366533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:17.366492    2547 generic.go:356] "Generic (PLEG): container finished" podID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerID="6386cfeff1458e72104f0aa4afcf854d50b453f6457dd4a774ad173528d67d31" exitCode=0
Sep 11 13:27:17.366931 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:17.366564    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6" event={"ID":"ce162dca-d99c-4cd6-b33e-91cd0882993a","Type":"ContainerDied","Data":"6386cfeff1458e72104f0aa4afcf854d50b453f6457dd4a774ad173528d67d31"}
Sep 11 13:27:17.366931 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:17.366638    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6" event={"ID":"ce162dca-d99c-4cd6-b33e-91cd0882993a","Type":"ContainerStarted","Data":"c2bd41ec762e2dbaf4c14224f1ae6bfd4ee9e1806570554fa11d4e13c1032000"}
Sep 11 13:27:18.030235 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.030202    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"]
Sep 11 13:27:18.033729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.033696    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.037936 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.037897    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlvws\""
Sep 11 13:27:18.038278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.038259    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 13:27:18.038384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.038259    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 13:27:18.038384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.038299    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 13:27:18.038384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.038313    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 13:27:18.055782 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.055747    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"]
Sep 11 13:27:18.131296 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.131262    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dae5d9c9-d494-49cf-af4b-7dce8092285c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.131476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.131321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92mt6\" (UniqueName: \"kubernetes.io/projected/dae5d9c9-d494-49cf-af4b-7dce8092285c-kube-api-access-92mt6\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.131476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.131399    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae5d9c9-d494-49cf-af4b-7dce8092285c-tmp\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.131476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.131437    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dae5d9c9-d494-49cf-af4b-7dce8092285c-webhook-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.131476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.131462    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dae5d9c9-d494-49cf-af4b-7dce8092285c-manifests\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.232163 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.232066    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dae5d9c9-d494-49cf-af4b-7dce8092285c-manifests\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.232163 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.232150    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dae5d9c9-d494-49cf-af4b-7dce8092285c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.232404 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.232203    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92mt6\" (UniqueName: \"kubernetes.io/projected/dae5d9c9-d494-49cf-af4b-7dce8092285c-kube-api-access-92mt6\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.232404 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.232242    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae5d9c9-d494-49cf-af4b-7dce8092285c-tmp\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.232404 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.232269    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dae5d9c9-d494-49cf-af4b-7dce8092285c-webhook-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.232602 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.232572    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dae5d9c9-d494-49cf-af4b-7dce8092285c-manifests\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.235107 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.235076    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dae5d9c9-d494-49cf-af4b-7dce8092285c-webhook-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.235364 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.235344    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dae5d9c9-d494-49cf-af4b-7dce8092285c-tmp\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.235553 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.235524    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dae5d9c9-d494-49cf-af4b-7dce8092285c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.249171 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.249144    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92mt6\" (UniqueName: \"kubernetes.io/projected/dae5d9c9-d494-49cf-af4b-7dce8092285c-kube-api-access-92mt6\") pod \"opendatahub-operator-controller-manager-64959b9bbc-mftg4\" (UID: \"dae5d9c9-d494-49cf-af4b-7dce8092285c\") " pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.373472 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.373440    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:18.373894 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.373727    2547 generic.go:356] "Generic (PLEG): container finished" podID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerID="1c515e4d6d2aeefbf787e650412b3c486afdd8d952ccf9b606be095a490fa900" exitCode=0
Sep 11 13:27:18.373894 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.373774    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6" event={"ID":"ce162dca-d99c-4cd6-b33e-91cd0882993a","Type":"ContainerDied","Data":"1c515e4d6d2aeefbf787e650412b3c486afdd8d952ccf9b606be095a490fa900"}
Sep 11 13:27:18.665835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:18.665808    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"]
Sep 11 13:27:18.668287 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:27:18.668258    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae5d9c9_d494_49cf_af4b_7dce8092285c.slice/crio-cf274fcdc70dd24896b50b4a5936a2a95b575e83a107028423803fa5b968bfc2 WatchSource:0}: Error finding container cf274fcdc70dd24896b50b4a5936a2a95b575e83a107028423803fa5b968bfc2: Status 404 returned error can't find the container with id cf274fcdc70dd24896b50b4a5936a2a95b575e83a107028423803fa5b968bfc2
Sep 11 13:27:19.382728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:19.382684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4" event={"ID":"dae5d9c9-d494-49cf-af4b-7dce8092285c","Type":"ContainerStarted","Data":"cf274fcdc70dd24896b50b4a5936a2a95b575e83a107028423803fa5b968bfc2"}
Sep 11 13:27:19.386329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:19.386287    2547 generic.go:356] "Generic (PLEG): container finished" podID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerID="13940c1b8bbf664a7fb4d76210a1874eefb9a50fe0681f7e8e269ab15c7cf9ba" exitCode=0
Sep 11 13:27:19.386503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:19.386363    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6" event={"ID":"ce162dca-d99c-4cd6-b33e-91cd0882993a","Type":"ContainerDied","Data":"13940c1b8bbf664a7fb4d76210a1874eefb9a50fe0681f7e8e269ab15c7cf9ba"}
Sep 11 13:27:21.668744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.668715    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:21.767182 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.767159    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-bundle\") pod \"ce162dca-d99c-4cd6-b33e-91cd0882993a\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") "
Sep 11 13:27:21.767280 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.767222    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fbf8\" (UniqueName: \"kubernetes.io/projected/ce162dca-d99c-4cd6-b33e-91cd0882993a-kube-api-access-6fbf8\") pod \"ce162dca-d99c-4cd6-b33e-91cd0882993a\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") "
Sep 11 13:27:21.767280 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.767244    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-util\") pod \"ce162dca-d99c-4cd6-b33e-91cd0882993a\" (UID: \"ce162dca-d99c-4cd6-b33e-91cd0882993a\") "
Sep 11 13:27:21.768061 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.768030    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-bundle" (OuterVolumeSpecName: "bundle") pod "ce162dca-d99c-4cd6-b33e-91cd0882993a" (UID: "ce162dca-d99c-4cd6-b33e-91cd0882993a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:21.769828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.769795    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce162dca-d99c-4cd6-b33e-91cd0882993a-kube-api-access-6fbf8" (OuterVolumeSpecName: "kube-api-access-6fbf8") pod "ce162dca-d99c-4cd6-b33e-91cd0882993a" (UID: "ce162dca-d99c-4cd6-b33e-91cd0882993a"). InnerVolumeSpecName "kube-api-access-6fbf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:27:21.773422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.773397    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-util" (OuterVolumeSpecName: "util") pod "ce162dca-d99c-4cd6-b33e-91cd0882993a" (UID: "ce162dca-d99c-4cd6-b33e-91cd0882993a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:27:21.868324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.868278    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:21.868324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.868310    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fbf8\" (UniqueName: \"kubernetes.io/projected/ce162dca-d99c-4cd6-b33e-91cd0882993a-kube-api-access-6fbf8\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:21.868324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:21.868319    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce162dca-d99c-4cd6-b33e-91cd0882993a-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:22.405469 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:22.405438    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6"
Sep 11 13:27:22.405469 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:22.405463    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b02zvj6" event={"ID":"ce162dca-d99c-4cd6-b33e-91cd0882993a","Type":"ContainerDied","Data":"c2bd41ec762e2dbaf4c14224f1ae6bfd4ee9e1806570554fa11d4e13c1032000"}
Sep 11 13:27:22.405733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:22.405511    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2bd41ec762e2dbaf4c14224f1ae6bfd4ee9e1806570554fa11d4e13c1032000"
Sep 11 13:27:22.407465 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:22.407428    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4" event={"ID":"dae5d9c9-d494-49cf-af4b-7dce8092285c","Type":"ContainerStarted","Data":"08704fc6486409b04745c972098fff1c665f6b722e8a816d0420acbf74be2a69"}
Sep 11 13:27:23.413363 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:23.413323    2547 generic.go:356] "Generic (PLEG): container finished" podID="dae5d9c9-d494-49cf-af4b-7dce8092285c" containerID="08704fc6486409b04745c972098fff1c665f6b722e8a816d0420acbf74be2a69" exitCode=0
Sep 11 13:27:23.413742 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:23.413374    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4" event={"ID":"dae5d9c9-d494-49cf-af4b-7dce8092285c","Type":"ContainerDied","Data":"08704fc6486409b04745c972098fff1c665f6b722e8a816d0420acbf74be2a69"}
Sep 11 13:27:24.420630 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:24.420596    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4" event={"ID":"dae5d9c9-d494-49cf-af4b-7dce8092285c","Type":"ContainerStarted","Data":"b2e27e2687980f1229a8ee696ff228898f34488a50c17a30816f5a6d78527a8a"}
Sep 11 13:27:24.421055 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:24.420699    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:24.443320 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:24.443261    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4" podStartSLOduration=2.992001947 podStartE2EDuration="7.443238662s" totalImagesPullingTime="3.359799919s" totalInitContainerRuntime="1.091436796s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:24.441342319 +0000 UTC m=+460.653886132" watchObservedRunningTime="2026-09-11 13:27:24.443238662 +0000 UTC m=+460.655782461"
Sep 11 13:27:30.409967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.409923    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b44cb474f-45frk" podUID="f41b2e72-0e30-4e87-9b4f-776b73e540ce" containerName="console" containerID="cri-o://6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d" gracePeriod=15
Sep 11 13:27:30.660450 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.660387    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:27:30.749390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749348    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-oauth-config\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.749390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749401    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-serving-cert\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.749613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749434    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9fp2\" (UniqueName: \"kubernetes.io/projected/f41b2e72-0e30-4e87-9b4f-776b73e540ce-kube-api-access-b9fp2\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.749613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749469    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-trusted-ca-bundle\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.749613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749498    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-config\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.749613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749524    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-oauth-serving-cert\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.749613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749585    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-service-ca\") pod \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\" (UID: \"f41b2e72-0e30-4e87-9b4f-776b73e540ce\") "
Sep 11 13:27:30.750008 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749964    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-config" (OuterVolumeSpecName: "console-config") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:27:30.750120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.749982    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:27:30.750254 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.750108    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:27:30.750254 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.750187    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-service-ca" (OuterVolumeSpecName: "service-ca") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:27:30.751728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.751706    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:27:30.751814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.751726    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:27:30.751814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.751760    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41b2e72-0e30-4e87-9b4f-776b73e540ce-kube-api-access-b9fp2" (OuterVolumeSpecName: "kube-api-access-b9fp2") pod "f41b2e72-0e30-4e87-9b4f-776b73e540ce" (UID: "f41b2e72-0e30-4e87-9b4f-776b73e540ce"). InnerVolumeSpecName "kube-api-access-b9fp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:27:30.850394 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850337    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:30.850394 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850385    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-oauth-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:30.850394 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850395    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:30.850394 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850404    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9fp2\" (UniqueName: \"kubernetes.io/projected/f41b2e72-0e30-4e87-9b4f-776b73e540ce-kube-api-access-b9fp2\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:30.850655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850414    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-trusted-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:30.850655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850423    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-console-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:30.850655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:30.850431    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f41b2e72-0e30-4e87-9b4f-776b73e540ce-oauth-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:27:31.457543 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.457506    2547 generic.go:356] "Generic (PLEG): container finished" podID="f41b2e72-0e30-4e87-9b4f-776b73e540ce" containerID="6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d" exitCode=0
Sep 11 13:27:31.457957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.457551    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b44cb474f-45frk"
Sep 11 13:27:31.457957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.457558    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b44cb474f-45frk" event={"ID":"f41b2e72-0e30-4e87-9b4f-776b73e540ce","Type":"ContainerDied","Data":"6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d"}
Sep 11 13:27:31.457957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.457599    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b44cb474f-45frk" event={"ID":"f41b2e72-0e30-4e87-9b4f-776b73e540ce","Type":"ContainerDied","Data":"e47ec23d774fe9359bb1506bfee4f333ab38433f268c3577b400e228dc90b2ed"}
Sep 11 13:27:31.457957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.457619    2547 scope.go:117] "RemoveContainer" containerID="6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d"
Sep 11 13:27:31.466669 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.466650    2547 scope.go:117] "RemoveContainer" containerID="6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d"
Sep 11 13:27:31.467019 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:27:31.466996    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d\": container with ID starting with 6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d not found: ID does not exist" containerID="6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d"
Sep 11 13:27:31.467081 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.467031    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d"} err="failed to get container status \"6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d\": rpc error: code = NotFound desc = could not find container \"6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d\": container with ID starting with 6b11d51fc62978d4ca0b15116d8b30be6d1cfa5c7d32d508537a187a5e31df3d not found: ID does not exist"
Sep 11 13:27:31.482790 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.482760    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b44cb474f-45frk"]
Sep 11 13:27:31.492192 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:31.492161    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b44cb474f-45frk"]
Sep 11 13:27:32.253854 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:32.253798    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41b2e72-0e30-4e87-9b4f-776b73e540ce" path="/var/lib/kubelet/pods/f41b2e72-0e30-4e87-9b4f-776b73e540ce/volumes"
Sep 11 13:27:35.429336 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:35.429299    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64959b9bbc-mftg4"
Sep 11 13:27:37.874026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.873979    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"]
Sep 11 13:27:37.874409 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874388    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="pull"
Sep 11 13:27:37.874409 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874402    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="pull"
Sep 11 13:27:37.874478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874411    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="extract"
Sep 11 13:27:37.874478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874416    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="extract"
Sep 11 13:27:37.874478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874424    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="util"
Sep 11 13:27:37.874478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874429    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="util"
Sep 11 13:27:37.874478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874448    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41b2e72-0e30-4e87-9b4f-776b73e540ce" containerName="console"
Sep 11 13:27:37.874478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874452    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41b2e72-0e30-4e87-9b4f-776b73e540ce" containerName="console"
Sep 11 13:27:37.874655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874504    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41b2e72-0e30-4e87-9b4f-776b73e540ce" containerName="console"
Sep 11 13:27:37.874655 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.874513    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce162dca-d99c-4cd6-b33e-91cd0882993a" containerName="extract"
Sep 11 13:27:37.877874 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.877841    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:37.882198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.882171    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 13:27:37.882306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.882255    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 13:27:37.883333 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.883310    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 13:27:37.883435 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.883339    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8swl5\""
Sep 11 13:27:37.893810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:37.893780    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"]
Sep 11 13:27:38.011591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.011556    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e808ef0f-9981-44ca-99f8-edb4391f458d-cert\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.011591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.011595    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e808ef0f-9981-44ca-99f8-edb4391f458d-metrics-cert\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.011802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.011630    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42h7r\" (UniqueName: \"kubernetes.io/projected/e808ef0f-9981-44ca-99f8-edb4391f458d-kube-api-access-42h7r\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.011802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.011691    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e808ef0f-9981-44ca-99f8-edb4391f458d-manager-config\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.112184 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.112149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e808ef0f-9981-44ca-99f8-edb4391f458d-cert\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.112184 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.112187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e808ef0f-9981-44ca-99f8-edb4391f458d-metrics-cert\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.112395 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.112231    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42h7r\" (UniqueName: \"kubernetes.io/projected/e808ef0f-9981-44ca-99f8-edb4391f458d-kube-api-access-42h7r\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.112395 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.112266    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e808ef0f-9981-44ca-99f8-edb4391f458d-manager-config\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.112947 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.112902    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e808ef0f-9981-44ca-99f8-edb4391f458d-manager-config\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.114752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.114735    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e808ef0f-9981-44ca-99f8-edb4391f458d-metrics-cert\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.114813 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.114766    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e808ef0f-9981-44ca-99f8-edb4391f458d-cert\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.142569 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.142491    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42h7r\" (UniqueName: \"kubernetes.io/projected/e808ef0f-9981-44ca-99f8-edb4391f458d-kube-api-access-42h7r\") pod \"lws-controller-manager-75ffb8c58-5zzlm\" (UID: \"e808ef0f-9981-44ca-99f8-edb4391f458d\") " pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.184534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.184499    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"]
Sep 11 13:27:38.187487 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.187460    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:38.188156 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.188137    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.196643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.196621    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 13:27:38.197802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.197785    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 13:27:38.199168 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.199147    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 13:27:38.202592 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.202574    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 13:27:38.202969 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.202905    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9f2q8\""
Sep 11 13:27:38.228285 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.228183    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"]
Sep 11 13:27:38.314115 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.314071    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe91f64-0a14-4fff-b4fc-e979ab05807f-tmp\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.314290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.314122    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkc4q\" (UniqueName: \"kubernetes.io/projected/fbe91f64-0a14-4fff-b4fc-e979ab05807f-kube-api-access-zkc4q\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.314290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.314149    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe91f64-0a14-4fff-b4fc-e979ab05807f-tls-certs\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.415617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.415525    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe91f64-0a14-4fff-b4fc-e979ab05807f-tmp\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.415617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.415579    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkc4q\" (UniqueName: \"kubernetes.io/projected/fbe91f64-0a14-4fff-b4fc-e979ab05807f-kube-api-access-zkc4q\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.415617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.415616    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe91f64-0a14-4fff-b4fc-e979ab05807f-tls-certs\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.417999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.417977    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbe91f64-0a14-4fff-b4fc-e979ab05807f-tmp\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.418244 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.418226    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbe91f64-0a14-4fff-b4fc-e979ab05807f-tls-certs\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.426417 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.426394    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkc4q\" (UniqueName: \"kubernetes.io/projected/fbe91f64-0a14-4fff-b4fc-e979ab05807f-kube-api-access-zkc4q\") pod \"kube-auth-proxy-8589c48f5d-6lp9t\" (UID: \"fbe91f64-0a14-4fff-b4fc-e979ab05807f\") " pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.466481 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.466455    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"]
Sep 11 13:27:38.468859 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:27:38.468831    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode808ef0f_9981_44ca_99f8_edb4391f458d.slice/crio-fcfa626a82d266b7d466586c98df2e7da83b0bb885a43e87696d5e838dcc48b6 WatchSource:0}: Error finding container fcfa626a82d266b7d466586c98df2e7da83b0bb885a43e87696d5e838dcc48b6: Status 404 returned error can't find the container with id fcfa626a82d266b7d466586c98df2e7da83b0bb885a43e87696d5e838dcc48b6
Sep 11 13:27:38.492816 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.492785    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm" event={"ID":"e808ef0f-9981-44ca-99f8-edb4391f458d","Type":"ContainerStarted","Data":"fcfa626a82d266b7d466586c98df2e7da83b0bb885a43e87696d5e838dcc48b6"}
Sep 11 13:27:38.511948 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.511899    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"
Sep 11 13:27:38.791582 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:38.791495    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t"]
Sep 11 13:27:38.794765 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:27:38.794730    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe91f64_0a14_4fff_b4fc_e979ab05807f.slice/crio-6e370db39a6fe79cc74594b209e01c126b26ed5cd57213b9a3fd9f562542cb24 WatchSource:0}: Error finding container 6e370db39a6fe79cc74594b209e01c126b26ed5cd57213b9a3fd9f562542cb24: Status 404 returned error can't find the container with id 6e370db39a6fe79cc74594b209e01c126b26ed5cd57213b9a3fd9f562542cb24
Sep 11 13:27:39.506727 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:39.506685    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t" event={"ID":"fbe91f64-0a14-4fff-b4fc-e979ab05807f","Type":"ContainerStarted","Data":"6e370db39a6fe79cc74594b209e01c126b26ed5cd57213b9a3fd9f562542cb24"}
Sep 11 13:27:42.524811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:42.524771    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t" event={"ID":"fbe91f64-0a14-4fff-b4fc-e979ab05807f","Type":"ContainerStarted","Data":"9c9a61167c4878eb5d85dc65a3c124dea9b6a2cc0914916cc2d989c8699a2403"}
Sep 11 13:27:42.544068 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:42.544003    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8589c48f5d-6lp9t" podStartSLOduration=1.8044661720000001 podStartE2EDuration="4.543980002s" totalImagesPullingTime="2.73951383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:42.543897808 +0000 UTC m=+478.756441608" watchObservedRunningTime="2026-09-11 13:27:42.543980002 +0000 UTC m=+478.756523803"
Sep 11 13:27:48.558880 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:48.558836    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm" event={"ID":"e808ef0f-9981-44ca-99f8-edb4391f458d","Type":"ContainerStarted","Data":"e3fc308eaae517603aa4b0d0783f9eb1923b65088b54896ffd96488e1e26d2e2"}
Sep 11 13:27:48.559291 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:48.558964    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:27:48.578433 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:48.578369    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm" podStartSLOduration=2.020996761 podStartE2EDuration="11.578351575s" totalImagesPullingTime="9.557354814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:27:48.576182706 +0000 UTC m=+484.788726507" watchObservedRunningTime="2026-09-11 13:27:48.578351575 +0000 UTC m=+484.790895375"
Sep 11 13:27:59.566628 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:27:59.566590    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75ffb8c58-5zzlm"
Sep 11 13:28:54.956964 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:54.956864    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"]
Sep 11 13:28:54.960487 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:54.960461    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:54.963236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:54.963206    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 13:28:54.963395 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:54.963245    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 13:28:54.964303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:54.964285    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6drkt\""
Sep 11 13:28:54.969518 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:54.969490    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"]
Sep 11 13:28:55.060578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.060536    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.060787 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.060593    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shvl2\" (UniqueName: \"kubernetes.io/projected/125292c5-f499-46ba-b2c8-0e719ba15a98-kube-api-access-shvl2\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.060787 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.060697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.070419 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.070387    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"]
Sep 11 13:28:55.073926 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.073891    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.094125 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.094088    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"]
Sep 11 13:28:55.161279 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.161570 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161539    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzltp\" (UniqueName: \"kubernetes.io/projected/90c5a799-1bae-40c4-89fb-f43718c3e023-kube-api-access-rzltp\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.161703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161591    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.161779 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161714    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.161833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161772    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.161833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shvl2\" (UniqueName: \"kubernetes.io/projected/125292c5-f499-46ba-b2c8-0e719ba15a98-kube-api-access-shvl2\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.161935 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.161829    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.162094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.162078    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.163643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.163624    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"]
Sep 11 13:28:55.167214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.167195    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.175196 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.175170    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shvl2\" (UniqueName: \"kubernetes.io/projected/125292c5-f499-46ba-b2c8-0e719ba15a98-kube-api-access-shvl2\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.179141 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.179113    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"]
Sep 11 13:28:55.262793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.262694    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.262793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.262741    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"]
Sep 11 13:28:55.262793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.262751    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.263101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.262830    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.263101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.262887    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzltp\" (UniqueName: \"kubernetes.io/projected/90c5a799-1bae-40c4-89fb-f43718c3e023-kube-api-access-rzltp\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.263101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.262971    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.263101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.263047    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82v8d\" (UniqueName: \"kubernetes.io/projected/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-kube-api-access-82v8d\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.263265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.263183    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.263382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.263365    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.266477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.266462    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.270478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.270455    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:55.271858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.271837    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzltp\" (UniqueName: \"kubernetes.io/projected/90c5a799-1bae-40c4-89fb-f43718c3e023-kube-api-access-rzltp\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.276754 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.276727    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"]
Sep 11 13:28:55.364421 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364377    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z47v7\" (UniqueName: \"kubernetes.io/projected/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-kube-api-access-z47v7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.364599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364438    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82v8d\" (UniqueName: \"kubernetes.io/projected/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-kube-api-access-82v8d\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.364599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364482    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.364599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364517    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.364599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364576    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.364818 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.364994 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.364971    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.365069 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.365007    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.374258 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.374223    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82v8d\" (UniqueName: \"kubernetes.io/projected/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-kube-api-access-82v8d\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.382870 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.382839    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:55.465591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.465555    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.465754 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.465694    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.465754 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.465744    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z47v7\" (UniqueName: \"kubernetes.io/projected/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-kube-api-access-z47v7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.466107 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.466085    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.466167 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.466093    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.475353 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.475324    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z47v7\" (UniqueName: \"kubernetes.io/projected/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-kube-api-access-z47v7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.485923 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.485885    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:55.558811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.558776    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"]
Sep 11 13:28:55.560354 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:28:55.560320    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125292c5_f499_46ba_b2c8_0e719ba15a98.slice/crio-96674fdcd046e8f1d416bffca372696e7b6295d83e1363698e6746073d7a5d66 WatchSource:0}: Error finding container 96674fdcd046e8f1d416bffca372696e7b6295d83e1363698e6746073d7a5d66: Status 404 returned error can't find the container with id 96674fdcd046e8f1d416bffca372696e7b6295d83e1363698e6746073d7a5d66
Sep 11 13:28:55.602793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.602761    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:28:55.665243 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.662591    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"]
Sep 11 13:28:55.665243 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:28:55.664440    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c5a799_1bae_40c4_89fb_f43718c3e023.slice/crio-3953cab43f8f8e99cb27d7f5a0b30397bf521f3bb666138dbab05dc1fcb13773 WatchSource:0}: Error finding container 3953cab43f8f8e99cb27d7f5a0b30397bf521f3bb666138dbab05dc1fcb13773: Status 404 returned error can't find the container with id 3953cab43f8f8e99cb27d7f5a0b30397bf521f3bb666138dbab05dc1fcb13773
Sep 11 13:28:55.762821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.762752    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"]
Sep 11 13:28:55.765004 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:28:55.764963    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2deb90c9_d2b6_4c72_9bcb_00ae422888f2.slice/crio-ce6198618b35d06338b4f391f21d1fc297656092408bbcee2a08c606d5bd60bc WatchSource:0}: Error finding container ce6198618b35d06338b4f391f21d1fc297656092408bbcee2a08c606d5bd60bc: Status 404 returned error can't find the container with id ce6198618b35d06338b4f391f21d1fc297656092408bbcee2a08c606d5bd60bc
Sep 11 13:28:55.856976 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:28:55.856931    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c5a799_1bae_40c4_89fb_f43718c3e023.slice/crio-conmon-41d73a45bf6d68ee12c0c73137e233b10645ed491a4125c92294696c332785c2.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c5a799_1bae_40c4_89fb_f43718c3e023.slice/crio-41d73a45bf6d68ee12c0c73137e233b10645ed491a4125c92294696c332785c2.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 13:28:55.886284 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.886121    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"]
Sep 11 13:28:55.893287 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.893260    2547 generic.go:356] "Generic (PLEG): container finished" podID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerID="41d73a45bf6d68ee12c0c73137e233b10645ed491a4125c92294696c332785c2" exitCode=0
Sep 11 13:28:55.893443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.893342    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6" event={"ID":"90c5a799-1bae-40c4-89fb-f43718c3e023","Type":"ContainerDied","Data":"41d73a45bf6d68ee12c0c73137e233b10645ed491a4125c92294696c332785c2"}
Sep 11 13:28:55.893443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.893403    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6" event={"ID":"90c5a799-1bae-40c4-89fb-f43718c3e023","Type":"ContainerStarted","Data":"3953cab43f8f8e99cb27d7f5a0b30397bf521f3bb666138dbab05dc1fcb13773"}
Sep 11 13:28:55.894853 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.894830    2547 generic.go:356] "Generic (PLEG): container finished" podID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerID="e92b2fe6b5be04883fe436e400513f9e06b01c4c028bd0b83a96564741c0bc2e" exitCode=0
Sep 11 13:28:55.894955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.894935    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr" event={"ID":"2deb90c9-d2b6-4c72-9bcb-00ae422888f2","Type":"ContainerDied","Data":"e92b2fe6b5be04883fe436e400513f9e06b01c4c028bd0b83a96564741c0bc2e"}
Sep 11 13:28:55.895013 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.894978    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr" event={"ID":"2deb90c9-d2b6-4c72-9bcb-00ae422888f2","Type":"ContainerStarted","Data":"ce6198618b35d06338b4f391f21d1fc297656092408bbcee2a08c606d5bd60bc"}
Sep 11 13:28:55.896535 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.896511    2547 generic.go:356] "Generic (PLEG): container finished" podID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerID="69a7e7c0930196435697d28489e1cf99ec40ae2f257113f38429b3ffc1c742ee" exitCode=0
Sep 11 13:28:55.896615 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.896596    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs" event={"ID":"125292c5-f499-46ba-b2c8-0e719ba15a98","Type":"ContainerDied","Data":"69a7e7c0930196435697d28489e1cf99ec40ae2f257113f38429b3ffc1c742ee"}
Sep 11 13:28:55.896661 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:55.896632    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs" event={"ID":"125292c5-f499-46ba-b2c8-0e719ba15a98","Type":"ContainerStarted","Data":"96674fdcd046e8f1d416bffca372696e7b6295d83e1363698e6746073d7a5d66"}
Sep 11 13:28:55.923973 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:28:55.923940    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7f49fb_5a6c_45be_a26d_0ebb4c8559b3.slice/crio-8a586e5ad6aff472d940d5a2804dcb1c0a1f8e22e4fa77d70abf0419b5ddf85e WatchSource:0}: Error finding container 8a586e5ad6aff472d940d5a2804dcb1c0a1f8e22e4fa77d70abf0419b5ddf85e: Status 404 returned error can't find the container with id 8a586e5ad6aff472d940d5a2804dcb1c0a1f8e22e4fa77d70abf0419b5ddf85e
Sep 11 13:28:56.905349 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.905315    2547 generic.go:356] "Generic (PLEG): container finished" podID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerID="b727d78146001d3a244b912f2a8772aae63ef808e03894a830908b4b69d5ed6c" exitCode=0
Sep 11 13:28:56.905775 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.905398    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6" event={"ID":"90c5a799-1bae-40c4-89fb-f43718c3e023","Type":"ContainerDied","Data":"b727d78146001d3a244b912f2a8772aae63ef808e03894a830908b4b69d5ed6c"}
Sep 11 13:28:56.907564 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.907538    2547 generic.go:356] "Generic (PLEG): container finished" podID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerID="e61a2a05e0719bea6d8a3638c01c9887814f12bcb14533a8bae50e5d3948cc4b" exitCode=0
Sep 11 13:28:56.907670 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.907620    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr" event={"ID":"2deb90c9-d2b6-4c72-9bcb-00ae422888f2","Type":"ContainerDied","Data":"e61a2a05e0719bea6d8a3638c01c9887814f12bcb14533a8bae50e5d3948cc4b"}
Sep 11 13:28:56.909533 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.909511    2547 generic.go:356] "Generic (PLEG): container finished" podID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerID="d1a7d764ef231b9bfb4a355fff933d6e717912ac5437fe3b6fb8bb28deca8335" exitCode=0
Sep 11 13:28:56.909614 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.909583    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs" event={"ID":"125292c5-f499-46ba-b2c8-0e719ba15a98","Type":"ContainerDied","Data":"d1a7d764ef231b9bfb4a355fff933d6e717912ac5437fe3b6fb8bb28deca8335"}
Sep 11 13:28:56.911590 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.911563    2547 generic.go:356] "Generic (PLEG): container finished" podID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerID="ebc291fe77440067e0569f3c63f9f7e1a2046fafaf0fcc576732cf12585af141" exitCode=0
Sep 11 13:28:56.911699 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.911606    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2" event={"ID":"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3","Type":"ContainerDied","Data":"ebc291fe77440067e0569f3c63f9f7e1a2046fafaf0fcc576732cf12585af141"}
Sep 11 13:28:56.911699 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:56.911640    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2" event={"ID":"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3","Type":"ContainerStarted","Data":"8a586e5ad6aff472d940d5a2804dcb1c0a1f8e22e4fa77d70abf0419b5ddf85e"}
Sep 11 13:28:57.919640 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.919604    2547 generic.go:356] "Generic (PLEG): container finished" podID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerID="46c36d6ebe18dc864ba3e9e82a52ff7807f3192e93893f5340162391f233fc53" exitCode=0
Sep 11 13:28:57.920074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.919668    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6" event={"ID":"90c5a799-1bae-40c4-89fb-f43718c3e023","Type":"ContainerDied","Data":"46c36d6ebe18dc864ba3e9e82a52ff7807f3192e93893f5340162391f233fc53"}
Sep 11 13:28:57.921987 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.921963    2547 generic.go:356] "Generic (PLEG): container finished" podID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerID="154e6b6f09e94ce825c5c2d45f9710a6bf49ee04ea7b8d5f9989bfa70eac08e7" exitCode=0
Sep 11 13:28:57.922133 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.922048    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr" event={"ID":"2deb90c9-d2b6-4c72-9bcb-00ae422888f2","Type":"ContainerDied","Data":"154e6b6f09e94ce825c5c2d45f9710a6bf49ee04ea7b8d5f9989bfa70eac08e7"}
Sep 11 13:28:57.924329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.924302    2547 generic.go:356] "Generic (PLEG): container finished" podID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerID="86d6698192da5336a5119832db6d75e2511323a1f86084e456b0cf1d732c9c5a" exitCode=0
Sep 11 13:28:57.924465 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.924358    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs" event={"ID":"125292c5-f499-46ba-b2c8-0e719ba15a98","Type":"ContainerDied","Data":"86d6698192da5336a5119832db6d75e2511323a1f86084e456b0cf1d732c9c5a"}
Sep 11 13:28:57.926214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.926192    2547 generic.go:356] "Generic (PLEG): container finished" podID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerID="272e9be8efaf42618ecf30b1b4dd166d86309b8508c46ca641bcfc8a5c08fcc7" exitCode=0
Sep 11 13:28:57.926317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:57.926269    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2" event={"ID":"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3","Type":"ContainerDied","Data":"272e9be8efaf42618ecf30b1b4dd166d86309b8508c46ca641bcfc8a5c08fcc7"}
Sep 11 13:28:58.934122 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:58.934083    2547 generic.go:356] "Generic (PLEG): container finished" podID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerID="d4c28a992b2f1e87fb67988c638432a3a8699c477cc7a6c614c42382704ea42c" exitCode=0
Sep 11 13:28:58.934491 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:58.934171    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2" event={"ID":"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3","Type":"ContainerDied","Data":"d4c28a992b2f1e87fb67988c638432a3a8699c477cc7a6c614c42382704ea42c"}
Sep 11 13:28:59.078093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.078064    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:59.105857 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.105823    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-bundle\") pod \"90c5a799-1bae-40c4-89fb-f43718c3e023\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") "
Sep 11 13:28:59.106024 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.105873    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzltp\" (UniqueName: \"kubernetes.io/projected/90c5a799-1bae-40c4-89fb-f43718c3e023-kube-api-access-rzltp\") pod \"90c5a799-1bae-40c4-89fb-f43718c3e023\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") "
Sep 11 13:28:59.106024 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.105961    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-util\") pod \"90c5a799-1bae-40c4-89fb-f43718c3e023\" (UID: \"90c5a799-1bae-40c4-89fb-f43718c3e023\") "
Sep 11 13:28:59.106774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.106727    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-bundle" (OuterVolumeSpecName: "bundle") pod "90c5a799-1bae-40c4-89fb-f43718c3e023" (UID: "90c5a799-1bae-40c4-89fb-f43718c3e023"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:28:59.108732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.108617    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c5a799-1bae-40c4-89fb-f43718c3e023-kube-api-access-rzltp" (OuterVolumeSpecName: "kube-api-access-rzltp") pod "90c5a799-1bae-40c4-89fb-f43718c3e023" (UID: "90c5a799-1bae-40c4-89fb-f43718c3e023"). InnerVolumeSpecName "kube-api-access-rzltp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:28:59.112413 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.112385    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-util" (OuterVolumeSpecName: "util") pod "90c5a799-1bae-40c4-89fb-f43718c3e023" (UID: "90c5a799-1bae-40c4-89fb-f43718c3e023"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:28:59.119622 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.119596    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:59.122743 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.122719    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:59.206726 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.206624    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-bundle\") pod \"125292c5-f499-46ba-b2c8-0e719ba15a98\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") "
Sep 11 13:28:59.206726 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.206666    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-util\") pod \"125292c5-f499-46ba-b2c8-0e719ba15a98\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") "
Sep 11 13:28:59.206726 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.206691    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shvl2\" (UniqueName: \"kubernetes.io/projected/125292c5-f499-46ba-b2c8-0e719ba15a98-kube-api-access-shvl2\") pod \"125292c5-f499-46ba-b2c8-0e719ba15a98\" (UID: \"125292c5-f499-46ba-b2c8-0e719ba15a98\") "
Sep 11 13:28:59.206726 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.206708    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-util\") pod \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") "
Sep 11 13:28:59.206726 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.206723    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82v8d\" (UniqueName: \"kubernetes.io/projected/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-kube-api-access-82v8d\") pod \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") "
Sep 11 13:28:59.207130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.206792    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-bundle\") pod \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\" (UID: \"2deb90c9-d2b6-4c72-9bcb-00ae422888f2\") "
Sep 11 13:28:59.207130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.207094    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.207130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.207114    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzltp\" (UniqueName: \"kubernetes.io/projected/90c5a799-1bae-40c4-89fb-f43718c3e023-kube-api-access-rzltp\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.207130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.207129    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90c5a799-1bae-40c4-89fb-f43718c3e023-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.207378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.207338    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-bundle" (OuterVolumeSpecName: "bundle") pod "2deb90c9-d2b6-4c72-9bcb-00ae422888f2" (UID: "2deb90c9-d2b6-4c72-9bcb-00ae422888f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:28:59.207513 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.207379    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-bundle" (OuterVolumeSpecName: "bundle") pod "125292c5-f499-46ba-b2c8-0e719ba15a98" (UID: "125292c5-f499-46ba-b2c8-0e719ba15a98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:28:59.209447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.209419    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-kube-api-access-82v8d" (OuterVolumeSpecName: "kube-api-access-82v8d") pod "2deb90c9-d2b6-4c72-9bcb-00ae422888f2" (UID: "2deb90c9-d2b6-4c72-9bcb-00ae422888f2"). InnerVolumeSpecName "kube-api-access-82v8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:28:59.209447 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.209435    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125292c5-f499-46ba-b2c8-0e719ba15a98-kube-api-access-shvl2" (OuterVolumeSpecName: "kube-api-access-shvl2") pod "125292c5-f499-46ba-b2c8-0e719ba15a98" (UID: "125292c5-f499-46ba-b2c8-0e719ba15a98"). InnerVolumeSpecName "kube-api-access-shvl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:28:59.211844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.211815    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-util" (OuterVolumeSpecName: "util") pod "2deb90c9-d2b6-4c72-9bcb-00ae422888f2" (UID: "2deb90c9-d2b6-4c72-9bcb-00ae422888f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:28:59.212598 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.212577    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-util" (OuterVolumeSpecName: "util") pod "125292c5-f499-46ba-b2c8-0e719ba15a98" (UID: "125292c5-f499-46ba-b2c8-0e719ba15a98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:28:59.308487 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.308447    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.308487 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.308480    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125292c5-f499-46ba-b2c8-0e719ba15a98-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.308487 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.308490    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shvl2\" (UniqueName: \"kubernetes.io/projected/125292c5-f499-46ba-b2c8-0e719ba15a98-kube-api-access-shvl2\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.308712 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.308501    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.308712 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.308509    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82v8d\" (UniqueName: \"kubernetes.io/projected/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-kube-api-access-82v8d\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.308712 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.308517    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2deb90c9-d2b6-4c72-9bcb-00ae422888f2-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:28:59.941224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.941191    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6"
Sep 11 13:28:59.941650 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.941199    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gnpg6" event={"ID":"90c5a799-1bae-40c4-89fb-f43718c3e023","Type":"ContainerDied","Data":"3953cab43f8f8e99cb27d7f5a0b30397bf521f3bb666138dbab05dc1fcb13773"}
Sep 11 13:28:59.941650 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.941321    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3953cab43f8f8e99cb27d7f5a0b30397bf521f3bb666138dbab05dc1fcb13773"
Sep 11 13:28:59.943335 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.943315    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr"
Sep 11 13:28:59.943335 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.943323    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c655zzr" event={"ID":"2deb90c9-d2b6-4c72-9bcb-00ae422888f2","Type":"ContainerDied","Data":"ce6198618b35d06338b4f391f21d1fc297656092408bbcee2a08c606d5bd60bc"}
Sep 11 13:28:59.943526 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.943363    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce6198618b35d06338b4f391f21d1fc297656092408bbcee2a08c606d5bd60bc"
Sep 11 13:28:59.945495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.945473    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs"
Sep 11 13:28:59.945613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.945492    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg5lbs" event={"ID":"125292c5-f499-46ba-b2c8-0e719ba15a98","Type":"ContainerDied","Data":"96674fdcd046e8f1d416bffca372696e7b6295d83e1363698e6746073d7a5d66"}
Sep 11 13:28:59.945613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:28:59.945532    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96674fdcd046e8f1d416bffca372696e7b6295d83e1363698e6746073d7a5d66"
Sep 11 13:29:00.090550 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.090522    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:29:00.116113 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.116083    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z47v7\" (UniqueName: \"kubernetes.io/projected/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-kube-api-access-z47v7\") pod \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") "
Sep 11 13:29:00.116289 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.116129    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-bundle\") pod \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") "
Sep 11 13:29:00.116289 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.116202    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-util\") pod \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\" (UID: \"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3\") "
Sep 11 13:29:00.116961 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.116901    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-bundle" (OuterVolumeSpecName: "bundle") pod "7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" (UID: "7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:29:00.118642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.118617    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-kube-api-access-z47v7" (OuterVolumeSpecName: "kube-api-access-z47v7") pod "7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" (UID: "7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3"). InnerVolumeSpecName "kube-api-access-z47v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:29:00.122049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.122020    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-util" (OuterVolumeSpecName: "util") pod "7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" (UID: "7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:29:00.217369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.217281    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:29:00.217369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.217312    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z47v7\" (UniqueName: \"kubernetes.io/projected/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-kube-api-access-z47v7\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:29:00.217369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.217323    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:29:00.952303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.952277    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2"
Sep 11 13:29:00.952664 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.952313    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afdkn2" event={"ID":"7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3","Type":"ContainerDied","Data":"8a586e5ad6aff472d940d5a2804dcb1c0a1f8e22e4fa77d70abf0419b5ddf85e"}
Sep 11 13:29:00.952664 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:00.952356    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a586e5ad6aff472d940d5a2804dcb1c0a1f8e22e4fa77d70abf0419b5ddf85e"
Sep 11 13:29:22.650723 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.650681    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"]
Sep 11 13:29:22.651209 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651175    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="util"
Sep 11 13:29:22.651209 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651193    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="util"
Sep 11 13:29:22.651209 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651203    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651211    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651228    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="util"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651237    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="util"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651248    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="util"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651256    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="util"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651268    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="extract"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651277    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="extract"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651289    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="extract"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651298    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="extract"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651307    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="extract"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651316    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="extract"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651331    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651339    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651362    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651370    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651379    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651387    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="pull"
Sep 11 13:29:22.651390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651398    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="util"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651406    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="util"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651415    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="extract"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651423    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="extract"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651516    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2deb90c9-d2b6-4c72-9bcb-00ae422888f2" containerName="extract"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651529    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c5a799-1bae-40c4-89fb-f43718c3e023" containerName="extract"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651539    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="125292c5-f499-46ba-b2c8-0e719ba15a98" containerName="extract"
Sep 11 13:29:22.652187 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.651550    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a7f49fb-5a6c-45be-a26d-0ebb4c8559b3" containerName="extract"
Sep 11 13:29:22.654850 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.654825    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.659194 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.659167    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 13:29:22.659343 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.659211    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 13:29:22.660310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.660288    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 13:29:22.660310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.660313    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5b74\""
Sep 11 13:29:22.660488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.660318    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 13:29:22.664951 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.664924    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"]
Sep 11 13:29:22.818346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.818310    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.818514 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.818372    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v4ft\" (UniqueName: \"kubernetes.io/projected/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-kube-api-access-9v4ft\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.818514 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.818482    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.919961 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.919838    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v4ft\" (UniqueName: \"kubernetes.io/projected/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-kube-api-access-9v4ft\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.919961 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.919903    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.920192 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.919970    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.920617 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.920597    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.922566 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.922534    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.933551 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.933517    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v4ft\" (UniqueName: \"kubernetes.io/projected/ac6d02f8-93fc-4a8e-a369-31b609d6fb47-kube-api-access-9v4ft\") pod \"kuadrant-console-plugin-fbdd4f445-dpk7l\" (UID: \"ac6d02f8-93fc-4a8e-a369-31b609d6fb47\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:22.964936 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:22.964865    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"
Sep 11 13:29:23.260926 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:23.260881    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l"]
Sep 11 13:29:23.263096 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:29:23.263052    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac6d02f8_93fc_4a8e_a369_31b609d6fb47.slice/crio-b27cda51b4c1ac25f01c6dc0fc25259b3b6b384e8cd7c9bca0165a135088ecde WatchSource:0}: Error finding container b27cda51b4c1ac25f01c6dc0fc25259b3b6b384e8cd7c9bca0165a135088ecde: Status 404 returned error can't find the container with id b27cda51b4c1ac25f01c6dc0fc25259b3b6b384e8cd7c9bca0165a135088ecde
Sep 11 13:29:24.073613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:24.073575    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l" event={"ID":"ac6d02f8-93fc-4a8e-a369-31b609d6fb47","Type":"ContainerStarted","Data":"b27cda51b4c1ac25f01c6dc0fc25259b3b6b384e8cd7c9bca0165a135088ecde"}
Sep 11 13:29:28.099699 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:28.099658    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l" event={"ID":"ac6d02f8-93fc-4a8e-a369-31b609d6fb47","Type":"ContainerStarted","Data":"d9d623e82507c8d320a8ec48f4545a11f2ff3d3f4dc1888e5d7e20e5e86fe892"}
Sep 11 13:29:28.119173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:28.119117    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dpk7l" podStartSLOduration=1.409057055 podStartE2EDuration="6.119098427s" totalImagesPullingTime="4.710041372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:29:28.117270042 +0000 UTC m=+584.329813853" watchObservedRunningTime="2026-09-11 13:29:28.119098427 +0000 UTC m=+584.331642227"
Sep 11 13:29:44.170037 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:44.170006    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:29:44.170454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:29:44.170006    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:30:13.058932 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.058838    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:30:13.062078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.062060    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.064642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.064610    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 13:30:13.072613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.072585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:30:13.116938 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.116894    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:30:13.155040 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.154996    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds4tc\" (UniqueName: \"kubernetes.io/projected/1f3de2b8-71b0-4b80-b966-5283a123a4e3-kube-api-access-ds4tc\") pod \"limitador-limitador-84994f7ffc-nfw5h\" (UID: \"1f3de2b8-71b0-4b80-b966-5283a123a4e3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.155221 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.155062    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f3de2b8-71b0-4b80-b966-5283a123a4e3-config-file\") pod \"limitador-limitador-84994f7ffc-nfw5h\" (UID: \"1f3de2b8-71b0-4b80-b966-5283a123a4e3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.255861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.255820    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f3de2b8-71b0-4b80-b966-5283a123a4e3-config-file\") pod \"limitador-limitador-84994f7ffc-nfw5h\" (UID: \"1f3de2b8-71b0-4b80-b966-5283a123a4e3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.256054 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.255892    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds4tc\" (UniqueName: \"kubernetes.io/projected/1f3de2b8-71b0-4b80-b966-5283a123a4e3-kube-api-access-ds4tc\") pod \"limitador-limitador-84994f7ffc-nfw5h\" (UID: \"1f3de2b8-71b0-4b80-b966-5283a123a4e3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.256529 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.256505    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f3de2b8-71b0-4b80-b966-5283a123a4e3-config-file\") pod \"limitador-limitador-84994f7ffc-nfw5h\" (UID: \"1f3de2b8-71b0-4b80-b966-5283a123a4e3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.269096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.269060    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds4tc\" (UniqueName: \"kubernetes.io/projected/1f3de2b8-71b0-4b80-b966-5283a123a4e3-kube-api-access-ds4tc\") pod \"limitador-limitador-84994f7ffc-nfw5h\" (UID: \"1f3de2b8-71b0-4b80-b966-5283a123a4e3\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.373164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.373123    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:13.650972 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.650940    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:30:13.653148 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:30:13.653106    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3de2b8_71b0_4b80_b966_5283a123a4e3.slice/crio-e583867338e4d285b64f200cf0ea655a4305b6ebc4a915af82ded347197b6575 WatchSource:0}: Error finding container e583867338e4d285b64f200cf0ea655a4305b6ebc4a915af82ded347197b6575: Status 404 returned error can't find the container with id e583867338e4d285b64f200cf0ea655a4305b6ebc4a915af82ded347197b6575
Sep 11 13:30:13.714679 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.714637    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-x5qt8"]
Sep 11 13:30:13.719194 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.719171    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:13.721832 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.721811    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l8kvx\""
Sep 11 13:30:13.725517 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.725487    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-x5qt8"]
Sep 11 13:30:13.861294 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.861255    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfcjm\" (UniqueName: \"kubernetes.io/projected/71319c27-7337-44a1-9575-77ad8ed195a9-kube-api-access-rfcjm\") pod \"authorino-59c974bd48-x5qt8\" (UID: \"71319c27-7337-44a1-9575-77ad8ed195a9\") " pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:13.962019 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.961886    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfcjm\" (UniqueName: \"kubernetes.io/projected/71319c27-7337-44a1-9575-77ad8ed195a9-kube-api-access-rfcjm\") pod \"authorino-59c974bd48-x5qt8\" (UID: \"71319c27-7337-44a1-9575-77ad8ed195a9\") " pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:13.971166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:13.971135    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfcjm\" (UniqueName: \"kubernetes.io/projected/71319c27-7337-44a1-9575-77ad8ed195a9-kube-api-access-rfcjm\") pod \"authorino-59c974bd48-x5qt8\" (UID: \"71319c27-7337-44a1-9575-77ad8ed195a9\") " pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:14.029743 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:14.029708    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:14.302998 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:14.302898    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-x5qt8"]
Sep 11 13:30:14.305866 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:30:14.305827    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71319c27_7337_44a1_9575_77ad8ed195a9.slice/crio-45511c408efbd3ed90520aeda31a8443d3037263c52e7010ede308c2a38b6750 WatchSource:0}: Error finding container 45511c408efbd3ed90520aeda31a8443d3037263c52e7010ede308c2a38b6750: Status 404 returned error can't find the container with id 45511c408efbd3ed90520aeda31a8443d3037263c52e7010ede308c2a38b6750
Sep 11 13:30:14.342050 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:14.342013    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h" event={"ID":"1f3de2b8-71b0-4b80-b966-5283a123a4e3","Type":"ContainerStarted","Data":"e583867338e4d285b64f200cf0ea655a4305b6ebc4a915af82ded347197b6575"}
Sep 11 13:30:14.343303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:14.343279    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-x5qt8" event={"ID":"71319c27-7337-44a1-9575-77ad8ed195a9","Type":"ContainerStarted","Data":"45511c408efbd3ed90520aeda31a8443d3037263c52e7010ede308c2a38b6750"}
Sep 11 13:30:17.363890 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:17.363846    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-x5qt8" event={"ID":"71319c27-7337-44a1-9575-77ad8ed195a9","Type":"ContainerStarted","Data":"fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f"}
Sep 11 13:30:17.365498 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:17.365464    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h" event={"ID":"1f3de2b8-71b0-4b80-b966-5283a123a4e3","Type":"ContainerStarted","Data":"884158a1cb4577f311b8b0f3f6895611207c9e2c665c356e0eedab904920a727"}
Sep 11 13:30:17.365620 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:17.365604    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:17.390891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:17.390834    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-x5qt8" podStartSLOduration=1.947324991 podStartE2EDuration="4.390816215s" totalImagesPullingTime="2.443491224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:17.382347639 +0000 UTC m=+633.594891440" watchObservedRunningTime="2026-09-11 13:30:17.390816215 +0000 UTC m=+633.603360016"
Sep 11 13:30:17.406031 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:17.405977    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h" podStartSLOduration=1.31646413 podStartE2EDuration="4.405959552s" totalImagesPullingTime="3.089495422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:17.403956384 +0000 UTC m=+633.616500184" watchObservedRunningTime="2026-09-11 13:30:17.405959552 +0000 UTC m=+633.618503353"
Sep 11 13:30:28.372484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:28.372453    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"
Sep 11 13:30:49.366316 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.366270    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-kg8sl"]
Sep 11 13:30:49.372305 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.372273    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:49.380828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.380804    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-kg8sl"]
Sep 11 13:30:49.421719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.421683    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kg8sl"]
Sep 11 13:30:49.422012 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:30:49.421992    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-72dg4], unattached volumes=[], failed to process volumes=[kube-api-access-72dg4]: context canceled" pod="kuadrant-system/authorino-557f876f69-kg8sl" podUID="e524e30a-64cb-4d0f-9bc8-662dada25e84"
Sep 11 13:30:49.469061 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.469022    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8ddcw"]
Sep 11 13:30:49.474973 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.474907    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/e524e30a-64cb-4d0f-9bc8-662dada25e84-kube-api-access-72dg4\") pod \"authorino-557f876f69-kg8sl\" (UID: \"e524e30a-64cb-4d0f-9bc8-662dada25e84\") " pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:49.484601 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.484563    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8ddcw"]
Sep 11 13:30:49.484786 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.484678    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.487660 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.487632    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 13:30:49.541349 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.541311    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:49.556884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.556850    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:49.575717 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.575666    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/e524e30a-64cb-4d0f-9bc8-662dada25e84-kube-api-access-72dg4\") pod \"authorino-557f876f69-kg8sl\" (UID: \"e524e30a-64cb-4d0f-9bc8-662dada25e84\") " pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:49.575964 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.575772    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-kube-api-access-znmhq\") pod \"authorino-6d4dfc649f-8ddcw\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") " pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.575964 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.575804    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-tls-cert\") pod \"authorino-6d4dfc649f-8ddcw\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") " pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.585221 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.585194    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/e524e30a-64cb-4d0f-9bc8-662dada25e84-kube-api-access-72dg4\") pod \"authorino-557f876f69-kg8sl\" (UID: \"e524e30a-64cb-4d0f-9bc8-662dada25e84\") " pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:49.618013 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.617903    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8ddcw"]
Sep 11 13:30:49.618630 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:30:49.618593    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-znmhq tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-8ddcw" podUID="447d4cc5-bab7-433a-aaf6-f54aa2edf5c8"
Sep 11 13:30:49.645511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.645471    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86d4c8cd9f-8mdd7"]
Sep 11 13:30:49.650052 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.650026    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.656825 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.656759    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d4c8cd9f-8mdd7"]
Sep 11 13:30:49.676575 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.676532    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/e524e30a-64cb-4d0f-9bc8-662dada25e84-kube-api-access-72dg4\") pod \"e524e30a-64cb-4d0f-9bc8-662dada25e84\" (UID: \"e524e30a-64cb-4d0f-9bc8-662dada25e84\") "
Sep 11 13:30:49.676779 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.676705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-kube-api-access-znmhq\") pod \"authorino-6d4dfc649f-8ddcw\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") " pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.676779 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.676754    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-tls-cert\") pod \"authorino-6d4dfc649f-8ddcw\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") " pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.676943 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.676806    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f92d4a32-0df0-43f6-82df-ae8e55a37619-tls-cert\") pod \"authorino-86d4c8cd9f-8mdd7\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") " pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.676943 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.676845    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgn2h\" (UniqueName: \"kubernetes.io/projected/f92d4a32-0df0-43f6-82df-ae8e55a37619-kube-api-access-bgn2h\") pod \"authorino-86d4c8cd9f-8mdd7\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") " pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.678943 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.678888    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e524e30a-64cb-4d0f-9bc8-662dada25e84-kube-api-access-72dg4" (OuterVolumeSpecName: "kube-api-access-72dg4") pod "e524e30a-64cb-4d0f-9bc8-662dada25e84" (UID: "e524e30a-64cb-4d0f-9bc8-662dada25e84"). InnerVolumeSpecName "kube-api-access-72dg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:49.679340 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.679308    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-tls-cert\") pod \"authorino-6d4dfc649f-8ddcw\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") " pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.685684 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.685658    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-kube-api-access-znmhq\") pod \"authorino-6d4dfc649f-8ddcw\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") " pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:49.777653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.777593    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f92d4a32-0df0-43f6-82df-ae8e55a37619-tls-cert\") pod \"authorino-86d4c8cd9f-8mdd7\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") " pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.777653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.777662    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgn2h\" (UniqueName: \"kubernetes.io/projected/f92d4a32-0df0-43f6-82df-ae8e55a37619-kube-api-access-bgn2h\") pod \"authorino-86d4c8cd9f-8mdd7\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") " pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.777957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.777746    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/e524e30a-64cb-4d0f-9bc8-662dada25e84-kube-api-access-72dg4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:30:49.780516 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.780482    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f92d4a32-0df0-43f6-82df-ae8e55a37619-tls-cert\") pod \"authorino-86d4c8cd9f-8mdd7\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") " pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.787020 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.786992    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgn2h\" (UniqueName: \"kubernetes.io/projected/f92d4a32-0df0-43f6-82df-ae8e55a37619-kube-api-access-bgn2h\") pod \"authorino-86d4c8cd9f-8mdd7\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") " pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:49.961157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:49.961114    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:30:50.277120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.277004    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d4c8cd9f-8mdd7"]
Sep 11 13:30:50.279312 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:30:50.279285    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf92d4a32_0df0_43f6_82df_ae8e55a37619.slice/crio-c240906b9eb50024aed17f485c8b132e1dff1674dd82d9a88c368368e3c6a7c7 WatchSource:0}: Error finding container c240906b9eb50024aed17f485c8b132e1dff1674dd82d9a88c368368e3c6a7c7: Status 404 returned error can't find the container with id c240906b9eb50024aed17f485c8b132e1dff1674dd82d9a88c368368e3c6a7c7
Sep 11 13:30:50.547555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.547451    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7" event={"ID":"f92d4a32-0df0-43f6-82df-ae8e55a37619","Type":"ContainerStarted","Data":"c240906b9eb50024aed17f485c8b132e1dff1674dd82d9a88c368368e3c6a7c7"}
Sep 11 13:30:50.547555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.547545    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:50.547555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.547550    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-kg8sl"
Sep 11 13:30:50.554651 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.554628    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:50.586303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.586269    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-kube-api-access-znmhq\") pod \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") "
Sep 11 13:30:50.586466 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.586319    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-tls-cert\") pod \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\" (UID: \"447d4cc5-bab7-433a-aaf6-f54aa2edf5c8\") "
Sep 11 13:30:50.588750 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.588719    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "447d4cc5-bab7-433a-aaf6-f54aa2edf5c8" (UID: "447d4cc5-bab7-433a-aaf6-f54aa2edf5c8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:30:50.588885 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.588802    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-kube-api-access-znmhq" (OuterVolumeSpecName: "kube-api-access-znmhq") pod "447d4cc5-bab7-433a-aaf6-f54aa2edf5c8" (UID: "447d4cc5-bab7-433a-aaf6-f54aa2edf5c8"). InnerVolumeSpecName "kube-api-access-znmhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:50.590701 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.590677    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-kg8sl"]
Sep 11 13:30:50.594460 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.594429    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-kg8sl"]
Sep 11 13:30:50.687392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.687357    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-kube-api-access-znmhq\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:30:50.687392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:50.687388    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8-tls-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:30:51.555354 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.555319    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7" event={"ID":"f92d4a32-0df0-43f6-82df-ae8e55a37619","Type":"ContainerStarted","Data":"0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41"}
Sep 11 13:30:51.555736 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.555412    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-8ddcw"
Sep 11 13:30:51.574577 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.574516    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7" podStartSLOduration=1.916786354 podStartE2EDuration="2.574499208s" totalImagesPullingTime="657.712854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:51.57229255 +0000 UTC m=+667.784836352" watchObservedRunningTime="2026-09-11 13:30:51.574499208 +0000 UTC m=+667.787043059"
Sep 11 13:30:51.602576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.602538    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8ddcw"]
Sep 11 13:30:51.608529 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.608494    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-8ddcw"]
Sep 11 13:30:51.612585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.612554    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-x5qt8"]
Sep 11 13:30:51.612771 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.612747    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-x5qt8" podUID="71319c27-7337-44a1-9575-77ad8ed195a9" containerName="authorino" containerID="cri-o://fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f" gracePeriod=30
Sep 11 13:30:51.862217 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.862191    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:51.899392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.899356    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfcjm\" (UniqueName: \"kubernetes.io/projected/71319c27-7337-44a1-9575-77ad8ed195a9-kube-api-access-rfcjm\") pod \"71319c27-7337-44a1-9575-77ad8ed195a9\" (UID: \"71319c27-7337-44a1-9575-77ad8ed195a9\") "
Sep 11 13:30:51.901618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:51.901588    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71319c27-7337-44a1-9575-77ad8ed195a9-kube-api-access-rfcjm" (OuterVolumeSpecName: "kube-api-access-rfcjm") pod "71319c27-7337-44a1-9575-77ad8ed195a9" (UID: "71319c27-7337-44a1-9575-77ad8ed195a9"). InnerVolumeSpecName "kube-api-access-rfcjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:52.000313 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.000257    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfcjm\" (UniqueName: \"kubernetes.io/projected/71319c27-7337-44a1-9575-77ad8ed195a9-kube-api-access-rfcjm\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:30:52.249682 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.249647    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447d4cc5-bab7-433a-aaf6-f54aa2edf5c8" path="/var/lib/kubelet/pods/447d4cc5-bab7-433a-aaf6-f54aa2edf5c8/volumes"
Sep 11 13:30:52.249903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.249890    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e524e30a-64cb-4d0f-9bc8-662dada25e84" path="/var/lib/kubelet/pods/e524e30a-64cb-4d0f-9bc8-662dada25e84/volumes"
Sep 11 13:30:52.562320 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.562228    2547 generic.go:356] "Generic (PLEG): container finished" podID="71319c27-7337-44a1-9575-77ad8ed195a9" containerID="fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f" exitCode=0
Sep 11 13:30:52.562320 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.562276    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-x5qt8"
Sep 11 13:30:52.562762 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.562323    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-x5qt8" event={"ID":"71319c27-7337-44a1-9575-77ad8ed195a9","Type":"ContainerDied","Data":"fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f"}
Sep 11 13:30:52.562762 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.562369    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-x5qt8" event={"ID":"71319c27-7337-44a1-9575-77ad8ed195a9","Type":"ContainerDied","Data":"45511c408efbd3ed90520aeda31a8443d3037263c52e7010ede308c2a38b6750"}
Sep 11 13:30:52.562762 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.562390    2547 scope.go:117] "RemoveContainer" containerID="fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f"
Sep 11 13:30:52.571812 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.571789    2547 scope.go:117] "RemoveContainer" containerID="fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f"
Sep 11 13:30:52.572187 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:30:52.572164    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f\": container with ID starting with fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f not found: ID does not exist" containerID="fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f"
Sep 11 13:30:52.572249 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.572197    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f"} err="failed to get container status \"fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f\": rpc error: code = NotFound desc = could not find container \"fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f\": container with ID starting with fbeb0c33640b0587454e0959dee9216f36c498ef8d277416c75b4b1904861d8f not found: ID does not exist"
Sep 11 13:30:52.590029 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.589994    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-x5qt8"]
Sep 11 13:30:52.592147 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:52.592123    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-x5qt8"]
Sep 11 13:30:54.251007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:30:54.250964    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71319c27-7337-44a1-9575-77ad8ed195a9" path="/var/lib/kubelet/pods/71319c27-7337-44a1-9575-77ad8ed195a9/volumes"
Sep 11 13:31:34.877205 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:31:34.877164    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:31:58.387002 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:31:58.386970    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:32:05.527308 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:32:05.527269    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:32:28.207351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:32:28.207308    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:32:36.905719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:32:36.905664    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:32:43.602608 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:32:43.602570    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:32:54.996240 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:32:54.996202    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:33:04.151328 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.151292    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"]
Sep 11 13:33:04.151820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.151641    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71319c27-7337-44a1-9575-77ad8ed195a9" containerName="authorino"
Sep 11 13:33:04.151820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.151652    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="71319c27-7337-44a1-9575-77ad8ed195a9" containerName="authorino"
Sep 11 13:33:04.151820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.151742    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="71319c27-7337-44a1-9575-77ad8ed195a9" containerName="authorino"
Sep 11 13:33:04.154841 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.154821    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.159989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.159953    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zv5p8\""
Sep 11 13:33:04.159989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.159974    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 11 13:33:04.160198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.160006    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:33:04.160365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.160345    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:33:04.169706 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.169673    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"]
Sep 11 13:33:04.258284 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.258245    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.258284 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.258284    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.258534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.258317    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.258534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.258428    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.258534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.258473    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b66f92-8c74-4640-9187-561d19392e55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.258534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.258503    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqgj\" (UniqueName: \"kubernetes.io/projected/47b66f92-8c74-4640-9187-561d19392e55-kube-api-access-kbqgj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359384 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359341    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359602 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359516    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b66f92-8c74-4640-9187-561d19392e55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359602 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359563    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqgj\" (UniqueName: \"kubernetes.io/projected/47b66f92-8c74-4640-9187-561d19392e55-kube-api-access-kbqgj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359614    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359641    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359899 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359771    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.359996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.359969    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.360238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.360217    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.362038 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.362016    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47b66f92-8c74-4640-9187-561d19392e55-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.362157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.362138    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b66f92-8c74-4640-9187-561d19392e55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.369189 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.369158    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqgj\" (UniqueName: \"kubernetes.io/projected/47b66f92-8c74-4640-9187-561d19392e55-kube-api-access-kbqgj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-f9msx\" (UID: \"47b66f92-8c74-4640-9187-561d19392e55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.464833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.464595    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:04.741951 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.741922    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"]
Sep 11 13:33:04.743769 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:33:04.743737    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47b66f92_8c74_4640_9187_561d19392e55.slice/crio-c62c2b08acb0a49536eef06b36120db6ea3a800aed431a6e4a865f362429db26 WatchSource:0}: Error finding container c62c2b08acb0a49536eef06b36120db6ea3a800aed431a6e4a865f362429db26: Status 404 returned error can't find the container with id c62c2b08acb0a49536eef06b36120db6ea3a800aed431a6e4a865f362429db26
Sep 11 13:33:04.745201 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:04.745175    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:33:05.287789 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:05.287751    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx" event={"ID":"47b66f92-8c74-4640-9187-561d19392e55","Type":"ContainerStarted","Data":"c62c2b08acb0a49536eef06b36120db6ea3a800aed431a6e4a865f362429db26"}
Sep 11 13:33:06.302505 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:06.302455    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx" event={"ID":"47b66f92-8c74-4640-9187-561d19392e55","Type":"ContainerStarted","Data":"80df64f940732d8c4d99b0f05017e806406779296b28a465386a38259ac9cc45"}
Sep 11 13:33:06.314054 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:06.314009    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:33:06.324348 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:06.324289    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx" podStartSLOduration=1.297227206 podStartE2EDuration="2.324271305s" totalImagesPullingTime="1.027044099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:33:06.323602216 +0000 UTC m=+802.536146018" watchObservedRunningTime="2026-09-11 13:33:06.324271305 +0000 UTC m=+802.536815141"
Sep 11 13:33:14.465534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:14.465484    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:14.466056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:14.465548    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:14.477964 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:14.477938    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:33:15.364949 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:33:15.364904    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-f9msx"
Sep 11 13:34:30.723561 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.723522    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b5f4b7586-hggt7"]
Sep 11 13:34:30.726885 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.726859    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:30.738308 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.738274    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b5f4b7586-hggt7"]
Sep 11 13:34:30.824587 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.824548    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwgtl\" (UniqueName: \"kubernetes.io/projected/6da816e6-f801-46ca-8507-83ceaea29dc1-kube-api-access-kwgtl\") pod \"authorino-6b5f4b7586-hggt7\" (UID: \"6da816e6-f801-46ca-8507-83ceaea29dc1\") " pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:30.824761 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.824625    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6da816e6-f801-46ca-8507-83ceaea29dc1-tls-cert\") pod \"authorino-6b5f4b7586-hggt7\" (UID: \"6da816e6-f801-46ca-8507-83ceaea29dc1\") " pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:30.925723 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.925682    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwgtl\" (UniqueName: \"kubernetes.io/projected/6da816e6-f801-46ca-8507-83ceaea29dc1-kube-api-access-kwgtl\") pod \"authorino-6b5f4b7586-hggt7\" (UID: \"6da816e6-f801-46ca-8507-83ceaea29dc1\") " pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:30.925973 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.925768    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6da816e6-f801-46ca-8507-83ceaea29dc1-tls-cert\") pod \"authorino-6b5f4b7586-hggt7\" (UID: \"6da816e6-f801-46ca-8507-83ceaea29dc1\") " pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:30.928230 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.928204    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6da816e6-f801-46ca-8507-83ceaea29dc1-tls-cert\") pod \"authorino-6b5f4b7586-hggt7\" (UID: \"6da816e6-f801-46ca-8507-83ceaea29dc1\") " pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:30.935660 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:30.935632    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwgtl\" (UniqueName: \"kubernetes.io/projected/6da816e6-f801-46ca-8507-83ceaea29dc1-kube-api-access-kwgtl\") pod \"authorino-6b5f4b7586-hggt7\" (UID: \"6da816e6-f801-46ca-8507-83ceaea29dc1\") " pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:31.060376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:31.060274    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b5f4b7586-hggt7"
Sep 11 13:34:31.336837 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:31.336810    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b5f4b7586-hggt7"]
Sep 11 13:34:31.339704 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:34:31.339677    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6da816e6_f801_46ca_8507_83ceaea29dc1.slice/crio-92e77c0fddc3f60f7232bafe6151a65a2d43552009109c6c62aababd34354d86 WatchSource:0}: Error finding container 92e77c0fddc3f60f7232bafe6151a65a2d43552009109c6c62aababd34354d86: Status 404 returned error can't find the container with id 92e77c0fddc3f60f7232bafe6151a65a2d43552009109c6c62aababd34354d86
Sep 11 13:34:31.786049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:31.786016    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b5f4b7586-hggt7" event={"ID":"6da816e6-f801-46ca-8507-83ceaea29dc1","Type":"ContainerStarted","Data":"92e77c0fddc3f60f7232bafe6151a65a2d43552009109c6c62aababd34354d86"}
Sep 11 13:34:32.796489 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:32.796448    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b5f4b7586-hggt7" event={"ID":"6da816e6-f801-46ca-8507-83ceaea29dc1","Type":"ContainerStarted","Data":"4b0801f67c6bf10c22ec6a535fb4464197f5a5f715e481758fc0b807a07635da"}
Sep 11 13:34:33.086979 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.086837    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b5f4b7586-hggt7" podStartSLOduration=2.147613068 podStartE2EDuration="3.086810326s" totalImagesPullingTime="939.197258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:34:32.899196596 +0000 UTC m=+889.111740397" watchObservedRunningTime="2026-09-11 13:34:33.086810326 +0000 UTC m=+889.299354130"
Sep 11 13:34:33.090239 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.090198    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86d4c8cd9f-8mdd7"]
Sep 11 13:34:33.090420 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.090395    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7" podUID="f92d4a32-0df0-43f6-82df-ae8e55a37619" containerName="authorino" containerID="cri-o://0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41" gracePeriod=30
Sep 11 13:34:33.353142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.353059    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:34:33.453859 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.453782    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f92d4a32-0df0-43f6-82df-ae8e55a37619-tls-cert\") pod \"f92d4a32-0df0-43f6-82df-ae8e55a37619\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") "
Sep 11 13:34:33.453859 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.453859    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgn2h\" (UniqueName: \"kubernetes.io/projected/f92d4a32-0df0-43f6-82df-ae8e55a37619-kube-api-access-bgn2h\") pod \"f92d4a32-0df0-43f6-82df-ae8e55a37619\" (UID: \"f92d4a32-0df0-43f6-82df-ae8e55a37619\") "
Sep 11 13:34:33.458328 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.458265    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92d4a32-0df0-43f6-82df-ae8e55a37619-kube-api-access-bgn2h" (OuterVolumeSpecName: "kube-api-access-bgn2h") pod "f92d4a32-0df0-43f6-82df-ae8e55a37619" (UID: "f92d4a32-0df0-43f6-82df-ae8e55a37619"). InnerVolumeSpecName "kube-api-access-bgn2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:34:33.472488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.472450    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92d4a32-0df0-43f6-82df-ae8e55a37619-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f92d4a32-0df0-43f6-82df-ae8e55a37619" (UID: "f92d4a32-0df0-43f6-82df-ae8e55a37619"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:34:33.555561 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.555516    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f92d4a32-0df0-43f6-82df-ae8e55a37619-tls-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:34:33.555561 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.555560    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgn2h\" (UniqueName: \"kubernetes.io/projected/f92d4a32-0df0-43f6-82df-ae8e55a37619-kube-api-access-bgn2h\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:34:33.803654 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.803616    2547 generic.go:356] "Generic (PLEG): container finished" podID="f92d4a32-0df0-43f6-82df-ae8e55a37619" containerID="0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41" exitCode=0
Sep 11 13:34:33.804123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.803659    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7"
Sep 11 13:34:33.804123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.803699    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7" event={"ID":"f92d4a32-0df0-43f6-82df-ae8e55a37619","Type":"ContainerDied","Data":"0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41"}
Sep 11 13:34:33.804123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.803742    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d4c8cd9f-8mdd7" event={"ID":"f92d4a32-0df0-43f6-82df-ae8e55a37619","Type":"ContainerDied","Data":"c240906b9eb50024aed17f485c8b132e1dff1674dd82d9a88c368368e3c6a7c7"}
Sep 11 13:34:33.804123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.803764    2547 scope.go:117] "RemoveContainer" containerID="0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41"
Sep 11 13:34:33.816360 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.816197    2547 scope.go:117] "RemoveContainer" containerID="0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41"
Sep 11 13:34:33.817098 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:34:33.817075    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41\": container with ID starting with 0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41 not found: ID does not exist" containerID="0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41"
Sep 11 13:34:33.817211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.817104    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41"} err="failed to get container status \"0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41\": rpc error: code = NotFound desc = could not find container \"0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41\": container with ID starting with 0f16fc2d395a8d5a5863563e0a740135502000788bb45f606e3416ea40d1fc41 not found: ID does not exist"
Sep 11 13:34:33.877347 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.877303    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86d4c8cd9f-8mdd7"]
Sep 11 13:34:33.894135 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:33.894098    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86d4c8cd9f-8mdd7"]
Sep 11 13:34:34.248810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:34.248777    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92d4a32-0df0-43f6-82df-ae8e55a37619" path="/var/lib/kubelet/pods/f92d4a32-0df0-43f6-82df-ae8e55a37619/volumes"
Sep 11 13:34:44.207643 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:44.207609    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:34:44.208405 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:44.208383    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:34:53.340302 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.340267    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7752-4dbfe2"]
Sep 11 13:34:53.340683 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.340608    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92d4a32-0df0-43f6-82df-ae8e55a37619" containerName="authorino"
Sep 11 13:34:53.340683 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.340619    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92d4a32-0df0-43f6-82df-ae8e55a37619" containerName="authorino"
Sep 11 13:34:53.340755 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.340688    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92d4a32-0df0-43f6-82df-ae8e55a37619" containerName="authorino"
Sep 11 13:34:53.344814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.344793    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:34:53.348534 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.348508    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jcb7l\""
Sep 11 13:34:53.362457 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.362415    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7752-4dbfe2"]
Sep 11 13:34:53.432921 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.432880    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjb6w\" (UniqueName: \"kubernetes.io/projected/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2-kube-api-access-wjb6w\") pod \"test-curl-7752-4dbfe2\" (UID: \"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2\") " pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:34:53.533990 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.533948    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjb6w\" (UniqueName: \"kubernetes.io/projected/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2-kube-api-access-wjb6w\") pod \"test-curl-7752-4dbfe2\" (UID: \"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2\") " pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:34:53.544875 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.544844    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjb6w\" (UniqueName: \"kubernetes.io/projected/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2-kube-api-access-wjb6w\") pod \"test-curl-7752-4dbfe2\" (UID: \"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2\") " pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:34:53.654170 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.654131    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:34:53.947468 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:53.947433    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7752-4dbfe2"]
Sep 11 13:34:53.949096 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:34:53.949050    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3abb4d0b_b8dd_4a21_8860_c4ed03dc87f2.slice/crio-62e2740ad9b9118847bfa4d5d75a74e06b2ce19db519b6d32597905e5017c564 WatchSource:0}: Error finding container 62e2740ad9b9118847bfa4d5d75a74e06b2ce19db519b6d32597905e5017c564: Status 404 returned error can't find the container with id 62e2740ad9b9118847bfa4d5d75a74e06b2ce19db519b6d32597905e5017c564
Sep 11 13:34:54.925890 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:54.925849    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7752-4dbfe2" event={"ID":"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2","Type":"ContainerStarted","Data":"62e2740ad9b9118847bfa4d5d75a74e06b2ce19db519b6d32597905e5017c564"}
Sep 11 13:34:55.084745 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:55.084706    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:34:56.964460 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:56.964417    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7752-4dbfe2" event={"ID":"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2","Type":"ContainerStarted","Data":"cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841"}
Sep 11 13:34:56.986036 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:56.985963    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7752-4dbfe2" podStartSLOduration=1.603140242 podStartE2EDuration="3.985935865s" totalImagesPullingTime="2.382795623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:34:56.982267865 +0000 UTC m=+913.194811666" watchObservedRunningTime="2026-09-11 13:34:56.985935865 +0000 UTC m=+913.198479662"
Sep 11 13:34:57.641342 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.641304    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7752-4dbfe2"]
Sep 11 13:34:57.653229 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.653195    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7752-4dbfe2"]
Sep 11 13:34:57.816613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.816524    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7752-3217f0"]
Sep 11 13:34:57.816928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.816901    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" containerName="test-curl-7752-4dbfe2"
Sep 11 13:34:57.816981 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.816929    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" containerName="test-curl-7752-4dbfe2"
Sep 11 13:34:57.817023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.816995    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" containerName="test-curl-7752-4dbfe2"
Sep 11 13:34:57.820199 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.820176    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:34:57.829162 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.829123    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7752-3217f0"]
Sep 11 13:34:57.970651 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:34:57.970612    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7752-4dbfe2" container="test-curl-7752-4dbfe2"
Sep 11 13:34:57.978181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:57.978151    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsbvg\" (UniqueName: \"kubernetes.io/projected/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3-kube-api-access-hsbvg\") pod \"test-curl-7752-3217f0\" (UID: \"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3\") " pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:34:58.079024 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.078905    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsbvg\" (UniqueName: \"kubernetes.io/projected/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3-kube-api-access-hsbvg\") pod \"test-curl-7752-3217f0\" (UID: \"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3\") " pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:34:58.091064 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.091029    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsbvg\" (UniqueName: \"kubernetes.io/projected/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3-kube-api-access-hsbvg\") pod \"test-curl-7752-3217f0\" (UID: \"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3\") " pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:34:58.130725 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.130667    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:34:58.406182 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.406155    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7752-3217f0"]
Sep 11 13:34:58.408518 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:34:58.408487    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c73e18c_1c68_4dde_9f3d_4b829ed4cfa3.slice/crio-78a7ea2fbc882cef626d8264602e4f2fd8949d60942354ca0902099821d24697 WatchSource:0}: Error finding container 78a7ea2fbc882cef626d8264602e4f2fd8949d60942354ca0902099821d24697: Status 404 returned error can't find the container with id 78a7ea2fbc882cef626d8264602e4f2fd8949d60942354ca0902099821d24697
Sep 11 13:34:58.978453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.978408    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7752-3217f0" event={"ID":"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3","Type":"ContainerStarted","Data":"b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009"}
Sep 11 13:34:58.978968 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.978463    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7752-3217f0" event={"ID":"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3","Type":"ContainerStarted","Data":"78a7ea2fbc882cef626d8264602e4f2fd8949d60942354ca0902099821d24697"}
Sep 11 13:34:58.978968 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:58.978475    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7752-4dbfe2" podUID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" containerName="test-curl-7752-4dbfe2" containerID="cri-o://cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841" gracePeriod=2
Sep 11 13:34:59.708844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:59.708738    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7752-3217f0" podStartSLOduration=2.708720332 podStartE2EDuration="2.708720332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:34:59.005414313 +0000 UTC m=+915.217958114" watchObservedRunningTime="2026-09-11 13:34:59.708720332 +0000 UTC m=+915.921264131"
Sep 11 13:34:59.710888 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:59.710861    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7752-3217f0"]
Sep 11 13:34:59.715313 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:34:59.715281    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7752-3217f0"]
Sep 11 13:34:59.984281 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:34:59.984179    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7752-3217f0" container="test-curl-7752-3217f0"
Sep 11 13:35:00.687344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.687304    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"]
Sep 11 13:35:00.687836 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.687817    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" containerName="test-curl-7752-3217f0"
Sep 11 13:35:00.687884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.687840    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" containerName="test-curl-7752-3217f0"
Sep 11 13:35:00.687982 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.687969    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" containerName="test-curl-7752-3217f0"
Sep 11 13:35:00.691578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.691552    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.694288 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.694260    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:35:00.694443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.694294    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-a61c70-openshift-default-dockercfg-lxflj\""
Sep 11 13:35:00.705704 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.705667    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"]
Sep 11 13:35:00.768490 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.768454    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"]
Sep 11 13:35:00.772879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.772846    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.775732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.775702    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5305d131-openshift-default-dockercfg-vds4d\""
Sep 11 13:35:00.789388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.789351    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"]
Sep 11 13:35:00.803502 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803463    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-socket\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803698 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803572    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-envoy\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803698 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803609    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-data\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803698 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803643    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istiod-ca-cert\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803698 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803663    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nf7r\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-kube-api-access-9nf7r\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803727    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-podinfo\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-certs\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803800    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-token\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.803954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.803866    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-credential-socket\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905150 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istiod-ca-cert\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905150 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905153    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nf7r\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-kube-api-access-9nf7r\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905177    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqsvm\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-kube-api-access-jqsvm\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905196    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-podinfo\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905222    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-credential-socket\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905319    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-certs\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905378    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-token\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905720 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905548    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-token\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905720 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905598    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-credential-socket\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905720 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905628    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-socket\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905720 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905691    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-certs\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905735    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-data\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905805    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-certs\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.905903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905825    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5069a-048c-4464-ade3-f6fdf8d2049a-istiod-ca-cert\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.905903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905860    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-envoy\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.906060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905900    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-credential-socket\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.906060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905907    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-socket\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.906060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905973    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-podinfo\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:00.906060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.905976    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istiod-ca-cert\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.906185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.906080    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-envoy\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.906185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.906107    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-data\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.906185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.906170    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-socket\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.906385 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.906367    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-data\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.907773 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.907752    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-podinfo\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.908376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.908355    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-envoy\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.913957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.913902    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-token\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.914164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.914141    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nf7r\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-kube-api-access-9nf7r\") pod \"e2e-autores-a61c70-openshift-default-85df847998-js5bx\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") " pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:00.989658 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:00.989615    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7752-3217f0" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" containerName="test-curl-7752-3217f0" containerID="cri-o://b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009" gracePeriod=2
Sep 11 13:35:01.003009 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.002974    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:01.007482 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007296    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-token\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007482 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-socket\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007482 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-certs\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007482 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-data\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007485    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5069a-048c-4464-ade3-f6fdf8d2049a-istiod-ca-cert\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007513    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-envoy\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-podinfo\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007619    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqsvm\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-kube-api-access-jqsvm\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.007719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.007652    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-credential-socket\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.008106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.008082    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-data\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.008451 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.008271    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-credential-socket\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.008451 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.008410    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-socket\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.008584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.008514    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-certs\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.009039 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.009017    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5069a-048c-4464-ade3-f6fdf8d2049a-istiod-ca-cert\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.010385 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.010352    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-envoy\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.010723 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.010698    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-podinfo\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.019602 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.019580    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqsvm\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-kube-api-access-jqsvm\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.019820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.019791    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-token\") pod \"e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") " pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.087361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.087328    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:01.178365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.178327    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:35:01.297817 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.297781    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"]
Sep 11 13:35:01.299070 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:35:01.299039    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ac8eb9_bffa_4ff7_ab98_156bf147c3cd.slice/crio-c9c50d1c427ccc14f99e55e0d0a154a6af9be55ed79ab97d2267a7c9965ea783 WatchSource:0}: Error finding container c9c50d1c427ccc14f99e55e0d0a154a6af9be55ed79ab97d2267a7c9965ea783: Status 404 returned error can't find the container with id c9c50d1c427ccc14f99e55e0d0a154a6af9be55ed79ab97d2267a7c9965ea783
Sep 11 13:35:01.309690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.309658    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjb6w\" (UniqueName: \"kubernetes.io/projected/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2-kube-api-access-wjb6w\") pod \"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2\" (UID: \"3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2\") "
Sep 11 13:35:01.311925 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.311884    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2-kube-api-access-wjb6w" (OuterVolumeSpecName: "kube-api-access-wjb6w") pod "3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" (UID: "3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2"). InnerVolumeSpecName "kube-api-access-wjb6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:35:01.371396 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.371352    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"]
Sep 11 13:35:01.375063 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:35:01.375031    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d5069a_048c_4464_ade3_f6fdf8d2049a.slice/crio-2af1e21cf97ed9bcbdf0f374bc79194ba204c51d878519a0a97dac3b5a2f2261 WatchSource:0}: Error finding container 2af1e21cf97ed9bcbdf0f374bc79194ba204c51d878519a0a97dac3b5a2f2261: Status 404 returned error can't find the container with id 2af1e21cf97ed9bcbdf0f374bc79194ba204c51d878519a0a97dac3b5a2f2261
Sep 11 13:35:01.410976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.410892    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjb6w\" (UniqueName: \"kubernetes.io/projected/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2-kube-api-access-wjb6w\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:01.996794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.996750    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" event={"ID":"50d5069a-048c-4464-ade3-f6fdf8d2049a","Type":"ContainerStarted","Data":"2af1e21cf97ed9bcbdf0f374bc79194ba204c51d878519a0a97dac3b5a2f2261"}
Sep 11 13:35:01.998237 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.998198    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" event={"ID":"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd","Type":"ContainerStarted","Data":"c9c50d1c427ccc14f99e55e0d0a154a6af9be55ed79ab97d2267a7c9965ea783"}
Sep 11 13:35:01.999820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.999790    2547 generic.go:356] "Generic (PLEG): container finished" podID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" containerID="cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841" exitCode=137
Sep 11 13:35:02.000002 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.999848    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:35:02.000002 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:01.999890    2547 scope.go:117] "RemoveContainer" containerID="cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841"
Sep 11 13:35:02.010171 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:02.010147    2547 scope.go:117] "RemoveContainer" containerID="cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841"
Sep 11 13:35:02.010480 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:02.010460    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841\": container with ID starting with cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841 not found: ID does not exist" containerID="cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841"
Sep 11 13:35:02.010585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:02.010487    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841"} err="failed to get container status \"cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841\": rpc error: code = NotFound desc = could not find container \"cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841\": container with ID starting with cfb28fbfffac0d4af21febbbf4be4e420d921e6acd12d78f5fb5d50558f47841 not found: ID does not exist"
Sep 11 13:35:02.012421 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:02.012392    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7752-4dbfe2\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" pod="opendatahub/test-curl-7752-4dbfe2"
Sep 11 13:35:02.251062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:02.250983    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2" path="/var/lib/kubelet/pods/3abb4d0b-b8dd-4a21-8860-c4ed03dc87f2/volumes"
Sep 11 13:35:03.217086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:03.216990    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:35:03.331418 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:03.331328    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsbvg\" (UniqueName: \"kubernetes.io/projected/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3-kube-api-access-hsbvg\") pod \"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3\" (UID: \"5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3\") "
Sep 11 13:35:03.334282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:03.334240    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3-kube-api-access-hsbvg" (OuterVolumeSpecName: "kube-api-access-hsbvg") pod "5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" (UID: "5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3"). InnerVolumeSpecName "kube-api-access-hsbvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:35:03.433149 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:03.433100    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsbvg\" (UniqueName: \"kubernetes.io/projected/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3-kube-api-access-hsbvg\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:04.019697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.019659    2547 generic.go:356] "Generic (PLEG): container finished" podID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" containerID="b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009" exitCode=137
Sep 11 13:35:04.019903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.019716    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:35:04.019903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.019727    2547 scope.go:117] "RemoveContainer" containerID="b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009"
Sep 11 13:35:04.036302 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:04.036259    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7752-3217f0\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:35:04.248612 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:04.248571    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7752-3217f0\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" pod="opendatahub/test-curl-7752-3217f0"
Sep 11 13:35:04.250437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.250409    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3" path="/var/lib/kubelet/pods/5c73e18c-1c68-4dde-9f3d-4b829ed4cfa3/volumes"
Sep 11 13:35:04.271450 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.271271    2547 scope.go:117] "RemoveContainer" containerID="b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009"
Sep 11 13:35:04.271664 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:04.271640    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009\": container with ID starting with b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009 not found: ID does not exist" containerID="b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009"
Sep 11 13:35:04.271729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.271676    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009"} err="failed to get container status \"b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009\": rpc error: code = NotFound desc = could not find container \"b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009\": container with ID starting with b3ec2d17a764df2c7b9f1b57de81ab11fad5afaf0011a0b986aabd1b7ff55009 not found: ID does not exist"
Sep 11 13:35:04.351645 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.351598    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:04.351749 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.351682    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:04.351749 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.351712    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:04.358313 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.358273    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:04.358369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.358349    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:04.358402 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:04.358385    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:05.027905 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:05.027863    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" event={"ID":"50d5069a-048c-4464-ade3-f6fdf8d2049a","Type":"ContainerStarted","Data":"4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"}
Sep 11 13:35:05.029871 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:05.029833    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" event={"ID":"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd","Type":"ContainerStarted","Data":"6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"}
Sep 11 13:35:05.067976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:05.067898    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podStartSLOduration=2.093786426 podStartE2EDuration="5.067878744s" totalImagesPullingTime="2.974092318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:05.065464782 +0000 UTC m=+921.278008584" watchObservedRunningTime="2026-09-11 13:35:05.067878744 +0000 UTC m=+921.280422613"
Sep 11 13:35:05.087772 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:05.087724    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:05.093312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:05.093280    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:05.094558 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:05.094511    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podStartSLOduration=2.037805663 podStartE2EDuration="5.094493812s" totalImagesPullingTime="3.056688149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:05.092561408 +0000 UTC m=+921.305105209" watchObservedRunningTime="2026-09-11 13:35:05.094493812 +0000 UTC m=+921.307037687"
Sep 11 13:35:06.004218 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:06.004174    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:06.010237 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:06.010203    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:06.036468 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:06.036418    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:06.036682 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:06.036488    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:06.037325 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:06.037294    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:06.037426 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:06.037406    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:07.915351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:07.915313    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:35:10.283536 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.283498    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"]
Sep 11 13:35:10.295235 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.295191    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.299075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.299039    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5305d131-serving-cert\""
Sep 11 13:35:10.300373 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.300343    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x5rkw\""
Sep 11 13:35:10.300373 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.300365    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:35:10.300584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.300436    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:35:10.300584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.300482    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:35:10.314074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.314039    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"]
Sep 11 13:35:10.400393 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.400343    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfvlc\" (UniqueName: \"kubernetes.io/projected/1559da86-3c43-48b1-829e-f729a076aae2-kube-api-access-bfvlc\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.400576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.400471    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1559da86-3c43-48b1-829e-f729a076aae2-openshift-service-ca\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.400576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.400560    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-metrics-certs\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.400650 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.400592    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.501561 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.501515    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.501830 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:10.501690    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-serving-cert: secret "maas-api-e2e-ait-5305d131-serving-cert" not found
Sep 11 13:35:10.502225 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:10.501962    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls podName:1559da86-3c43-48b1-829e-f729a076aae2 nodeName:}" failed. No retries permitted until 2026-09-11 13:35:11.001902524 +0000 UTC m=+927.214446325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls") pod "maas-api-e2e-ait-5305d131-66d4785685-rz66v" (UID: "1559da86-3c43-48b1-829e-f729a076aae2") : secret "maas-api-e2e-ait-5305d131-serving-cert" not found
Sep 11 13:35:10.502225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.502029    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfvlc\" (UniqueName: \"kubernetes.io/projected/1559da86-3c43-48b1-829e-f729a076aae2-kube-api-access-bfvlc\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.502225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.502115    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1559da86-3c43-48b1-829e-f729a076aae2-openshift-service-ca\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.502225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.502176    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-metrics-certs\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.503307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.503278    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1559da86-3c43-48b1-829e-f729a076aae2-openshift-service-ca\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.505111 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.505085    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-metrics-certs\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:10.522939 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:10.522880    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfvlc\" (UniqueName: \"kubernetes.io/projected/1559da86-3c43-48b1-829e-f729a076aae2-kube-api-access-bfvlc\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:11.007364 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:11.007320    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:11.010088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:11.010050    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls\") pod \"maas-api-e2e-ait-5305d131-66d4785685-rz66v\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:11.209155 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:11.209109    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:11.517996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:11.517896    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"]
Sep 11 13:35:11.525146 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:35:11.525098    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1559da86_3c43_48b1_829e_f729a076aae2.slice/crio-e1570a5a422dc02b9ea201b645747e95ff78f549e77f79a9684f891245f8703c WatchSource:0}: Error finding container e1570a5a422dc02b9ea201b645747e95ff78f549e77f79a9684f891245f8703c: Status 404 returned error can't find the container with id e1570a5a422dc02b9ea201b645747e95ff78f549e77f79a9684f891245f8703c
Sep 11 13:35:12.075841 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:12.075758    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v" event={"ID":"1559da86-3c43-48b1-829e-f729a076aae2","Type":"ContainerStarted","Data":"e1570a5a422dc02b9ea201b645747e95ff78f549e77f79a9684f891245f8703c"}
Sep 11 13:35:14.095382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:14.095296    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v" event={"ID":"1559da86-3c43-48b1-829e-f729a076aae2","Type":"ContainerStarted","Data":"90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5"}
Sep 11 13:35:14.095778 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:14.095439    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:14.118853 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:14.118793    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v" podStartSLOduration=1.939784928 podStartE2EDuration="4.11877455s" totalImagesPullingTime="2.178989622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:14.116362543 +0000 UTC m=+930.328906356" watchObservedRunningTime="2026-09-11 13:35:14.11877455 +0000 UTC m=+930.331318351"
Sep 11 13:35:19.554450 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.554411    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"]
Sep 11 13:35:19.558718 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.558688    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.567001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.566971    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bfc5af-serving-cert\""
Sep 11 13:35:19.598731 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.598634    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"]
Sep 11 13:35:19.613770 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.613402    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-metrics-certs\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.613770 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.613505    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjqlk\" (UniqueName: \"kubernetes.io/projected/304f7ecc-84da-4c82-840d-1031ff6057af-kube-api-access-pjqlk\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.613770 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.613544    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.613770 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.613594    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/304f7ecc-84da-4c82-840d-1031ff6057af-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.714314 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.714277    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjqlk\" (UniqueName: \"kubernetes.io/projected/304f7ecc-84da-4c82-840d-1031ff6057af-kube-api-access-pjqlk\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.714588 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.714566    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.714752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.714736    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/304f7ecc-84da-4c82-840d-1031ff6057af-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.714859 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:19.714842    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-serving-cert: secret "maas-api-e2e-inf-b-bfc5af-serving-cert" not found
Sep 11 13:35:19.715009 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:19.714979    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls podName:304f7ecc-84da-4c82-840d-1031ff6057af nodeName:}" failed. No retries permitted until 2026-09-11 13:35:20.214941996 +0000 UTC m=+936.427485778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls") pod "maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" (UID: "304f7ecc-84da-4c82-840d-1031ff6057af") : secret "maas-api-e2e-inf-b-bfc5af-serving-cert" not found
Sep 11 13:35:19.715159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.715139    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-metrics-certs\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.716202 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.716175    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/304f7ecc-84da-4c82-840d-1031ff6057af-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.718038 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.718016    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-metrics-certs\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:19.728988 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:19.728941    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjqlk\" (UniqueName: \"kubernetes.io/projected/304f7ecc-84da-4c82-840d-1031ff6057af-kube-api-access-pjqlk\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:20.111324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:20.111282    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:20.226160 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:20.224885    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:20.230949 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:20.230888    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls\") pod \"maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:20.501170 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:20.501121    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:20.847298 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:20.847262    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"]
Sep 11 13:35:20.848498 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:35:20.848469    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304f7ecc_84da_4c82_840d_1031ff6057af.slice/crio-8e09d2f5b44c914e24f0a3dc61b45df7ae8cb2cd155d5021bcbbb68c925a0a73 WatchSource:0}: Error finding container 8e09d2f5b44c914e24f0a3dc61b45df7ae8cb2cd155d5021bcbbb68c925a0a73: Status 404 returned error can't find the container with id 8e09d2f5b44c914e24f0a3dc61b45df7ae8cb2cd155d5021bcbbb68c925a0a73
Sep 11 13:35:21.138996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:21.138961    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" event={"ID":"304f7ecc-84da-4c82-840d-1031ff6057af","Type":"ContainerStarted","Data":"8e09d2f5b44c914e24f0a3dc61b45df7ae8cb2cd155d5021bcbbb68c925a0a73"}
Sep 11 13:35:22.146571 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:22.146531    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" event={"ID":"304f7ecc-84da-4c82-840d-1031ff6057af","Type":"ContainerStarted","Data":"28e587ccc94c905fb57351bc3704d614d96d47b469d1b822d8829241ea84888d"}
Sep 11 13:35:22.147253 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:22.147232    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:22.180728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:22.180660    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" podStartSLOduration=2.8341583740000003 podStartE2EDuration="3.180637349s" totalImagesPullingTime="346.478975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:22.179998583 +0000 UTC m=+938.392542386" watchObservedRunningTime="2026-09-11 13:35:22.180637349 +0000 UTC m=+938.393181149"
Sep 11 13:35:24.622735 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:24.622695    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:35:26.171629 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:26.171545    2547 generic.go:356] "Generic (PLEG): container finished" podID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerID="4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8" exitCode=0
Sep 11 13:35:26.171629 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:26.171618    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" event={"ID":"50d5069a-048c-4464-ade3-f6fdf8d2049a","Type":"ContainerDied","Data":"4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"}
Sep 11 13:35:26.172135 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:26.172114    2547 scope.go:117] "RemoveContainer" containerID="4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"
Sep 11 13:35:26.173480 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:26.173404    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:26.173480 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:26.173477    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:26.173638 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:26.173508    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:27.179012 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.178973    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" event={"ID":"50d5069a-048c-4464-ade3-f6fdf8d2049a","Type":"ContainerStarted","Data":"0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769"}
Sep 11 13:35:27.180521 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.180497    2547 generic.go:356] "Generic (PLEG): container finished" podID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerID="6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1" exitCode=0
Sep 11 13:35:27.180634 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.180569    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" event={"ID":"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd","Type":"ContainerDied","Data":"6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"}
Sep 11 13:35:27.180937 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.180900    2547 scope.go:117] "RemoveContainer" containerID="6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"
Sep 11 13:35:27.181944 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.181890    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:27.182023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.181983    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:27.182062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:27.182042    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:28.088452 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:28.088078    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:28.088958 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:28.088892    2547 patch_prober.go:28] interesting pod/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 13:35:28.089174 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:28.089121    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 13:35:28.193717 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:28.193669    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" event={"ID":"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd","Type":"ContainerStarted","Data":"46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3"}
Sep 11 13:35:29.004310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:29.004203    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:29.004310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:29.004235    2547 patch_prober.go:28] interesting pod/e2e-autores-a61c70-openshift-default-85df847998-js5bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:35:29.004310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:29.004292    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 13:35:29.089014 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:29.088965    2547 patch_prober.go:28] interesting pod/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 13:35:29.089250 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:29.089042    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 13:35:29.174708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:29.174675    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:35:30.004309 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:30.004258    2547 patch_prober.go:28] interesting pod/e2e-autores-a61c70-openshift-default-85df847998-js5bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:35:30.004831 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:30.004338    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 13:35:30.088344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:30.088302    2547 patch_prober.go:28] interesting pod/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 13:35:30.088648 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:30.088612    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 13:35:31.003715 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:31.003667    2547 patch_prober.go:28] interesting pod/e2e-autores-a61c70-openshift-default-85df847998-js5bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:35:31.004027 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:31.003740    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 13:35:31.088713 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:31.088668    2547 patch_prober.go:28] interesting pod/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 13:35:31.089251 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:31.088755    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 13:35:32.004152 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:32.004107    2547 patch_prober.go:28] interesting pod/e2e-autores-a61c70-openshift-default-85df847998-js5bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:35:32.004472 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:32.004430    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 13:35:32.088048 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:32.088010    2547 patch_prober.go:28] interesting pod/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 13:35:32.088244 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:32.088083    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 13:35:33.003618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:33.003582    2547 patch_prober.go:28] interesting pod/e2e-autores-a61c70-openshift-default-85df847998-js5bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 13:35:33.004112 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:33.004078    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 13:35:33.088587 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:33.088545    2547 patch_prober.go:28] interesting pod/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 13:35:33.088812 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:33.088616    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 13:35:34.008375 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:34.008339    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:34.008749 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:34.008623    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:34.009478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:34.009459    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:35:34.093178 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:34.093145    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:34.093618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:34.093599    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:34.094412 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:34.094389    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:38.944869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:38.944833    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:35:49.001126 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.001090    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"]
Sep 11 13:35:49.001555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.001318    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v" podUID="1559da86-3c43-48b1-829e-f729a076aae2" containerName="maas-api" containerID="cri-o://90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5" gracePeriod=30
Sep 11 13:35:49.255118 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.255044    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:49.334114 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.334080    2547 generic.go:356] "Generic (PLEG): container finished" podID="1559da86-3c43-48b1-829e-f729a076aae2" containerID="90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5" exitCode=0
Sep 11 13:35:49.334282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.334122    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v" event={"ID":"1559da86-3c43-48b1-829e-f729a076aae2","Type":"ContainerDied","Data":"90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5"}
Sep 11 13:35:49.334282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.334138    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"
Sep 11 13:35:49.334282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.334188    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v" event={"ID":"1559da86-3c43-48b1-829e-f729a076aae2","Type":"ContainerDied","Data":"e1570a5a422dc02b9ea201b645747e95ff78f549e77f79a9684f891245f8703c"}
Sep 11 13:35:49.334282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.334211    2547 scope.go:117] "RemoveContainer" containerID="90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5"
Sep 11 13:35:49.343974 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.343946    2547 scope.go:117] "RemoveContainer" containerID="90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5"
Sep 11 13:35:49.344343 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:49.344317    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5\": container with ID starting with 90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5 not found: ID does not exist" containerID="90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5"
Sep 11 13:35:49.344418 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.344357    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5"} err="failed to get container status \"90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5\": rpc error: code = NotFound desc = could not find container \"90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5\": container with ID starting with 90a3f0f018dac4d01b09a9ddb6febf559ae31416e178c20bb37974310cca4ca5 not found: ID does not exist"
Sep 11 13:35:49.402494 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.402462    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-metrics-certs\") pod \"1559da86-3c43-48b1-829e-f729a076aae2\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") "
Sep 11 13:35:49.402682 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.402548    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls\") pod \"1559da86-3c43-48b1-829e-f729a076aae2\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") "
Sep 11 13:35:49.402682 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.402593    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfvlc\" (UniqueName: \"kubernetes.io/projected/1559da86-3c43-48b1-829e-f729a076aae2-kube-api-access-bfvlc\") pod \"1559da86-3c43-48b1-829e-f729a076aae2\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") "
Sep 11 13:35:49.402804 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.402742    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1559da86-3c43-48b1-829e-f729a076aae2-openshift-service-ca\") pod \"1559da86-3c43-48b1-829e-f729a076aae2\" (UID: \"1559da86-3c43-48b1-829e-f729a076aae2\") "
Sep 11 13:35:49.403139 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.403104    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1559da86-3c43-48b1-829e-f729a076aae2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1559da86-3c43-48b1-829e-f729a076aae2" (UID: "1559da86-3c43-48b1-829e-f729a076aae2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:35:49.405443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.405413    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1559da86-3c43-48b1-829e-f729a076aae2-kube-api-access-bfvlc" (OuterVolumeSpecName: "kube-api-access-bfvlc") pod "1559da86-3c43-48b1-829e-f729a076aae2" (UID: "1559da86-3c43-48b1-829e-f729a076aae2"). InnerVolumeSpecName "kube-api-access-bfvlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:35:49.405540 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.405467    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1559da86-3c43-48b1-829e-f729a076aae2" (UID: "1559da86-3c43-48b1-829e-f729a076aae2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:35:49.405540 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.405516    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1559da86-3c43-48b1-829e-f729a076aae2" (UID: "1559da86-3c43-48b1-829e-f729a076aae2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:35:49.492383 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.492349    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"]
Sep 11 13:35:49.492571 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.492553    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy" containerID="cri-o://0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769" gracePeriod=30
Sep 11 13:35:49.504105 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.504077    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:49.504105 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.504102    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1559da86-3c43-48b1-829e-f729a076aae2-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:49.504105 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.504111    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfvlc\" (UniqueName: \"kubernetes.io/projected/1559da86-3c43-48b1-829e-f729a076aae2-kube-api-access-bfvlc\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:49.504328 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.504120    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1559da86-3c43-48b1-829e-f729a076aae2-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:49.667944 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.667845    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"]
Sep 11 13:35:49.670890 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:49.670857    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5305d131-66d4785685-rz66v"]
Sep 11 13:35:50.104374 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.104285    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:35:50.249829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.249795    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1559da86-3c43-48b1-829e-f729a076aae2" path="/var/lib/kubelet/pods/1559da86-3c43-48b1-829e-f729a076aae2/volumes"
Sep 11 13:35:50.689323 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.689281    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"]
Sep 11 13:35:50.689861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.689846    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1559da86-3c43-48b1-829e-f729a076aae2" containerName="maas-api"
Sep 11 13:35:50.689928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.689866    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1559da86-3c43-48b1-829e-f729a076aae2" containerName="maas-api"
Sep 11 13:35:50.689995 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.689984    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1559da86-3c43-48b1-829e-f729a076aae2" containerName="maas-api"
Sep 11 13:35:50.692904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.692886    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.697654 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.697630    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9acc1188-gw-openshift-default-dockercfg-lvnzt\""
Sep 11 13:35:50.711479 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.711435    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"]
Sep 11 13:35:50.815238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815194    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-envoy\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815242    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-certs\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815506 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815273    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istiod-ca-cert\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815506 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815307    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfr49\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-kube-api-access-bfr49\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815506 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815403    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-podinfo\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815506 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815435    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-token\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815506 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815456    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-socket\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815672 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815513    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-credential-socket\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.815672 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.815570    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-data\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istiod-ca-cert\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916316    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfr49\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-kube-api-access-bfr49\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-podinfo\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916368    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-token\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916390    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-socket\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-credential-socket\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916478    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-data\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916808 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916521    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-envoy\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916808 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916560    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-certs\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916946 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916807    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-socket\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.916946 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.916906    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-credential-socket\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.917116 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.917003    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-certs\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.917116 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.917067    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-data\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.917116 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.917110    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istiod-ca-cert\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.918896 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.918869    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-envoy\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.919062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.919042    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-podinfo\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.925986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.925958    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-token\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:50.926098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:50.925957    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfr49\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-kube-api-access-bfr49\") pod \"e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") " pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:51.003086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:51.002998    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:51.287755 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:51.287724    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"]
Sep 11 13:35:51.289687 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:35:51.289647    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ce8b8c_19d1_40a7_bfad_7fb57e49f74f.slice/crio-9b414617bf5db958a7856c110494130a22f86eca921381623d61be4ffe841938 WatchSource:0}: Error finding container 9b414617bf5db958a7856c110494130a22f86eca921381623d61be4ffe841938: Status 404 returned error can't find the container with id 9b414617bf5db958a7856c110494130a22f86eca921381623d61be4ffe841938
Sep 11 13:35:51.292116 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:51.292081    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:51.292203 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:51.292152    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:51.292203 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:51.292180    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:35:51.348484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:51.348454    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" event={"ID":"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f","Type":"ContainerStarted","Data":"9b414617bf5db958a7856c110494130a22f86eca921381623d61be4ffe841938"}
Sep 11 13:35:52.356056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:52.356010    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" event={"ID":"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f","Type":"ContainerStarted","Data":"2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"}
Sep 11 13:35:52.395016 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:52.394954    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podStartSLOduration=2.39490112 podStartE2EDuration="2.39490112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:52.394407542 +0000 UTC m=+968.606951343" watchObservedRunningTime="2026-09-11 13:35:52.39490112 +0000 UTC m=+968.607444920"
Sep 11 13:35:53.004151 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:53.004113    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:53.009593 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:53.009561    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:53.362129 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:53.362037    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:53.369499 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:53.363470    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:35:54.417411 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.417378    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"]
Sep 11 13:35:54.419769 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.419751    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.427671 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.427281    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9acc1188-serving-cert\""
Sep 11 13:35:54.455103 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.455067    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"]
Sep 11 13:35:54.550823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.550785    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f2fef6-bfe7-4f61-af16-917234aba89a-openshift-service-ca\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.551041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.550830    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/c4f2fef6-bfe7-4f61-af16-917234aba89a-kube-api-access-b4f9m\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.551041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.550944    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.551041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.551000    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-metrics-certs\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.652178 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.652131    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f2fef6-bfe7-4f61-af16-917234aba89a-openshift-service-ca\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.652361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.652185    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/c4f2fef6-bfe7-4f61-af16-917234aba89a-kube-api-access-b4f9m\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.652361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.652290    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.652361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.652354    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-metrics-certs\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.652525 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:54.652450    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-serving-cert: secret "maas-api-e2e-migrate-9acc1188-serving-cert" not found
Sep 11 13:35:54.652583 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:54.652540    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls podName:c4f2fef6-bfe7-4f61-af16-917234aba89a nodeName:}" failed. No retries permitted until 2026-09-11 13:35:55.152518977 +0000 UTC m=+971.365062760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls") pod "maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" (UID: "c4f2fef6-bfe7-4f61-af16-917234aba89a") : secret "maas-api-e2e-migrate-9acc1188-serving-cert" not found
Sep 11 13:35:54.652976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.652951    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f2fef6-bfe7-4f61-af16-917234aba89a-openshift-service-ca\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.654852 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.654829    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-metrics-certs\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.668133 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.668048    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/c4f2fef6-bfe7-4f61-af16-917234aba89a-kube-api-access-b4f9m\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:54.755448 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.755419    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:54.854070 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854025    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-certs\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854070 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854070    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-podinfo\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854305 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854109    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5069a-048c-4464-ade3-f6fdf8d2049a-istiod-ca-cert\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854305 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854157    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-credential-socket\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854305 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854188    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-token\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854305 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854210    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-socket\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854343    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-envoy\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854376    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqsvm\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-kube-api-access-jqsvm\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854388    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:35:54.854512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854415    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-data\") pod \"50d5069a-048c-4464-ade3-f6fdf8d2049a\" (UID: \"50d5069a-048c-4464-ade3-f6fdf8d2049a\") "
Sep 11 13:35:54.854512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854454    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:35:54.854765 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854594    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-data" (OuterVolumeSpecName: "istio-data") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:35:54.854765 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854675    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:35:54.855007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854899    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.855007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854941    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.855007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854958    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.855007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.854974    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.855222 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.855047    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d5069a-048c-4464-ade3-f6fdf8d2049a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:35:54.856555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.856534    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-token" (OuterVolumeSpecName: "istio-token") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:35:54.856555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.856544    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-kube-api-access-jqsvm" (OuterVolumeSpecName: "kube-api-access-jqsvm") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "kube-api-access-jqsvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:35:54.856821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.856805    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:35:54.856864 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.856812    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50d5069a-048c-4464-ade3-f6fdf8d2049a" (UID: "50d5069a-048c-4464-ade3-f6fdf8d2049a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:35:54.956173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.956084    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.956173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.956118    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5069a-048c-4464-ade3-f6fdf8d2049a-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.956173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.956126    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.956173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.956135    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5069a-048c-4464-ade3-f6fdf8d2049a-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:54.956173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:54.956144    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqsvm\" (UniqueName: \"kubernetes.io/projected/50d5069a-048c-4464-ade3-f6fdf8d2049a-kube-api-access-jqsvm\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:35:55.158344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.158298    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:55.160792 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.160762    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls\") pod \"maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:55.331435 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.331345    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:55.378437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.378398    2547 generic.go:356] "Generic (PLEG): container finished" podID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerID="0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769" exitCode=0
Sep 11 13:35:55.378620 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.378468    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"
Sep 11 13:35:55.378620 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.378458    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" event={"ID":"50d5069a-048c-4464-ade3-f6fdf8d2049a","Type":"ContainerDied","Data":"0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769"}
Sep 11 13:35:55.378724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.378627    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh" event={"ID":"50d5069a-048c-4464-ade3-f6fdf8d2049a","Type":"ContainerDied","Data":"2af1e21cf97ed9bcbdf0f374bc79194ba204c51d878519a0a97dac3b5a2f2261"}
Sep 11 13:35:55.378724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.378665    2547 scope.go:117] "RemoveContainer" containerID="0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769"
Sep 11 13:35:55.397052 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.393105    2547 scope.go:117] "RemoveContainer" containerID="4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"
Sep 11 13:35:55.407439 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.407413    2547 scope.go:117] "RemoveContainer" containerID="0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769"
Sep 11 13:35:55.407768 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:55.407747    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769\": container with ID starting with 0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769 not found: ID does not exist" containerID="0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769"
Sep 11 13:35:55.407845 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.407778    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769"} err="failed to get container status \"0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769\": rpc error: code = NotFound desc = could not find container \"0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769\": container with ID starting with 0ad176e7f1ecc29a180133c2cccafaf8c539f6695ba2ab2248d51b383e776769 not found: ID does not exist"
Sep 11 13:35:55.407845 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.407798    2547 scope.go:117] "RemoveContainer" containerID="4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"
Sep 11 13:35:55.408052 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:35:55.408033    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8\": container with ID starting with 4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8 not found: ID does not exist" containerID="4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"
Sep 11 13:35:55.408126 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.408055    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8"} err="failed to get container status \"4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8\": rpc error: code = NotFound desc = could not find container \"4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8\": container with ID starting with 4968333de144f28c0637ea2ee4dd79906597fdb3257173b1e9e5f7c4d881f6f8 not found: ID does not exist"
Sep 11 13:35:55.451781 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.451738    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"]
Sep 11 13:35:55.459678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.459642    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5305d131-openshift-default-6ddc48f556-r2hgh"]
Sep 11 13:35:55.634539 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:55.634510    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"]
Sep 11 13:35:55.638124 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:35:55.638091    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f2fef6_bfe7_4f61_af16_917234aba89a.slice/crio-c3f3281d5bca7ad04e09787dadeaa8823958e032c56ea556fe266351ff6d4f2c WatchSource:0}: Error finding container c3f3281d5bca7ad04e09787dadeaa8823958e032c56ea556fe266351ff6d4f2c: Status 404 returned error can't find the container with id c3f3281d5bca7ad04e09787dadeaa8823958e032c56ea556fe266351ff6d4f2c
Sep 11 13:35:56.250886 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:56.250853    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" path="/var/lib/kubelet/pods/50d5069a-048c-4464-ade3-f6fdf8d2049a/volumes"
Sep 11 13:35:56.386764 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:56.386724    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" event={"ID":"c4f2fef6-bfe7-4f61-af16-917234aba89a","Type":"ContainerStarted","Data":"1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce"}
Sep 11 13:35:56.386951 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:56.386795    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:35:56.386951 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:56.386817    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" event={"ID":"c4f2fef6-bfe7-4f61-af16-917234aba89a","Type":"ContainerStarted","Data":"c3f3281d5bca7ad04e09787dadeaa8823958e032c56ea556fe266351ff6d4f2c"}
Sep 11 13:35:56.411730 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:56.411679    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" podStartSLOduration=2.036098512 podStartE2EDuration="2.411662414s" totalImagesPullingTime="375.563902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:56.410222878 +0000 UTC m=+972.622766678" watchObservedRunningTime="2026-09-11 13:35:56.411662414 +0000 UTC m=+972.624206214"
Sep 11 13:35:58.614778 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.614740    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"]
Sep 11 13:35:58.615185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.615127    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy"
Sep 11 13:35:58.615185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.615140    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy"
Sep 11 13:35:58.615257 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.615220    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy"
Sep 11 13:35:58.617241 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.617221    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.620638 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.620612    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-b386d576-kserve-self-signed-certs\""
Sep 11 13:35:58.631526 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.631492    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"]
Sep 11 13:35:58.696072 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.696036    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-tmp-dir\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.696072 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.696077    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-dshm\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.696301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.696119    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-home\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.696301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.696169    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-model-cache\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.696301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.696196    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28m5\" (UniqueName: \"kubernetes.io/projected/8ba41d62-524a-4624-aef9-59266f2d2b90-kube-api-access-w28m5\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.696301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.696219    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba41d62-524a-4624-aef9-59266f2d2b90-tls-certs\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797110 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797072    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-model-cache\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797125    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w28m5\" (UniqueName: \"kubernetes.io/projected/8ba41d62-524a-4624-aef9-59266f2d2b90-kube-api-access-w28m5\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797262    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba41d62-524a-4624-aef9-59266f2d2b90-tls-certs\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797395 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797331    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-tmp-dir\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797395 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797357    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-dshm\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797411    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-home\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797539 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797492    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-model-cache\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797715 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797695    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-tmp-dir\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.797784 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.797761    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-home\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.799697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.799671    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-dshm\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.799873 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.799853    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba41d62-524a-4624-aef9-59266f2d2b90-tls-certs\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.809975 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.809950    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28m5\" (UniqueName: \"kubernetes.io/projected/8ba41d62-524a-4624-aef9-59266f2d2b90-kube-api-access-w28m5\") pod \"e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") " pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:58.927316 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:58.927272    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:35:59.223427 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:59.223388    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"]
Sep 11 13:35:59.407564 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:59.407525    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd" event={"ID":"8ba41d62-524a-4624-aef9-59266f2d2b90","Type":"ContainerStarted","Data":"2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1"}
Sep 11 13:35:59.407564 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:59.407577    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd" event={"ID":"8ba41d62-524a-4624-aef9-59266f2d2b90","Type":"ContainerStarted","Data":"107c771d4d52c02061400255de2e802c50152434584cf30ead55f21059804bef"}
Sep 11 13:35:59.431649 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:35:59.431587    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd" podStartSLOduration=1.431570274 podStartE2EDuration="1.431570274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:35:59.430588458 +0000 UTC m=+975.643132264" watchObservedRunningTime="2026-09-11 13:35:59.431570274 +0000 UTC m=+975.644114119"
Sep 11 13:36:02.399081 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:02.399044    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:36:06.924322 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:06.924224    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:36:08.791850 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:08.791766    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:36330->10.133.0.57:15021: read: connection reset by peer" start-of-body=
Sep 11 13:36:08.791850 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:08.791825    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:36330->10.133.0.57:15021: read: connection reset by peer"
Sep 11 13:36:08.927690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:08.927643    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:36:08.927980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:08.927946    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:36:08.941126 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:08.941097    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:36:09.473544 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.473507    2547 generic.go:356] "Generic (PLEG): container finished" podID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerID="2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065" exitCode=0
Sep 11 13:36:09.473721 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.473582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" event={"ID":"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f","Type":"ContainerDied","Data":"2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"}
Sep 11 13:36:09.474093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.474078    2547 scope.go:117] "RemoveContainer" containerID="2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"
Sep 11 13:36:09.475162 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.475132    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:09.475229 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.475209    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:09.475274 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.475242    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:09.485583 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:09.485554    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:36:10.488973 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:10.488928    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" event={"ID":"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f","Type":"ContainerStarted","Data":"0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1"}
Sep 11 13:36:11.003945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:11.003879    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:36:11.004225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:11.004196    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 13:36:11.004282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:11.004256    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 13:36:12.004271 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:12.004224    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 13:36:12.004670 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:12.004295    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 13:36:13.004238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:13.004204    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 13:36:13.004406 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:13.004264    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 13:36:14.003470 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:14.003431    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 13:36:14.003876 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:14.003835    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 13:36:15.004464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:15.004424    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 13:36:15.004864 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:15.004492    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 13:36:16.007458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:16.007423    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:36:16.008052 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:16.007715    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:36:16.008458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:16.008442    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:36:20.017265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:20.017222    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:36:26.126467 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.126430    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"]
Sep 11 13:36:26.126863 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.126651    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" podUID="c4f2fef6-bfe7-4f61-af16-917234aba89a" containerName="maas-api" containerID="cri-o://1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce" gracePeriod=30
Sep 11 13:36:26.389520 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.389447    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:36:26.471001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.470959    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-metrics-certs\") pod \"c4f2fef6-bfe7-4f61-af16-917234aba89a\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") "
Sep 11 13:36:26.471213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.471052    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f2fef6-bfe7-4f61-af16-917234aba89a-openshift-service-ca\") pod \"c4f2fef6-bfe7-4f61-af16-917234aba89a\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") "
Sep 11 13:36:26.471213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.471076    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls\") pod \"c4f2fef6-bfe7-4f61-af16-917234aba89a\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") "
Sep 11 13:36:26.471213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.471142    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/c4f2fef6-bfe7-4f61-af16-917234aba89a-kube-api-access-b4f9m\") pod \"c4f2fef6-bfe7-4f61-af16-917234aba89a\" (UID: \"c4f2fef6-bfe7-4f61-af16-917234aba89a\") "
Sep 11 13:36:26.471503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.471464    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4f2fef6-bfe7-4f61-af16-917234aba89a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4f2fef6-bfe7-4f61-af16-917234aba89a" (UID: "c4f2fef6-bfe7-4f61-af16-917234aba89a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:36:26.473281 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.473249    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4f2fef6-bfe7-4f61-af16-917234aba89a" (UID: "c4f2fef6-bfe7-4f61-af16-917234aba89a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:36:26.473281 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.473275    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f2fef6-bfe7-4f61-af16-917234aba89a-kube-api-access-b4f9m" (OuterVolumeSpecName: "kube-api-access-b4f9m") pod "c4f2fef6-bfe7-4f61-af16-917234aba89a" (UID: "c4f2fef6-bfe7-4f61-af16-917234aba89a"). InnerVolumeSpecName "kube-api-access-b4f9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:36:26.473456 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.473332    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4f2fef6-bfe7-4f61-af16-917234aba89a" (UID: "c4f2fef6-bfe7-4f61-af16-917234aba89a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:36:26.572560 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.572518    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4f2fef6-bfe7-4f61-af16-917234aba89a-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:26.572560 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.572556    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:26.572560 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.572569    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/c4f2fef6-bfe7-4f61-af16-917234aba89a-kube-api-access-b4f9m\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:26.572560 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.572578    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4f2fef6-bfe7-4f61-af16-917234aba89a-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:26.583248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.583216    2547 generic.go:356] "Generic (PLEG): container finished" podID="c4f2fef6-bfe7-4f61-af16-917234aba89a" containerID="1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce" exitCode=0
Sep 11 13:36:26.583464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.583279    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"
Sep 11 13:36:26.583464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.583313    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" event={"ID":"c4f2fef6-bfe7-4f61-af16-917234aba89a","Type":"ContainerDied","Data":"1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce"}
Sep 11 13:36:26.583464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.583383    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4" event={"ID":"c4f2fef6-bfe7-4f61-af16-917234aba89a","Type":"ContainerDied","Data":"c3f3281d5bca7ad04e09787dadeaa8823958e032c56ea556fe266351ff6d4f2c"}
Sep 11 13:36:26.583464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.583412    2547 scope.go:117] "RemoveContainer" containerID="1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce"
Sep 11 13:36:26.604389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.604366    2547 scope.go:117] "RemoveContainer" containerID="1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce"
Sep 11 13:36:26.604732 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:36:26.604713    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce\": container with ID starting with 1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce not found: ID does not exist" containerID="1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce"
Sep 11 13:36:26.604816 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.604738    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce"} err="failed to get container status \"1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce\": rpc error: code = NotFound desc = could not find container \"1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce\": container with ID starting with 1c3c2c9ea41ab475d86b36891ce1a1fb79741b54dcb0b3e4756cc4ef2a2e31ce not found: ID does not exist"
Sep 11 13:36:26.639808 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.639712    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"]
Sep 11 13:36:26.653662 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.653620    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9acc1188-b4fc4fbd4-bdfq4"]
Sep 11 13:36:26.864341 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.864299    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"]
Sep 11 13:36:26.864680 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:26.864639    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" containerID="cri-o://0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1" gracePeriod=30
Sep 11 13:36:27.643713 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.643675    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"]
Sep 11 13:36:27.644139 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.644118    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f2fef6-bfe7-4f61-af16-917234aba89a" containerName="maas-api"
Sep 11 13:36:27.644139 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.644131    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f2fef6-bfe7-4f61-af16-917234aba89a" containerName="maas-api"
Sep 11 13:36:27.644214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.644145    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy"
Sep 11 13:36:27.644214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.644151    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy"
Sep 11 13:36:27.644214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.644209    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d5069a-048c-4464-ade3-f6fdf8d2049a" containerName="istio-proxy"
Sep 11 13:36:27.644308 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.644216    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f2fef6-bfe7-4f61-af16-917234aba89a" containerName="maas-api"
Sep 11 13:36:27.647118 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.647087    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.650379 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.650354    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-db87970d-openshift-default-dockercfg-cj5qx\""
Sep 11 13:36:27.668345 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.668310    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"]
Sep 11 13:36:27.784339 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784289    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840657d4-0847-4578-9fa5-86295a9c5287-istiod-ca-cert\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784530 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r68b4\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-kube-api-access-r68b4\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784530 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784413    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-certs\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784530 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784475    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-credential-socket\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784530 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784496    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-socket\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784536    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-envoy\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784568    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840657d4-0847-4578-9fa5-86295a9c5287-istio-podinfo\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784585    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-istio-token\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.784675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.784635    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-data\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885577    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68b4\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-kube-api-access-r68b4\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885629    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-certs\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885677    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-credential-socket\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-socket\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885730    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-envoy\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885752    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840657d4-0847-4578-9fa5-86295a9c5287-istio-podinfo\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.885810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885776    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-istio-token\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886158 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885817    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-data\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886158 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.885875    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840657d4-0847-4578-9fa5-86295a9c5287-istiod-ca-cert\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886253 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.886154    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-certs\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886372 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.886352    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-credential-socket\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.886370    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-socket\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.886436    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-data\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.886763 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.886736    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840657d4-0847-4578-9fa5-86295a9c5287-istiod-ca-cert\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.888311 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.888286    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-envoy\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.888537 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.888518    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840657d4-0847-4578-9fa5-86295a9c5287-istio-podinfo\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.895341 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.895267    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-istio-token\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.895341 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.895320    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r68b4\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-kube-api-access-r68b4\") pod \"e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") " pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:27.958667 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:27.958621    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:28.249486 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:36:28.249454    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840657d4_0847_4578_9fa5_86295a9c5287.slice/crio-06622321f6548522a3a14e81987001e8d63350f65ead7ba2fbcc68475ffe92f6 WatchSource:0}: Error finding container 06622321f6548522a3a14e81987001e8d63350f65ead7ba2fbcc68475ffe92f6: Status 404 returned error can't find the container with id 06622321f6548522a3a14e81987001e8d63350f65ead7ba2fbcc68475ffe92f6
Sep 11 13:36:28.250827 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.250793    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4f2fef6-bfe7-4f61-af16-917234aba89a" path="/var/lib/kubelet/pods/c4f2fef6-bfe7-4f61-af16-917234aba89a/volumes"
Sep 11 13:36:28.251201 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.251183    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"]
Sep 11 13:36:28.252188 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.252154    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:28.252257 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.252224    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:28.252294 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.252254    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:28.598880 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.598784    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" event={"ID":"840657d4-0847-4578-9fa5-86295a9c5287","Type":"ContainerStarted","Data":"e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"}
Sep 11 13:36:28.598880 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.598844    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" event={"ID":"840657d4-0847-4578-9fa5-86295a9c5287","Type":"ContainerStarted","Data":"06622321f6548522a3a14e81987001e8d63350f65ead7ba2fbcc68475ffe92f6"}
Sep 11 13:36:28.629678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.629609    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podStartSLOduration=1.62958279 podStartE2EDuration="1.62958279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:36:28.627694053 +0000 UTC m=+1004.840237853" watchObservedRunningTime="2026-09-11 13:36:28.62958279 +0000 UTC m=+1004.842126595"
Sep 11 13:36:28.959678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:28.959643    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:29.965884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:29.965851    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:30.610995 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:30.610956    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:30.612074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:30.612052    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:31.010949 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:31.010890    2547 patch_prober.go:28] interesting pod/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:36:31.011416 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:31.010977    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:36:32.141133 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.141067    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:36:32.225944 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.225867    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-credential-socket\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.225963    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-envoy\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.225984    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-socket\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226009    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-certs\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226030    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-data\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226058    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfr49\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-kube-api-access-bfr49\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226093    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-podinfo\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226116    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-token\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226182    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istiod-ca-cert\") pod \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\" (UID: \"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f\") "
Sep 11 13:36:32.226500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226360    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:36:32.226500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226376    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:36:32.226500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226394    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:36:32.226697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226556    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:36:32.226697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226628    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.226697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226648    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.226697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226662    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.226845 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.226712    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:36:32.228377 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.228348    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:36:32.228490 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.228399    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:36:32.228690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.228670    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-kube-api-access-bfr49" (OuterVolumeSpecName: "kube-api-access-bfr49") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "kube-api-access-bfr49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:36:32.228757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.228684    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" (UID: "e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:36:32.328231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.328093    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.328231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.328131    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.328231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.328150    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfr49\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-kube-api-access-bfr49\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.328231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.328163    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.328231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.328178    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.328231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.328191    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:36:32.624572 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.624532    2547 generic.go:356] "Generic (PLEG): container finished" podID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerID="0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1" exitCode=0
Sep 11 13:36:32.624782 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.624590    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"
Sep 11 13:36:32.624782 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.624622    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" event={"ID":"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f","Type":"ContainerDied","Data":"0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1"}
Sep 11 13:36:32.624782 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.624683    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2" event={"ID":"e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f","Type":"ContainerDied","Data":"9b414617bf5db958a7856c110494130a22f86eca921381623d61be4ffe841938"}
Sep 11 13:36:32.624782 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.624706    2547 scope.go:117] "RemoveContainer" containerID="0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1"
Sep 11 13:36:32.636999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.636978    2547 scope.go:117] "RemoveContainer" containerID="2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"
Sep 11 13:36:32.644586 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.644549    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"]
Sep 11 13:36:32.646978 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.646876    2547 scope.go:117] "RemoveContainer" containerID="0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1"
Sep 11 13:36:32.647389 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:36:32.647364    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1\": container with ID starting with 0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1 not found: ID does not exist" containerID="0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1"
Sep 11 13:36:32.647492 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.647397    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1"} err="failed to get container status \"0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1\": rpc error: code = NotFound desc = could not find container \"0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1\": container with ID starting with 0eff2da6ef0d0365f76358a85295bb01fb0d7fe29d81904e6d53dc3d345ef9d1 not found: ID does not exist"
Sep 11 13:36:32.647492 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.647417    2547 scope.go:117] "RemoveContainer" containerID="2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"
Sep 11 13:36:32.647800 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:36:32.647780    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065\": container with ID starting with 2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065 not found: ID does not exist" containerID="2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"
Sep 11 13:36:32.647858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.647809    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065"} err="failed to get container status \"2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065\": rpc error: code = NotFound desc = could not find container \"2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065\": container with ID starting with 2b796494f0fdc6f88e773095cb205660e21170ac4c44da1a57e649a869113065 not found: ID does not exist"
Sep 11 13:36:32.649728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:32.649704    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9acc1188-gw-openshift-default-7895c667d4-pqxw2"]
Sep 11 13:36:34.161975 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.161939    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"]
Sep 11 13:36:34.162407 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.162387    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy"
Sep 11 13:36:34.162407 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.162402    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy"
Sep 11 13:36:34.162599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.162481    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy"
Sep 11 13:36:34.162599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.162492    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy"
Sep 11 13:36:34.165579 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.165551    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.169969 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.169939    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-db87970d-serving-cert\""
Sep 11 13:36:34.178492 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.178459    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"]
Sep 11 13:36:34.248593 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.248557    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e07a67-e9ee-4b11-b7df-382b7b5afad0-openshift-service-ca\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.248776 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.248693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-maas-api-tls\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.248776 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.248741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-metrics-certs\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.248776 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.248765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9pz\" (UniqueName: \"kubernetes.io/projected/35e07a67-e9ee-4b11-b7df-382b7b5afad0-kube-api-access-xn9pz\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.249812 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.249790    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" path="/var/lib/kubelet/pods/e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f/volumes"
Sep 11 13:36:34.350139 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.350096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-maas-api-tls\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.350139 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.350149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-metrics-certs\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.350367 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.350166    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9pz\" (UniqueName: \"kubernetes.io/projected/35e07a67-e9ee-4b11-b7df-382b7b5afad0-kube-api-access-xn9pz\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.350367 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.350209    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e07a67-e9ee-4b11-b7df-382b7b5afad0-openshift-service-ca\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.350818 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.350796    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e07a67-e9ee-4b11-b7df-382b7b5afad0-openshift-service-ca\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.352763 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.352738    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-maas-api-tls\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.352871 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.352787    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-metrics-certs\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.362180 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.362150    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9pz\" (UniqueName: \"kubernetes.io/projected/35e07a67-e9ee-4b11-b7df-382b7b5afad0-kube-api-access-xn9pz\") pod \"maas-api-e2e-ait-db87970d-7645759d6d-2dq54\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.479123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.479038    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:34.769433 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:34.769391    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"]
Sep 11 13:36:34.772015 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:36:34.771979    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e07a67_e9ee_4b11_b7df_382b7b5afad0.slice/crio-dcc5244340b37ebee310dd62543214e4413548d413d1f6771eee3c1dccf9397f WatchSource:0}: Error finding container dcc5244340b37ebee310dd62543214e4413548d413d1f6771eee3c1dccf9397f: Status 404 returned error can't find the container with id dcc5244340b37ebee310dd62543214e4413548d413d1f6771eee3c1dccf9397f
Sep 11 13:36:35.644199 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:35.644158    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54" event={"ID":"35e07a67-e9ee-4b11-b7df-382b7b5afad0","Type":"ContainerStarted","Data":"82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0"}
Sep 11 13:36:35.644570 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:35.644216    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54" event={"ID":"35e07a67-e9ee-4b11-b7df-382b7b5afad0","Type":"ContainerStarted","Data":"dcc5244340b37ebee310dd62543214e4413548d413d1f6771eee3c1dccf9397f"}
Sep 11 13:36:35.644570 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:35.644272    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:41.634226 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:41.634165    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54" podStartSLOduration=7.280088316 podStartE2EDuration="7.634146862s" totalImagesPullingTime="354.058546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:36:35.67242911 +0000 UTC m=+1011.884972911" watchObservedRunningTime="2026-09-11 13:36:41.634146862 +0000 UTC m=+1017.846690715"
Sep 11 13:36:41.635401 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:41.635381    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:36:41.656273 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:41.656238    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:36:52.751624 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:52.751559    2547 generic.go:356] "Generic (PLEG): container finished" podID="840657d4-0847-4578-9fa5-86295a9c5287" containerID="e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27" exitCode=0
Sep 11 13:36:52.752065 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:52.751628    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" event={"ID":"840657d4-0847-4578-9fa5-86295a9c5287","Type":"ContainerDied","Data":"e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"}
Sep 11 13:36:52.752110 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:52.752085    2547 scope.go:117] "RemoveContainer" containerID="e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"
Sep 11 13:36:52.753252 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:52.753220    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:52.753348 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:52.753297    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:52.753348 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:52.753328    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:36:53.760603 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:53.760559    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" event={"ID":"840657d4-0847-4578-9fa5-86295a9c5287","Type":"ContainerStarted","Data":"73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a"}
Sep 11 13:36:53.959588 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:53.959551    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:53.959814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:53.959790    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 13:36:53.959939 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:53.959865    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 13:36:54.959763 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:54.959730    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 13:36:54.960228 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:54.959785    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 13:36:55.959994 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:55.959958    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 13:36:55.960415 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:55.960027    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 13:36:56.959653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:56.959616    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 13:36:56.959839 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:56.959672    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 13:36:57.959407 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:57.959366    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 13:36:57.959828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:57.959426    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 13:36:58.959106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:58.959067    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 11 13:36:58.959312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:58.959128    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 11 13:36:59.963953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:59.963893    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:59.964437 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:59.964202    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:36:59.964848 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:36:59.964830    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:37:00.622145 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:00.622104    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:37:12.227434 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.227398    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"]
Sep 11 13:37:12.228029 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.227607    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54" podUID="35e07a67-e9ee-4b11-b7df-382b7b5afad0" containerName="maas-api" containerID="cri-o://82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0" gracePeriod=30
Sep 11 13:37:12.483716 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.483646    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:37:12.543207 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.543174    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn9pz\" (UniqueName: \"kubernetes.io/projected/35e07a67-e9ee-4b11-b7df-382b7b5afad0-kube-api-access-xn9pz\") pod \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") "
Sep 11 13:37:12.543419 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.543240    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-maas-api-tls\") pod \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") "
Sep 11 13:37:12.543419 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.543299    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e07a67-e9ee-4b11-b7df-382b7b5afad0-openshift-service-ca\") pod \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") "
Sep 11 13:37:12.543419 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.543321    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-metrics-certs\") pod \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\" (UID: \"35e07a67-e9ee-4b11-b7df-382b7b5afad0\") "
Sep 11 13:37:12.543688 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.543655    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e07a67-e9ee-4b11-b7df-382b7b5afad0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35e07a67-e9ee-4b11-b7df-382b7b5afad0" (UID: "35e07a67-e9ee-4b11-b7df-382b7b5afad0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:37:12.545496 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.545473    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35e07a67-e9ee-4b11-b7df-382b7b5afad0" (UID: "35e07a67-e9ee-4b11-b7df-382b7b5afad0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:12.545609 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.545487    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e07a67-e9ee-4b11-b7df-382b7b5afad0-kube-api-access-xn9pz" (OuterVolumeSpecName: "kube-api-access-xn9pz") pod "35e07a67-e9ee-4b11-b7df-382b7b5afad0" (UID: "35e07a67-e9ee-4b11-b7df-382b7b5afad0"). InnerVolumeSpecName "kube-api-access-xn9pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:12.545609 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.545490    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "35e07a67-e9ee-4b11-b7df-382b7b5afad0" (UID: "35e07a67-e9ee-4b11-b7df-382b7b5afad0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:12.644424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.644390    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35e07a67-e9ee-4b11-b7df-382b7b5afad0-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:12.644424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.644421    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:12.644424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.644433    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn9pz\" (UniqueName: \"kubernetes.io/projected/35e07a67-e9ee-4b11-b7df-382b7b5afad0-kube-api-access-xn9pz\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:12.644663 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.644442    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35e07a67-e9ee-4b11-b7df-382b7b5afad0-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:12.884029 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.883978    2547 generic.go:356] "Generic (PLEG): container finished" podID="35e07a67-e9ee-4b11-b7df-382b7b5afad0" containerID="82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0" exitCode=0
Sep 11 13:37:12.884029 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.884026    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"
Sep 11 13:37:12.884241 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.884063    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54" event={"ID":"35e07a67-e9ee-4b11-b7df-382b7b5afad0","Type":"ContainerDied","Data":"82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0"}
Sep 11 13:37:12.884241 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.884126    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54" event={"ID":"35e07a67-e9ee-4b11-b7df-382b7b5afad0","Type":"ContainerDied","Data":"dcc5244340b37ebee310dd62543214e4413548d413d1f6771eee3c1dccf9397f"}
Sep 11 13:37:12.884241 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.884148    2547 scope.go:117] "RemoveContainer" containerID="82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0"
Sep 11 13:37:12.894203 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.894180    2547 scope.go:117] "RemoveContainer" containerID="82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0"
Sep 11 13:37:12.894512 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:12.894492    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0\": container with ID starting with 82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0 not found: ID does not exist" containerID="82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0"
Sep 11 13:37:12.894601 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.894522    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0"} err="failed to get container status \"82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0\": rpc error: code = NotFound desc = could not find container \"82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0\": container with ID starting with 82697f888583830e74c2729f827a5a1055652e3f247af1d1fb064df8d475cce0 not found: ID does not exist"
Sep 11 13:37:12.924656 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.924619    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"]
Sep 11 13:37:12.936888 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:12.936846    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-db87970d-7645759d6d-2dq54"]
Sep 11 13:37:13.877480 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:13.877450    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"]
Sep 11 13:37:13.877852 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:13.877667    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" containerID="cri-o://73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a" gracePeriod=30
Sep 11 13:37:14.249355 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:14.249270    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e07a67-e9ee-4b11-b7df-382b7b5afad0" path="/var/lib/kubelet/pods/35e07a67-e9ee-4b11-b7df-382b7b5afad0/volumes"
Sep 11 13:37:14.966780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:14.966744    2547 patch_prober.go:28] interesting pod/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 11 13:37:14.967220 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:14.966836    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:37:15.504365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:15.504329    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"]
Sep 11 13:37:19.134057 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.134027    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:37:19.212348 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212255    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-istio-token\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212348 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212344    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-envoy\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212370    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-socket\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212389    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r68b4\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-kube-api-access-r68b4\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212407    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-credential-socket\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212428    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840657d4-0847-4578-9fa5-86295a9c5287-istiod-ca-cert\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212492    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840657d4-0847-4578-9fa5-86295a9c5287-istio-podinfo\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212512    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-data\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212529    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-certs\") pod \"840657d4-0847-4578-9fa5-86295a9c5287\" (UID: \"840657d4-0847-4578-9fa5-86295a9c5287\") "
Sep 11 13:37:19.212958 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212740    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:19.212958 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212836    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-data" (OuterVolumeSpecName: "istio-data") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:19.213077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212949    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:19.213077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.212975    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:19.213077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.213061    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/840657d4-0847-4578-9fa5-86295a9c5287-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:37:19.214714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.214684    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/840657d4-0847-4578-9fa5-86295a9c5287-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:37:19.214817 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.214736    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-istio-token" (OuterVolumeSpecName: "istio-token") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:19.214996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.214974    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:19.215080 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.214990    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-kube-api-access-r68b4" (OuterVolumeSpecName: "kube-api-access-r68b4") pod "840657d4-0847-4578-9fa5-86295a9c5287" (UID: "840657d4-0847-4578-9fa5-86295a9c5287"). InnerVolumeSpecName "kube-api-access-r68b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:19.313309 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313269    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/840657d4-0847-4578-9fa5-86295a9c5287-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313309 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313303    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313325    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313334    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313341    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313349    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313357    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r68b4\" (UniqueName: \"kubernetes.io/projected/840657d4-0847-4578-9fa5-86295a9c5287-kube-api-access-r68b4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313367    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/840657d4-0847-4578-9fa5-86295a9c5287-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.313524 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.313376    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/840657d4-0847-4578-9fa5-86295a9c5287-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:19.926893 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.926853    2547 generic.go:356] "Generic (PLEG): container finished" podID="840657d4-0847-4578-9fa5-86295a9c5287" containerID="73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a" exitCode=0
Sep 11 13:37:19.927093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.926906    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" event={"ID":"840657d4-0847-4578-9fa5-86295a9c5287","Type":"ContainerDied","Data":"73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a"}
Sep 11 13:37:19.927093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.926977    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5" event={"ID":"840657d4-0847-4578-9fa5-86295a9c5287","Type":"ContainerDied","Data":"06622321f6548522a3a14e81987001e8d63350f65ead7ba2fbcc68475ffe92f6"}
Sep 11 13:37:19.927093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.926998    2547 scope.go:117] "RemoveContainer" containerID="73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a"
Sep 11 13:37:19.927093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.926904    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"
Sep 11 13:37:19.938757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.938734    2547 scope.go:117] "RemoveContainer" containerID="e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"
Sep 11 13:37:19.948346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.948326    2547 scope.go:117] "RemoveContainer" containerID="73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a"
Sep 11 13:37:19.948693 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:19.948672    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a\": container with ID starting with 73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a not found: ID does not exist" containerID="73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a"
Sep 11 13:37:19.948733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.948702    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a"} err="failed to get container status \"73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a\": rpc error: code = NotFound desc = could not find container \"73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a\": container with ID starting with 73f19a5c7133f0b2d21e750c5ce4e1d36602d10a1b05c9c8c39f27aa0a17925a not found: ID does not exist"
Sep 11 13:37:19.948733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.948719    2547 scope.go:117] "RemoveContainer" containerID="e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"
Sep 11 13:37:19.948992 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:19.948974    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27\": container with ID starting with e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27 not found: ID does not exist" containerID="e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"
Sep 11 13:37:19.949036 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.948999    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27"} err="failed to get container status \"e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27\": rpc error: code = NotFound desc = could not find container \"e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27\": container with ID starting with e1cd5e1c3a72f1a337ef488020cbb49538092fdffda2db28a3940fedc61ffc27 not found: ID does not exist"
Sep 11 13:37:19.971385 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.971352    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"]
Sep 11 13:37:19.983354 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:19.983328    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-db87970d-openshift-default-6c4d948b78-9c8x5"]
Sep 11 13:37:20.249103 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:20.249024    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840657d4-0847-4578-9fa5-86295a9c5287" path="/var/lib/kubelet/pods/840657d4-0847-4578-9fa5-86295a9c5287/volumes"
Sep 11 13:37:20.366398 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:20.366358    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:37:21.038329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038292    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"]
Sep 11 13:37:21.038674 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038662    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e07a67-e9ee-4b11-b7df-382b7b5afad0" containerName="maas-api"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038676    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e07a67-e9ee-4b11-b7df-382b7b5afad0" containerName="maas-api"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038685    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038691    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ce8b8c-19d1-40a7-bfad-7fb57e49f74f" containerName="istio-proxy"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038701    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038707    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038713    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy"
Sep 11 13:37:21.038733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038719    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy"
Sep 11 13:37:21.039104 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038775    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e07a67-e9ee-4b11-b7df-382b7b5afad0" containerName="maas-api"
Sep 11 13:37:21.039104 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.038786    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy"
Sep 11 13:37:21.043519 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.043489    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.047055 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.047032    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-344409b9-serving-cert\""
Sep 11 13:37:21.060574 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.060545    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"]
Sep 11 13:37:21.130940 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.130877    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2dng\" (UniqueName: \"kubernetes.io/projected/2ea36552-0769-417b-8d39-0fd2adc19f82-kube-api-access-f2dng\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.131106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.130990    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-maas-api-tls\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.131106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.131044    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea36552-0769-417b-8d39-0fd2adc19f82-openshift-service-ca\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.131106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.131073    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-metrics-certs\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.232576 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.232536    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea36552-0769-417b-8d39-0fd2adc19f82-openshift-service-ca\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.232771 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.232585    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-metrics-certs\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.232771 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.232627    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2dng\" (UniqueName: \"kubernetes.io/projected/2ea36552-0769-417b-8d39-0fd2adc19f82-kube-api-access-f2dng\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.232771 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.232660    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-maas-api-tls\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.233387 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.233362    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea36552-0769-417b-8d39-0fd2adc19f82-openshift-service-ca\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.235214 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.235182    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-metrics-certs\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.235341 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.235281    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-maas-api-tls\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.245907 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.245872    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2dng\" (UniqueName: \"kubernetes.io/projected/2ea36552-0769-417b-8d39-0fd2adc19f82-kube-api-access-f2dng\") pod \"maas-api-e2e-derive-344409b9-579d65b467-sf9z8\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.356625 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.356536    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:21.620150 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.620051    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"]
Sep 11 13:37:21.620734 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.620677    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy" containerID="cri-o://46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3" gracePeriod=30
Sep 11 13:37:21.638082 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.638051    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"]
Sep 11 13:37:21.640175 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:37:21.640148    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea36552_0769_417b_8d39_0fd2adc19f82.slice/crio-466d511f997e1780565e17e6a9e3d18a9f6ad360209cc0b27d9e344740c4c2a8 WatchSource:0}: Error finding container 466d511f997e1780565e17e6a9e3d18a9f6ad360209cc0b27d9e344740c4c2a8: Status 404 returned error can't find the container with id 466d511f997e1780565e17e6a9e3d18a9f6ad360209cc0b27d9e344740c4c2a8
Sep 11 13:37:21.941126 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:21.941075    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8" event={"ID":"2ea36552-0769-417b-8d39-0fd2adc19f82","Type":"ContainerStarted","Data":"466d511f997e1780565e17e6a9e3d18a9f6ad360209cc0b27d9e344740c4c2a8"}
Sep 11 13:37:22.949296 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:22.949249    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8" event={"ID":"2ea36552-0769-417b-8d39-0fd2adc19f82","Type":"ContainerStarted","Data":"e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e"}
Sep 11 13:37:22.949818 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:22.949357    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:22.972872 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:22.972801    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8" podStartSLOduration=1.587705888 podStartE2EDuration="1.972777209s" totalImagesPullingTime="385.071321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:37:22.972336656 +0000 UTC m=+1059.184880463" watchObservedRunningTime="2026-09-11 13:37:22.972777209 +0000 UTC m=+1059.185321011"
Sep 11 13:37:26.879373 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.879344    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:37:26.975158 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.975059    2547 generic.go:356] "Generic (PLEG): container finished" podID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerID="46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3" exitCode=0
Sep 11 13:37:26.975158 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.975112    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"
Sep 11 13:37:26.975158 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.975151    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" event={"ID":"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd","Type":"ContainerDied","Data":"46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3"}
Sep 11 13:37:26.975389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.975204    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx" event={"ID":"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd","Type":"ContainerDied","Data":"c9c50d1c427ccc14f99e55e0d0a154a6af9be55ed79ab97d2267a7c9965ea783"}
Sep 11 13:37:26.975389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.975229    2547 scope.go:117] "RemoveContainer" containerID="46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3"
Sep 11 13:37:26.984294 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.984278    2547 scope.go:117] "RemoveContainer" containerID="6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"
Sep 11 13:37:26.988662 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988636    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nf7r\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-kube-api-access-9nf7r\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.988809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988697    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-socket\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.988809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988752    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-podinfo\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.988809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988776    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-certs\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.988809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988803    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-token\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.989131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988847    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-envoy\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.989131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988885    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-data\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.989131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.988938    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-credential-socket\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.989131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989107    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:26.989346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989165    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istiod-ca-cert\") pod \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\" (UID: \"d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd\") "
Sep 11 13:37:26.989346 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989327    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:26.989453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989348    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:26.989509 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989445    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:26.989735 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989710    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:37:26.989904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989890    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:26.989904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989906    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:26.990062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989934    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:26.990062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989947    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:26.990062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.989956    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:26.991353 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.991328    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-kube-api-access-9nf7r" (OuterVolumeSpecName: "kube-api-access-9nf7r") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "kube-api-access-9nf7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:26.991518 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.991497    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:37:26.991594 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.991524    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:26.991683 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.991667    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" (UID: "d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:26.994055 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.994034    2547 scope.go:117] "RemoveContainer" containerID="46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3"
Sep 11 13:37:26.994414 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:26.994394    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3\": container with ID starting with 46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3 not found: ID does not exist" containerID="46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3"
Sep 11 13:37:26.994460 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.994424    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3"} err="failed to get container status \"46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3\": rpc error: code = NotFound desc = could not find container \"46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3\": container with ID starting with 46413270fb37ca8ec4aa2856df38f8bb75a96eb1763f097c05c7bdb02cb95fa3 not found: ID does not exist"
Sep 11 13:37:26.994460 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.994443    2547 scope.go:117] "RemoveContainer" containerID="6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"
Sep 11 13:37:26.994734 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:26.994716    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1\": container with ID starting with 6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1 not found: ID does not exist" containerID="6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"
Sep 11 13:37:26.994798 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:26.994748    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1"} err="failed to get container status \"6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1\": rpc error: code = NotFound desc = could not find container \"6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1\": container with ID starting with 6ac47e000ccdab9e4a56949a2086a6c168441fe30c98e0596cb23aec71e5d6e1 not found: ID does not exist"
Sep 11 13:37:27.091067 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:27.091031    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nf7r\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-kube-api-access-9nf7r\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:27.091067 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:27.091064    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:27.091067 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:27.091079    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:27.091306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:27.091087    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:27.316733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:27.313657    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"]
Sep 11 13:37:27.322098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:27.322052    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-a61c70-openshift-default-85df847998-js5bx"]
Sep 11 13:37:28.251589 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:28.251540    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" path="/var/lib/kubelet/pods/d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd/volumes"
Sep 11 13:37:28.961811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:28.961780    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:29.887301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887269    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"]
Sep 11 13:37:29.887689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887640    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy"
Sep 11 13:37:29.887689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887652    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy"
Sep 11 13:37:29.887689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887665    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy"
Sep 11 13:37:29.887689 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887670    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy"
Sep 11 13:37:29.887830 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887739    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="840657d4-0847-4578-9fa5-86295a9c5287" containerName="istio-proxy"
Sep 11 13:37:29.887830 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.887748    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy"
Sep 11 13:37:29.892294 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.892271    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:29.895192 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.895168    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-cdac79-serving-cert\""
Sep 11 13:37:29.904013 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:29.903984    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"]
Sep 11 13:37:30.019597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.019562    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-maas-api-tls\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.019597 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.019601    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-metrics-certs\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.019829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.019638    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92c9d587-36c8-430d-ac2f-888da7d39c53-openshift-service-ca\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.019829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.019660    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld4bj\" (UniqueName: \"kubernetes.io/projected/92c9d587-36c8-430d-ac2f-888da7d39c53-kube-api-access-ld4bj\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.121303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.121265    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-maas-api-tls\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.121303 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.121312    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-metrics-certs\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.121559 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.121367    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92c9d587-36c8-430d-ac2f-888da7d39c53-openshift-service-ca\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.121559 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.121400    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld4bj\" (UniqueName: \"kubernetes.io/projected/92c9d587-36c8-430d-ac2f-888da7d39c53-kube-api-access-ld4bj\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.122127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.122102    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92c9d587-36c8-430d-ac2f-888da7d39c53-openshift-service-ca\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.123897 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.123878    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-maas-api-tls\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.123976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.123887    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-metrics-certs\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.131903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.131874    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld4bj\" (UniqueName: \"kubernetes.io/projected/92c9d587-36c8-430d-ac2f-888da7d39c53-kube-api-access-ld4bj\") pod \"maas-api-e2e-explicit-cdac79-55749bcf8-s67kx\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.204649 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.204556    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:30.483939 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.483897    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"]
Sep 11 13:37:30.485678 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:37:30.485652    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c9d587_36c8_430d_ac2f_888da7d39c53.slice/crio-07afcc036c03987dc06bac7025e336779fbf4d0a1280e7d320b796e302cad734 WatchSource:0}: Error finding container 07afcc036c03987dc06bac7025e336779fbf4d0a1280e7d320b796e302cad734: Status 404 returned error can't find the container with id 07afcc036c03987dc06bac7025e336779fbf4d0a1280e7d320b796e302cad734
Sep 11 13:37:30.523888 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.523830    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd" podUID="8ba41d62-524a-4624-aef9-59266f2d2b90" containerName="main" containerID="cri-o://2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1" gracePeriod=45
Sep 11 13:37:30.759055 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.759025    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:37:30.871989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.871958    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"]
Sep 11 13:37:30.872328 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.872316    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba41d62-524a-4624-aef9-59266f2d2b90" containerName="main"
Sep 11 13:37:30.872381 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.872330    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba41d62-524a-4624-aef9-59266f2d2b90" containerName="main"
Sep 11 13:37:30.872418 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.872404    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ac8eb9-bffa-4ff7-ab98-156bf147c3cd" containerName="istio-proxy"
Sep 11 13:37:30.872418 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.872414    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba41d62-524a-4624-aef9-59266f2d2b90" containerName="main"
Sep 11 13:37:30.876814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.876788    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:30.880561 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.880477    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-cdac79-dockercfg-6jcrc\""
Sep 11 13:37:30.880694 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.880670    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-cdac79\""
Sep 11 13:37:30.915057 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.915025    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"]
Sep 11 13:37:30.929881 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.929846    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-model-cache\") pod \"8ba41d62-524a-4624-aef9-59266f2d2b90\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") "
Sep 11 13:37:30.930086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.929893    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w28m5\" (UniqueName: \"kubernetes.io/projected/8ba41d62-524a-4624-aef9-59266f2d2b90-kube-api-access-w28m5\") pod \"8ba41d62-524a-4624-aef9-59266f2d2b90\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") "
Sep 11 13:37:30.930086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.929967    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba41d62-524a-4624-aef9-59266f2d2b90-tls-certs\") pod \"8ba41d62-524a-4624-aef9-59266f2d2b90\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") "
Sep 11 13:37:30.930086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930057    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-tmp-dir\") pod \"8ba41d62-524a-4624-aef9-59266f2d2b90\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") "
Sep 11 13:37:30.930256 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930127    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-dshm\") pod \"8ba41d62-524a-4624-aef9-59266f2d2b90\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") "
Sep 11 13:37:30.930256 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930222    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-home\") pod \"8ba41d62-524a-4624-aef9-59266f2d2b90\" (UID: \"8ba41d62-524a-4624-aef9-59266f2d2b90\") "
Sep 11 13:37:30.930354 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930236    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ba41d62-524a-4624-aef9-59266f2d2b90" (UID: "8ba41d62-524a-4624-aef9-59266f2d2b90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:30.930404 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930387    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ba41d62-524a-4624-aef9-59266f2d2b90" (UID: "8ba41d62-524a-4624-aef9-59266f2d2b90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:30.930561 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930533    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-home" (OuterVolumeSpecName: "home") pod "8ba41d62-524a-4624-aef9-59266f2d2b90" (UID: "8ba41d62-524a-4624-aef9-59266f2d2b90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:30.930692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930610    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-model-cache\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:30.930692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.930629    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-tmp-dir\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:30.932320 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.932299    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba41d62-524a-4624-aef9-59266f2d2b90-kube-api-access-w28m5" (OuterVolumeSpecName: "kube-api-access-w28m5") pod "8ba41d62-524a-4624-aef9-59266f2d2b90" (UID: "8ba41d62-524a-4624-aef9-59266f2d2b90"). InnerVolumeSpecName "kube-api-access-w28m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:30.932542 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.932524    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ba41d62-524a-4624-aef9-59266f2d2b90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ba41d62-524a-4624-aef9-59266f2d2b90" (UID: "8ba41d62-524a-4624-aef9-59266f2d2b90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:30.932636 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.932554    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-dshm" (OuterVolumeSpecName: "dshm") pod "8ba41d62-524a-4624-aef9-59266f2d2b90" (UID: "8ba41d62-524a-4624-aef9-59266f2d2b90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:37:30.970179 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.970145    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"]
Sep 11 13:37:30.973954 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:30.973931    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.001353 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.001252    2547 generic.go:356] "Generic (PLEG): container finished" podID="8ba41d62-524a-4624-aef9-59266f2d2b90" containerID="2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1" exitCode=0
Sep 11 13:37:31.001353 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.001301    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"
Sep 11 13:37:31.001581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.001359    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd" event={"ID":"8ba41d62-524a-4624-aef9-59266f2d2b90","Type":"ContainerDied","Data":"2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1"}
Sep 11 13:37:31.001581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.001398    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd" event={"ID":"8ba41d62-524a-4624-aef9-59266f2d2b90","Type":"ContainerDied","Data":"107c771d4d52c02061400255de2e802c50152434584cf30ead55f21059804bef"}
Sep 11 13:37:31.001581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.001422    2547 scope.go:117] "RemoveContainer" containerID="2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1"
Sep 11 13:37:31.004079 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.004054    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"]
Sep 11 13:37:31.004288 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.004254    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx" event={"ID":"92c9d587-36c8-430d-ac2f-888da7d39c53","Type":"ContainerStarted","Data":"bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98"}
Sep 11 13:37:31.004454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.004310    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx" event={"ID":"92c9d587-36c8-430d-ac2f-888da7d39c53","Type":"ContainerStarted","Data":"07afcc036c03987dc06bac7025e336779fbf4d0a1280e7d320b796e302cad734"}
Sep 11 13:37:31.004454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.004351    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:31.015203 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.015177    2547 scope.go:117] "RemoveContainer" containerID="2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1"
Sep 11 13:37:31.015860 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:31.015825    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1\": container with ID starting with 2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1 not found: ID does not exist" containerID="2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1"
Sep 11 13:37:31.016000 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.015875    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1"} err="failed to get container status \"2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1\": rpc error: code = NotFound desc = could not find container \"2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1\": container with ID starting with 2ec4bfb83752660dda1c437f8146101e730b75cc3ec8ef250e059eb7ede9bda1 not found: ID does not exist"
Sep 11 13:37:31.032029 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.031990    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4cn\" (UniqueName: \"kubernetes.io/projected/c8f7f641-ea02-450f-942f-1b0fc0478dd1-kube-api-access-xz4cn\") pod \"payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.032198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032042    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7f641-ea02-450f-942f-1b0fc0478dd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.032198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032087    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjf9d\" (UniqueName: \"kubernetes.io/projected/0b485cfb-00d2-455e-b0ea-322fefb46bb4-kube-api-access-xjf9d\") pod \"payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") " pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.032279 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032205    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b485cfb-00d2-455e-b0ea-322fefb46bb4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") " pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.032329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032275    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-home\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:31.032329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032295    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w28m5\" (UniqueName: \"kubernetes.io/projected/8ba41d62-524a-4624-aef9-59266f2d2b90-kube-api-access-w28m5\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:31.032329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032309    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba41d62-524a-4624-aef9-59266f2d2b90-tls-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:31.032329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.032319    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ba41d62-524a-4624-aef9-59266f2d2b90-dshm\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:31.049308 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.049271    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"]
Sep 11 13:37:31.055528 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.055499    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-b386d576-kserve-5f584dbbc6-5nlkd"]
Sep 11 13:37:31.077925 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.077850    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx" podStartSLOduration=1.7524157599999999 podStartE2EDuration="2.077833154s" totalImagesPullingTime="325.417394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:37:31.074326982 +0000 UTC m=+1067.286870796" watchObservedRunningTime="2026-09-11 13:37:31.077833154 +0000 UTC m=+1067.290376975"
Sep 11 13:37:31.132792 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.132753    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4cn\" (UniqueName: \"kubernetes.io/projected/c8f7f641-ea02-450f-942f-1b0fc0478dd1-kube-api-access-xz4cn\") pod \"payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.132903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.132796    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7f641-ea02-450f-942f-1b0fc0478dd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.132903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.132834    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjf9d\" (UniqueName: \"kubernetes.io/projected/0b485cfb-00d2-455e-b0ea-322fefb46bb4-kube-api-access-xjf9d\") pod \"payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") " pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.132903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.132871    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b485cfb-00d2-455e-b0ea-322fefb46bb4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") " pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.133663 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.133635    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b485cfb-00d2-455e-b0ea-322fefb46bb4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") " pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.133762 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.133689    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7f641-ea02-450f-942f-1b0fc0478dd1-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.142580 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.142551    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjf9d\" (UniqueName: \"kubernetes.io/projected/0b485cfb-00d2-455e-b0ea-322fefb46bb4-kube-api-access-xjf9d\") pod \"payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") " pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.142694 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.142551    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4cn\" (UniqueName: \"kubernetes.io/projected/c8f7f641-ea02-450f-942f-1b0fc0478dd1-kube-api-access-xz4cn\") pod \"payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.189471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.189433    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:31.284339 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.284240    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:31.484107 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:37:31.484073    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f7f641_ea02_450f_942f_1b0fc0478dd1.slice/crio-3ade5eea5aa609bdf28b90512c7ff416c322b9dd3b9111111bccec53fcd8f320 WatchSource:0}: Error finding container 3ade5eea5aa609bdf28b90512c7ff416c322b9dd3b9111111bccec53fcd8f320: Status 404 returned error can't find the container with id 3ade5eea5aa609bdf28b90512c7ff416c322b9dd3b9111111bccec53fcd8f320
Sep 11 13:37:31.484980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.484961    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"]
Sep 11 13:37:31.564148 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:31.564120    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"]
Sep 11 13:37:31.565990 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:37:31.565964    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b485cfb_00d2_455e_b0ea_322fefb46bb4.slice/crio-f7d60517278e86ebadf59028fb58482fbd87e1dbcf0c71b5862d044ce413126a WatchSource:0}: Error finding container f7d60517278e86ebadf59028fb58482fbd87e1dbcf0c71b5862d044ce413126a: Status 404 returned error can't find the container with id f7d60517278e86ebadf59028fb58482fbd87e1dbcf0c71b5862d044ce413126a
Sep 11 13:37:32.016707 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:32.016609    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg" event={"ID":"0b485cfb-00d2-455e-b0ea-322fefb46bb4","Type":"ContainerStarted","Data":"f7d60517278e86ebadf59028fb58482fbd87e1dbcf0c71b5862d044ce413126a"}
Sep 11 13:37:32.022547 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:32.022509    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p" event={"ID":"c8f7f641-ea02-450f-942f-1b0fc0478dd1","Type":"ContainerStarted","Data":"3ade5eea5aa609bdf28b90512c7ff416c322b9dd3b9111111bccec53fcd8f320"}
Sep 11 13:37:32.256432 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:32.256335    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba41d62-524a-4624-aef9-59266f2d2b90" path="/var/lib/kubelet/pods/8ba41d62-524a-4624-aef9-59266f2d2b90/volumes"
Sep 11 13:37:34.036488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.036439    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg" event={"ID":"0b485cfb-00d2-455e-b0ea-322fefb46bb4","Type":"ContainerStarted","Data":"fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa"}
Sep 11 13:37:34.036986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.036509    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:34.038249 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.038215    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p" event={"ID":"c8f7f641-ea02-450f-942f-1b0fc0478dd1","Type":"ContainerStarted","Data":"840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55"}
Sep 11 13:37:34.038376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.038273    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:34.058794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.058745    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg" podStartSLOduration=2.421092412 podStartE2EDuration="4.058725494s" totalImagesPullingTime="1.637633082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:37:34.056650486 +0000 UTC m=+1070.269194288" watchObservedRunningTime="2026-09-11 13:37:34.058725494 +0000 UTC m=+1070.271269294"
Sep 11 13:37:34.080836 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.080773    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p" podStartSLOduration=2.367401203 podStartE2EDuration="4.080750566s" totalImagesPullingTime="1.713349363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:37:34.080435698 +0000 UTC m=+1070.292979501" watchObservedRunningTime="2026-09-11 13:37:34.080750566 +0000 UTC m=+1070.293294363"
Sep 11 13:37:34.821966 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:34.821900    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:37:37.028104 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:37.028024    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:37:43.202410 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.202374    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"]
Sep 11 13:37:43.202837 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.202595    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8" podUID="2ea36552-0769-417b-8d39-0fd2adc19f82" containerName="maas-api" containerID="cri-o://e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e" gracePeriod=30
Sep 11 13:37:43.456907 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.456831    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:43.549518 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.549476    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea36552-0769-417b-8d39-0fd2adc19f82-openshift-service-ca\") pod \"2ea36552-0769-417b-8d39-0fd2adc19f82\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") "
Sep 11 13:37:43.549518 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.549520    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2dng\" (UniqueName: \"kubernetes.io/projected/2ea36552-0769-417b-8d39-0fd2adc19f82-kube-api-access-f2dng\") pod \"2ea36552-0769-417b-8d39-0fd2adc19f82\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") "
Sep 11 13:37:43.549761 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.549583    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-maas-api-tls\") pod \"2ea36552-0769-417b-8d39-0fd2adc19f82\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") "
Sep 11 13:37:43.549761 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.549600    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-metrics-certs\") pod \"2ea36552-0769-417b-8d39-0fd2adc19f82\" (UID: \"2ea36552-0769-417b-8d39-0fd2adc19f82\") "
Sep 11 13:37:43.549903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.549872    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ea36552-0769-417b-8d39-0fd2adc19f82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ea36552-0769-417b-8d39-0fd2adc19f82" (UID: "2ea36552-0769-417b-8d39-0fd2adc19f82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:37:43.551802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.551744    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ea36552-0769-417b-8d39-0fd2adc19f82-kube-api-access-f2dng" (OuterVolumeSpecName: "kube-api-access-f2dng") pod "2ea36552-0769-417b-8d39-0fd2adc19f82" (UID: "2ea36552-0769-417b-8d39-0fd2adc19f82"). InnerVolumeSpecName "kube-api-access-f2dng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:37:43.551802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.551770    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2ea36552-0769-417b-8d39-0fd2adc19f82" (UID: "2ea36552-0769-417b-8d39-0fd2adc19f82"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:43.552045 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.551832    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ea36552-0769-417b-8d39-0fd2adc19f82" (UID: "2ea36552-0769-417b-8d39-0fd2adc19f82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:37:43.651297 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.651253    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ea36552-0769-417b-8d39-0fd2adc19f82-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:43.651297 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.651289    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2dng\" (UniqueName: \"kubernetes.io/projected/2ea36552-0769-417b-8d39-0fd2adc19f82-kube-api-access-f2dng\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:43.651297 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.651300    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:43.651297 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:43.651309    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ea36552-0769-417b-8d39-0fd2adc19f82-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:37:44.098766 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.098729    2547 generic.go:356] "Generic (PLEG): container finished" podID="2ea36552-0769-417b-8d39-0fd2adc19f82" containerID="e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e" exitCode=0
Sep 11 13:37:44.098766 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.098769    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"
Sep 11 13:37:44.098974 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.098817    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8" event={"ID":"2ea36552-0769-417b-8d39-0fd2adc19f82","Type":"ContainerDied","Data":"e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e"}
Sep 11 13:37:44.098974 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.098866    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8" event={"ID":"2ea36552-0769-417b-8d39-0fd2adc19f82","Type":"ContainerDied","Data":"466d511f997e1780565e17e6a9e3d18a9f6ad360209cc0b27d9e344740c4c2a8"}
Sep 11 13:37:44.098974 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.098894    2547 scope.go:117] "RemoveContainer" containerID="e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e"
Sep 11 13:37:44.109456 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.109436    2547 scope.go:117] "RemoveContainer" containerID="e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e"
Sep 11 13:37:44.109775 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:37:44.109755    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e\": container with ID starting with e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e not found: ID does not exist" containerID="e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e"
Sep 11 13:37:44.109813 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.109784    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e"} err="failed to get container status \"e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e\": rpc error: code = NotFound desc = could not find container \"e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e\": container with ID starting with e41af399dbab4e63ef752b0321181f6b832fe87c4256ef3f3cdcdda7dcaec18e not found: ID does not exist"
Sep 11 13:37:44.126989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.126953    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"]
Sep 11 13:37:44.135036 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.135006    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-344409b9-579d65b467-sf9z8"]
Sep 11 13:37:44.249467 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:44.249431    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ea36552-0769-417b-8d39-0fd2adc19f82" path="/var/lib/kubelet/pods/2ea36552-0769-417b-8d39-0fd2adc19f82/volumes"
Sep 11 13:37:45.048332 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:45.048302    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:37:45.048545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:45.048383    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:37:54.522099 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:37:54.522065    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:38:09.717398 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:09.717355    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:38:13.618326 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.618280    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"]
Sep 11 13:38:13.618821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.618795    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ea36552-0769-417b-8d39-0fd2adc19f82" containerName="maas-api"
Sep 11 13:38:13.618821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.618812    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ea36552-0769-417b-8d39-0fd2adc19f82" containerName="maas-api"
Sep 11 13:38:13.618900 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.618880    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ea36552-0769-417b-8d39-0fd2adc19f82" containerName="maas-api"
Sep 11 13:38:13.622087 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.622065    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.625329 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.625304    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-cdac79\"/\"openshift-service-ca.crt\""
Sep 11 13:38:13.625512 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.625343    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-cdac79\"/\"kube-root-ca.crt\""
Sep 11 13:38:13.626609 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.626586    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-cdac79\"/\"default-dockercfg-rzvt5\""
Sep 11 13:38:13.626731 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.626675    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-cdac79\"/\"explicit-model-cdac79-kserve-self-signed-certs\""
Sep 11 13:38:13.632708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.632680    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"]
Sep 11 13:38:13.732463 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.732424    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-home\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.732463 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.732468    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tmp-dir\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.732752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.732518    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5mz\" (UniqueName: \"kubernetes.io/projected/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-kube-api-access-mp5mz\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.732752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.732605    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-model-cache\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.732752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.732646    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tls-certs\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.732752 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.732716    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-dshm\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.833996    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-home\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834043    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tmp-dir\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834094    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5mz\" (UniqueName: \"kubernetes.io/projected/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-kube-api-access-mp5mz\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834125    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-model-cache\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834152    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tls-certs\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834193    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-dshm\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834536 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834498    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-home\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834536 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834526    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tmp-dir\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.834609 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.834557    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-model-cache\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.836581 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.836554    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-dshm\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.836828 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.836807    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tls-certs\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.843589 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.843567    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5mz\" (UniqueName: \"kubernetes.io/projected/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-kube-api-access-mp5mz\") pod \"explicit-model-cdac79-kserve-8c4d45fff-nsmhg\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") " pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:13.932465 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:13.932428    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:14.212787 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:14.212753    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"]
Sep 11 13:38:14.214746 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:38:14.214718    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ffacad2_fe7b_4ebd_ac78_6848358ebe9d.slice/crio-638d60300324f905d6260bd14bb955747bd3891056e6935a5ae76cca9b2f327e WatchSource:0}: Error finding container 638d60300324f905d6260bd14bb955747bd3891056e6935a5ae76cca9b2f327e: Status 404 returned error can't find the container with id 638d60300324f905d6260bd14bb955747bd3891056e6935a5ae76cca9b2f327e
Sep 11 13:38:14.280055 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:14.280008    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg" event={"ID":"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d","Type":"ContainerStarted","Data":"638d60300324f905d6260bd14bb955747bd3891056e6935a5ae76cca9b2f327e"}
Sep 11 13:38:15.287041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:15.287003    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg" event={"ID":"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d","Type":"ContainerStarted","Data":"00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719"}
Sep 11 13:38:15.310897 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:15.310840    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg" podStartSLOduration=2.310820701 podStartE2EDuration="2.310820701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:38:15.309181225 +0000 UTC m=+1111.521725029" watchObservedRunningTime="2026-09-11 13:38:15.310820701 +0000 UTC m=+1111.523364501"
Sep 11 13:38:23.933121 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:23.933076    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:23.933609 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:23.933145    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:23.946224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:23.946185    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:24.349614 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:24.349530    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:38.869066 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:38.869027    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"]
Sep 11 13:38:44.144017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:44.143980    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:38:49.715150 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:49.715112    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"]
Sep 11 13:38:49.715696 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:49.715408    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx" podUID="92c9d587-36c8-430d-ac2f-888da7d39c53" containerName="maas-api" containerID="cri-o://bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98" gracePeriod=30
Sep 11 13:38:49.792417 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:49.792376    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"]
Sep 11 13:38:49.792697 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:49.792649    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg" podUID="0b485cfb-00d2-455e-b0ea-322fefb46bb4" containerName="payload-processing" containerID="cri-o://fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa" gracePeriod=30
Sep 11 13:38:49.812550 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:49.812518    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"]
Sep 11 13:38:49.812760 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:49.812740    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p" podUID="c8f7f641-ea02-450f-942f-1b0fc0478dd1" containerName="payload-pre-processing" containerID="cri-o://840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55" gracePeriod=30
Sep 11 13:38:50.053374 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.053347    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:38:50.101729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.101698    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:38:50.110907 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.110873    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:38:50.183312 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183282    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-maas-api-tls\") pod \"92c9d587-36c8-430d-ac2f-888da7d39c53\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") "
Sep 11 13:38:50.183486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183366    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b485cfb-00d2-455e-b0ea-322fefb46bb4-plugins-config-volume\") pod \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") "
Sep 11 13:38:50.183486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183388    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-metrics-certs\") pod \"92c9d587-36c8-430d-ac2f-888da7d39c53\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") "
Sep 11 13:38:50.183486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183408    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92c9d587-36c8-430d-ac2f-888da7d39c53-openshift-service-ca\") pod \"92c9d587-36c8-430d-ac2f-888da7d39c53\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") "
Sep 11 13:38:50.183486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183446    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjf9d\" (UniqueName: \"kubernetes.io/projected/0b485cfb-00d2-455e-b0ea-322fefb46bb4-kube-api-access-xjf9d\") pod \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\" (UID: \"0b485cfb-00d2-455e-b0ea-322fefb46bb4\") "
Sep 11 13:38:50.183486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183465    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld4bj\" (UniqueName: \"kubernetes.io/projected/92c9d587-36c8-430d-ac2f-888da7d39c53-kube-api-access-ld4bj\") pod \"92c9d587-36c8-430d-ac2f-888da7d39c53\" (UID: \"92c9d587-36c8-430d-ac2f-888da7d39c53\") "
Sep 11 13:38:50.183840 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183790    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c9d587-36c8-430d-ac2f-888da7d39c53-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "92c9d587-36c8-430d-ac2f-888da7d39c53" (UID: "92c9d587-36c8-430d-ac2f-888da7d39c53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:38:50.183840 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.183807    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b485cfb-00d2-455e-b0ea-322fefb46bb4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b485cfb-00d2-455e-b0ea-322fefb46bb4" (UID: "0b485cfb-00d2-455e-b0ea-322fefb46bb4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:38:50.185717 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.185690    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "92c9d587-36c8-430d-ac2f-888da7d39c53" (UID: "92c9d587-36c8-430d-ac2f-888da7d39c53"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:38:50.185835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.185713    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c9d587-36c8-430d-ac2f-888da7d39c53-kube-api-access-ld4bj" (OuterVolumeSpecName: "kube-api-access-ld4bj") pod "92c9d587-36c8-430d-ac2f-888da7d39c53" (UID: "92c9d587-36c8-430d-ac2f-888da7d39c53"). InnerVolumeSpecName "kube-api-access-ld4bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:38:50.186102 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.186074    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "92c9d587-36c8-430d-ac2f-888da7d39c53" (UID: "92c9d587-36c8-430d-ac2f-888da7d39c53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:38:50.186102 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.186094    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b485cfb-00d2-455e-b0ea-322fefb46bb4-kube-api-access-xjf9d" (OuterVolumeSpecName: "kube-api-access-xjf9d") pod "0b485cfb-00d2-455e-b0ea-322fefb46bb4" (UID: "0b485cfb-00d2-455e-b0ea-322fefb46bb4"). InnerVolumeSpecName "kube-api-access-xjf9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:38:50.285062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285020    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz4cn\" (UniqueName: \"kubernetes.io/projected/c8f7f641-ea02-450f-942f-1b0fc0478dd1-kube-api-access-xz4cn\") pod \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") "
Sep 11 13:38:50.285266 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285139    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7f641-ea02-450f-942f-1b0fc0478dd1-plugins-config-volume\") pod \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\" (UID: \"c8f7f641-ea02-450f-942f-1b0fc0478dd1\") "
Sep 11 13:38:50.285358 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285344    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.285425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285360    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b485cfb-00d2-455e-b0ea-322fefb46bb4-plugins-config-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.285425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285370    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9d587-36c8-430d-ac2f-888da7d39c53-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.285425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285378    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92c9d587-36c8-430d-ac2f-888da7d39c53-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.285425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285390    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjf9d\" (UniqueName: \"kubernetes.io/projected/0b485cfb-00d2-455e-b0ea-322fefb46bb4-kube-api-access-xjf9d\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.285425 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285403    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld4bj\" (UniqueName: \"kubernetes.io/projected/92c9d587-36c8-430d-ac2f-888da7d39c53-kube-api-access-ld4bj\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.285606 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.285489    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8f7f641-ea02-450f-942f-1b0fc0478dd1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8f7f641-ea02-450f-942f-1b0fc0478dd1" (UID: "c8f7f641-ea02-450f-942f-1b0fc0478dd1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:38:50.287326 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.287295    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f7f641-ea02-450f-942f-1b0fc0478dd1-kube-api-access-xz4cn" (OuterVolumeSpecName: "kube-api-access-xz4cn") pod "c8f7f641-ea02-450f-942f-1b0fc0478dd1" (UID: "c8f7f641-ea02-450f-942f-1b0fc0478dd1"). InnerVolumeSpecName "kube-api-access-xz4cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:38:50.385959 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.385874    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz4cn\" (UniqueName: \"kubernetes.io/projected/c8f7f641-ea02-450f-942f-1b0fc0478dd1-kube-api-access-xz4cn\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.385959 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.385952    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8f7f641-ea02-450f-942f-1b0fc0478dd1-plugins-config-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:50.485397 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.485351    2547 generic.go:356] "Generic (PLEG): container finished" podID="0b485cfb-00d2-455e-b0ea-322fefb46bb4" containerID="fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa" exitCode=0
Sep 11 13:38:50.485613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.485420    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"
Sep 11 13:38:50.485613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.485444    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg" event={"ID":"0b485cfb-00d2-455e-b0ea-322fefb46bb4","Type":"ContainerDied","Data":"fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa"}
Sep 11 13:38:50.485613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.485546    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg" event={"ID":"0b485cfb-00d2-455e-b0ea-322fefb46bb4","Type":"ContainerDied","Data":"f7d60517278e86ebadf59028fb58482fbd87e1dbcf0c71b5862d044ce413126a"}
Sep 11 13:38:50.485613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.485578    2547 scope.go:117] "RemoveContainer" containerID="fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa"
Sep 11 13:38:50.486962 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.486938    2547 generic.go:356] "Generic (PLEG): container finished" podID="92c9d587-36c8-430d-ac2f-888da7d39c53" containerID="bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98" exitCode=0
Sep 11 13:38:50.487090 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.486971    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx" event={"ID":"92c9d587-36c8-430d-ac2f-888da7d39c53","Type":"ContainerDied","Data":"bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98"}
Sep 11 13:38:50.487090 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.487025    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"
Sep 11 13:38:50.487210 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.487028    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx" event={"ID":"92c9d587-36c8-430d-ac2f-888da7d39c53","Type":"ContainerDied","Data":"07afcc036c03987dc06bac7025e336779fbf4d0a1280e7d320b796e302cad734"}
Sep 11 13:38:50.488681 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.488654    2547 generic.go:356] "Generic (PLEG): container finished" podID="c8f7f641-ea02-450f-942f-1b0fc0478dd1" containerID="840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55" exitCode=0
Sep 11 13:38:50.488809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.488718    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"
Sep 11 13:38:50.488809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.488750    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p" event={"ID":"c8f7f641-ea02-450f-942f-1b0fc0478dd1","Type":"ContainerDied","Data":"840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55"}
Sep 11 13:38:50.488809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.488806    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p" event={"ID":"c8f7f641-ea02-450f-942f-1b0fc0478dd1","Type":"ContainerDied","Data":"3ade5eea5aa609bdf28b90512c7ff416c322b9dd3b9111111bccec53fcd8f320"}
Sep 11 13:38:50.496526 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.496506    2547 scope.go:117] "RemoveContainer" containerID="fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa"
Sep 11 13:38:50.496845 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:38:50.496828    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa\": container with ID starting with fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa not found: ID does not exist" containerID="fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa"
Sep 11 13:38:50.496928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.496855    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa"} err="failed to get container status \"fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa\": rpc error: code = NotFound desc = could not find container \"fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa\": container with ID starting with fba9fed18af322c69112f1851d84be5b86d56ee10dc0ab677fee0ee0eb981efa not found: ID does not exist"
Sep 11 13:38:50.496928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.496871    2547 scope.go:117] "RemoveContainer" containerID="bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98"
Sep 11 13:38:50.507121 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.507088    2547 scope.go:117] "RemoveContainer" containerID="bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98"
Sep 11 13:38:50.507506 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:38:50.507474    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98\": container with ID starting with bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98 not found: ID does not exist" containerID="bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98"
Sep 11 13:38:50.507600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.507504    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98"} err="failed to get container status \"bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98\": rpc error: code = NotFound desc = could not find container \"bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98\": container with ID starting with bd47ba4a0124812aea5fbf2d72a2bd6637daa834e9d01cbeca31859c6cfdbc98 not found: ID does not exist"
Sep 11 13:38:50.507600 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.507522    2547 scope.go:117] "RemoveContainer" containerID="840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55"
Sep 11 13:38:50.516365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.516339    2547 scope.go:117] "RemoveContainer" containerID="840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55"
Sep 11 13:38:50.516694 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:38:50.516675    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55\": container with ID starting with 840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55 not found: ID does not exist" containerID="840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55"
Sep 11 13:38:50.516743 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.516700    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55"} err="failed to get container status \"840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55\": rpc error: code = NotFound desc = could not find container \"840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55\": container with ID starting with 840bd47669be723fd18be8b907ececf610f48d62001c96d3bb6fdd14b38b4a55 not found: ID does not exist"
Sep 11 13:38:50.520379 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.520348    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"]
Sep 11 13:38:50.523842 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.523813    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cdac79-55749bcf8-s67kx"]
Sep 11 13:38:50.538759 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.538722    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"]
Sep 11 13:38:50.541867 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.541833    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-cdac79-84f7cfc6b5-lcrjg"]
Sep 11 13:38:50.557924 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.557885    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"]
Sep 11 13:38:50.561685 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:50.561651    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-cdac79-7d68667c98-jvj4p"]
Sep 11 13:38:52.248869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:52.248831    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b485cfb-00d2-455e-b0ea-322fefb46bb4" path="/var/lib/kubelet/pods/0b485cfb-00d2-455e-b0ea-322fefb46bb4/volumes"
Sep 11 13:38:52.249324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:52.249274    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92c9d587-36c8-430d-ac2f-888da7d39c53" path="/var/lib/kubelet/pods/92c9d587-36c8-430d-ac2f-888da7d39c53/volumes"
Sep 11 13:38:52.249608 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:52.249594    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f7f641-ea02-450f-942f-1b0fc0478dd1" path="/var/lib/kubelet/pods/c8f7f641-ea02-450f-942f-1b0fc0478dd1/volumes"
Sep 11 13:38:53.888429 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:53.888390    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg" podUID="3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" containerName="main" containerID="cri-o://00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719" gracePeriod=45
Sep 11 13:38:54.145883 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.145820    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:54.320503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320471    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp5mz\" (UniqueName: \"kubernetes.io/projected/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-kube-api-access-mp5mz\") pod \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") "
Sep 11 13:38:54.320503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320509    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tls-certs\") pod \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") "
Sep 11 13:38:54.320719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320548    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-home\") pod \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") "
Sep 11 13:38:54.320719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320597    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-model-cache\") pod \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") "
Sep 11 13:38:54.320719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320692    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-dshm\") pod \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") "
Sep 11 13:38:54.320719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320718    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tmp-dir\") pod \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\" (UID: \"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d\") "
Sep 11 13:38:54.320957 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320826    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-home" (OuterVolumeSpecName: "home") pod "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" (UID: "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:38:54.321020 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.320977    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" (UID: "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:38:54.321077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.321008    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" (UID: "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:38:54.321077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.321043    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-home\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:54.322810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.322772    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-dshm" (OuterVolumeSpecName: "dshm") pod "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" (UID: "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:38:54.322965 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.322831    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" (UID: "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:38:54.322965 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.322854    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-kube-api-access-mp5mz" (OuterVolumeSpecName: "kube-api-access-mp5mz") pod "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" (UID: "3ffacad2-fe7b-4ebd-ac78-6848358ebe9d"). InnerVolumeSpecName "kube-api-access-mp5mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:38:54.421983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.421883    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp5mz\" (UniqueName: \"kubernetes.io/projected/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-kube-api-access-mp5mz\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:54.421983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.421948    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tls-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:54.421983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.421959    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-model-cache\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:54.421983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.421968    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-dshm\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:54.421983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.421977    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d-tmp-dir\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:38:54.515207 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.515169    2547 generic.go:356] "Generic (PLEG): container finished" podID="3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" containerID="00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719" exitCode=0
Sep 11 13:38:54.515374 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.515217    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"
Sep 11 13:38:54.515374 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.515225    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg" event={"ID":"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d","Type":"ContainerDied","Data":"00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719"}
Sep 11 13:38:54.515374 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.515264    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg" event={"ID":"3ffacad2-fe7b-4ebd-ac78-6848358ebe9d","Type":"ContainerDied","Data":"638d60300324f905d6260bd14bb955747bd3891056e6935a5ae76cca9b2f327e"}
Sep 11 13:38:54.515374 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.515285    2547 scope.go:117] "RemoveContainer" containerID="00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719"
Sep 11 13:38:54.525491 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.525458    2547 scope.go:117] "RemoveContainer" containerID="00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719"
Sep 11 13:38:54.525703 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:38:54.525685    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719\": container with ID starting with 00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719 not found: ID does not exist" containerID="00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719"
Sep 11 13:38:54.525750 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.525710    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719"} err="failed to get container status \"00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719\": rpc error: code = NotFound desc = could not find container \"00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719\": container with ID starting with 00e1a37e155b48a060e375ebc306dc3d4ed339fcbf48aa33aef9387a0d1ea719 not found: ID does not exist"
Sep 11 13:38:54.539459 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.539432    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"]
Sep 11 13:38:54.546015 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.545989    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-cdac79/explicit-model-cdac79-kserve-8c4d45fff-nsmhg"]
Sep 11 13:38:54.838265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:54.838153    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:38:56.249325 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:56.249289    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" path="/var/lib/kubelet/pods/3ffacad2-fe7b-4ebd-ac78-6848358ebe9d/volumes"
Sep 11 13:38:58.228109 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228063    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"]
Sep 11 13:38:58.228606 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228586    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f7f641-ea02-450f-942f-1b0fc0478dd1" containerName="payload-pre-processing"
Sep 11 13:38:58.228678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228610    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f7f641-ea02-450f-942f-1b0fc0478dd1" containerName="payload-pre-processing"
Sep 11 13:38:58.228678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228628    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" containerName="main"
Sep 11 13:38:58.228678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228637    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" containerName="main"
Sep 11 13:38:58.228678 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228670    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c9d587-36c8-430d-ac2f-888da7d39c53" containerName="maas-api"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228679    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c9d587-36c8-430d-ac2f-888da7d39c53" containerName="maas-api"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228689    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b485cfb-00d2-455e-b0ea-322fefb46bb4" containerName="payload-processing"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228698    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b485cfb-00d2-455e-b0ea-322fefb46bb4" containerName="payload-processing"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228791    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f7f641-ea02-450f-942f-1b0fc0478dd1" containerName="payload-pre-processing"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228805    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ffacad2-fe7b-4ebd-ac78-6848358ebe9d" containerName="main"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228817    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b485cfb-00d2-455e-b0ea-322fefb46bb4" containerName="payload-processing"
Sep 11 13:38:58.228884 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.228828    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="92c9d587-36c8-430d-ac2f-888da7d39c53" containerName="maas-api"
Sep 11 13:38:58.233455 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.233431    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.239942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.239904    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:38:58.240108 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.239904    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f94333-openshift-default-dockercfg-jhc48\""
Sep 11 13:38:58.252865 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.252831    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"]
Sep 11 13:38:58.357263 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357215    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-socket\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357348    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-credential-socket\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357393    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-podinfo\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357412    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-token\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357433    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvrx\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-kube-api-access-wmvrx\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357595 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357556    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-envoy\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357630 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357593    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-data\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357666 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357625    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/151f4812-47ba-4508-9709-8cb7c56fdc0a-istiod-ca-cert\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.357714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.357696    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-certs\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458437    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-podinfo\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458474    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-token\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458496    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvrx\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-kube-api-access-wmvrx\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458533    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-envoy\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458553    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-data\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458573    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/151f4812-47ba-4508-9709-8cb7c56fdc0a-istiod-ca-cert\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458604    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-certs\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458621    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-socket\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.458732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.458668    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-credential-socket\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.459152 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.459099    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-data\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.459152 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.459121    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-socket\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.459152 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.459144    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-certs\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.459268 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.459205    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-credential-socket\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.459610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.459586    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/151f4812-47ba-4508-9709-8cb7c56fdc0a-istiod-ca-cert\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.460999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.460978    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-envoy\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.461260 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.461239    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-podinfo\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.470011 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.469974    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-token\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.470444 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.470423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvrx\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-kube-api-access-wmvrx\") pod \"e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") " pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.544813 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.544720    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:38:58.835494 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.835463    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"]
Sep 11 13:38:58.838173 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:38:58.838145    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151f4812_47ba_4508_9709_8cb7c56fdc0a.slice/crio-8b86d0e442b1f170d615f488c7f123d8a029730d08dafa4c97685e21f757cc64 WatchSource:0}: Error finding container 8b86d0e442b1f170d615f488c7f123d8a029730d08dafa4c97685e21f757cc64: Status 404 returned error can't find the container with id 8b86d0e442b1f170d615f488c7f123d8a029730d08dafa4c97685e21f757cc64
Sep 11 13:38:58.840267 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.840235    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:38:58.840334 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.840305    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:38:58.840375 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:58.840334    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:38:59.552077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:59.552038    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" event={"ID":"151f4812-47ba-4508-9709-8cb7c56fdc0a","Type":"ContainerStarted","Data":"4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32"}
Sep 11 13:38:59.552578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:38:59.552131    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" event={"ID":"151f4812-47ba-4508-9709-8cb7c56fdc0a","Type":"ContainerStarted","Data":"8b86d0e442b1f170d615f488c7f123d8a029730d08dafa4c97685e21f757cc64"}
Sep 11 13:39:00.545314 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:00.545274    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:39:00.551057 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:00.551028    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:39:00.557893 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:00.557869    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:39:00.558761 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:00.558739    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:39:00.590848 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:00.590787    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" podStartSLOduration=2.590769768 podStartE2EDuration="2.590769768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:38:59.579884148 +0000 UTC m=+1155.792427951" watchObservedRunningTime="2026-09-11 13:39:00.590769768 +0000 UTC m=+1156.803313602"
Sep 11 13:39:27.317853 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:27.317763    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:39:27.853184 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:27.853143    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"]
Sep 11 13:39:27.853432 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:27.853352    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" podUID="151f4812-47ba-4508-9709-8cb7c56fdc0a" containerName="istio-proxy" containerID="cri-o://4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32" gracePeriod=30
Sep 11 13:39:30.561058 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:30.561016    2547 patch_prober.go:28] interesting pod/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:39:30.561466 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:30.561091    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" podUID="151f4812-47ba-4508-9709-8cb7c56fdc0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:39:33.113789 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.113759    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:39:33.273451 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273413    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-certs\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273451 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273462    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/151f4812-47ba-4508-9709-8cb7c56fdc0a-istiod-ca-cert\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273528    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-podinfo\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273569    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmvrx\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-kube-api-access-wmvrx\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273626    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-envoy\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273693 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273677    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-socket\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273938 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273701    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-token\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273938 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273725    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:33.273938 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273756    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-credential-socket\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.273938 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.273785    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-data\") pod \"151f4812-47ba-4508-9709-8cb7c56fdc0a\" (UID: \"151f4812-47ba-4508-9709-8cb7c56fdc0a\") "
Sep 11 13:39:33.274168 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274006    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/151f4812-47ba-4508-9709-8cb7c56fdc0a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:39:33.274168 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274135    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:33.274301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274274    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:33.274301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274286    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-data" (OuterVolumeSpecName: "istio-data") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:33.274440 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274421    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.274500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274445    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.274500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274459    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.274500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274472    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.274500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.274485    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/151f4812-47ba-4508-9709-8cb7c56fdc0a-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.275983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.275955    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-token" (OuterVolumeSpecName: "istio-token") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:33.276084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.275972    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-kube-api-access-wmvrx" (OuterVolumeSpecName: "kube-api-access-wmvrx") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "kube-api-access-wmvrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:39:33.276084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.275976    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:39:33.276084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.276010    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "151f4812-47ba-4508-9709-8cb7c56fdc0a" (UID: "151f4812-47ba-4508-9709-8cb7c56fdc0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:39:33.374989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.374956    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.374989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.374983    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.374989 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.374993    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmvrx\" (UniqueName: \"kubernetes.io/projected/151f4812-47ba-4508-9709-8cb7c56fdc0a-kube-api-access-wmvrx\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.375234 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.375003    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/151f4812-47ba-4508-9709-8cb7c56fdc0a-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:39:33.748963 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.748894    2547 generic.go:356] "Generic (PLEG): container finished" podID="151f4812-47ba-4508-9709-8cb7c56fdc0a" containerID="4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32" exitCode=0
Sep 11 13:39:33.749181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.748975    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"
Sep 11 13:39:33.749181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.748985    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" event={"ID":"151f4812-47ba-4508-9709-8cb7c56fdc0a","Type":"ContainerDied","Data":"4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32"}
Sep 11 13:39:33.749181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.749045    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx" event={"ID":"151f4812-47ba-4508-9709-8cb7c56fdc0a","Type":"ContainerDied","Data":"8b86d0e442b1f170d615f488c7f123d8a029730d08dafa4c97685e21f757cc64"}
Sep 11 13:39:33.749181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.749068    2547 scope.go:117] "RemoveContainer" containerID="4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32"
Sep 11 13:39:33.759044 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.759023    2547 scope.go:117] "RemoveContainer" containerID="4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32"
Sep 11 13:39:33.759402 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:39:33.759382    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32\": container with ID starting with 4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32 not found: ID does not exist" containerID="4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32"
Sep 11 13:39:33.759460 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.759411    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32"} err="failed to get container status \"4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32\": rpc error: code = NotFound desc = could not find container \"4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32\": container with ID starting with 4e1884394092b71a0adfba3661447f3dc2ce07c61bb7d2fe89806f8a4022ba32 not found: ID does not exist"
Sep 11 13:39:33.777362 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.777324    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"]
Sep 11 13:39:33.784320 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:33.784284    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f94333-openshift-default-6cc66ff4b4-t5tsx"]
Sep 11 13:39:34.248780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:34.248747    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="151f4812-47ba-4508-9709-8cb7c56fdc0a" path="/var/lib/kubelet/pods/151f4812-47ba-4508-9709-8cb7c56fdc0a/volumes"
Sep 11 13:39:38.255296 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.255262    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"]
Sep 11 13:39:38.255813 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.255797    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151f4812-47ba-4508-9709-8cb7c56fdc0a" containerName="istio-proxy"
Sep 11 13:39:38.255858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.255815    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="151f4812-47ba-4508-9709-8cb7c56fdc0a" containerName="istio-proxy"
Sep 11 13:39:38.255942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.255903    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="151f4812-47ba-4508-9709-8cb7c56fdc0a" containerName="istio-proxy"
Sep 11 13:39:38.260727 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.260704    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.270456 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.270429    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-62b0dfd4-openshift-default-dockercfg-ntq5p\""
Sep 11 13:39:38.288332 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.288302    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"]
Sep 11 13:39:38.293261 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.293224    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:39:38.423835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.423776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxz92\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-kube-api-access-bxz92\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.423853    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-credential-socket\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.423887    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-token\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.423907    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-envoy\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.423970    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-data\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.423990    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istiod-ca-cert\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.424007    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-certs\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424269 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.424065    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-socket\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.424269 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.424106    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-podinfo\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525520 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-credential-socket\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525520 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525468    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-token\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525520 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525495    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-envoy\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525533    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-data\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525566    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istiod-ca-cert\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525697    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-certs\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525765    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-socket\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.525823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525795    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-podinfo\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.526115 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.525835    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxz92\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-kube-api-access-bxz92\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.526115 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.526001    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-credential-socket\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.526220 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.526126    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-data\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.526262 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.526212    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-socket\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.526424 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.526399    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istiod-ca-cert\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.526470 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.526436    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-certs\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.528061 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.528035    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-envoy\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.528218 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.528203    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-podinfo\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.539060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.539022    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-token\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.546043 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.546012    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxz92\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-kube-api-access-bxz92\") pod \"e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") " pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.571112 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.571073    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:38.854341 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.854311    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"]
Sep 11 13:39:38.855973 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:39:38.855947    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292f6b11_6ab3_46fb_beb2_5ba0477e3150.slice/crio-a0d4c64e0bea730d9d91ac04a2f1feba84af5d3ccda53d979326c081202bd715 WatchSource:0}: Error finding container a0d4c64e0bea730d9d91ac04a2f1feba84af5d3ccda53d979326c081202bd715: Status 404 returned error can't find the container with id a0d4c64e0bea730d9d91ac04a2f1feba84af5d3ccda53d979326c081202bd715
Sep 11 13:39:38.858099 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.858064    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:39:38.858173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.858137    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:39:38.858173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:38.858166    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:39:39.784811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:39.784772    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" event={"ID":"292f6b11-6ab3-46fb-beb2-5ba0477e3150","Type":"ContainerStarted","Data":"6621d2cac4b3b16da346a83e47e426913584ef7993e943cf51e4e35debce1f02"}
Sep 11 13:39:39.785378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:39.784840    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" event={"ID":"292f6b11-6ab3-46fb-beb2-5ba0477e3150","Type":"ContainerStarted","Data":"a0d4c64e0bea730d9d91ac04a2f1feba84af5d3ccda53d979326c081202bd715"}
Sep 11 13:39:39.806431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:39.806373    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podStartSLOduration=1.806352956 podStartE2EDuration="1.806352956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:39:39.805220546 +0000 UTC m=+1196.017764345" watchObservedRunningTime="2026-09-11 13:39:39.806352956 +0000 UTC m=+1196.018896756"
Sep 11 13:39:40.572195 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:40.572159    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:40.577382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:40.577355    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:40.790906 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:40.790874    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:40.791774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:40.791752    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:39:42.133021 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:42.132987    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:39:43.770096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.770059    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"]
Sep 11 13:39:43.773572 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.773547    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.776770 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.776747    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-62b0dfd4-serving-cert\""
Sep 11 13:39:43.792753 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.792723    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"]
Sep 11 13:39:43.877318 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.877288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-metrics-certs\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.877515 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.877331    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4j4\" (UniqueName: \"kubernetes.io/projected/237efd5c-97dd-450c-8eec-9c3b996d6dc9-kube-api-access-sj4j4\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.877515 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.877486    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.877613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.877545    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237efd5c-97dd-450c-8eec-9c3b996d6dc9-openshift-service-ca\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.978292 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.978243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.978510 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.978313    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237efd5c-97dd-450c-8eec-9c3b996d6dc9-openshift-service-ca\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.978510 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.978358    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-metrics-certs\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.978510 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.978388    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4j4\" (UniqueName: \"kubernetes.io/projected/237efd5c-97dd-450c-8eec-9c3b996d6dc9-kube-api-access-sj4j4\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.978510 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:39:43.978439    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-serving-cert: secret "maas-api-e2e-mt-62b0dfd4-serving-cert" not found
Sep 11 13:39:43.978735 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:39:43.978522    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls podName:237efd5c-97dd-450c-8eec-9c3b996d6dc9 nodeName:}" failed. No retries permitted until 2026-09-11 13:39:44.478496421 +0000 UTC m=+1200.691040200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls") pod "maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" (UID: "237efd5c-97dd-450c-8eec-9c3b996d6dc9") : secret "maas-api-e2e-mt-62b0dfd4-serving-cert" not found
Sep 11 13:39:43.979140 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.979120    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237efd5c-97dd-450c-8eec-9c3b996d6dc9-openshift-service-ca\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.981146 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.981120    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-metrics-certs\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:43.989197 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:43.989165    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4j4\" (UniqueName: \"kubernetes.io/projected/237efd5c-97dd-450c-8eec-9c3b996d6dc9-kube-api-access-sj4j4\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:44.250416 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.250389    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:39:44.254896 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.254864    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:39:44.481971 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.481900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:44.484614 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.484575    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls\") pod \"maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:44.686593 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.686548    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:44.964338 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.964246    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"]
Sep 11 13:39:44.967253 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:39:44.967222    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237efd5c_97dd_450c_8eec_9c3b996d6dc9.slice/crio-06635ebd16bcd80820e278c24e246a541d7a17d8bf31e289f66c16af4dcbfb9e WatchSource:0}: Error finding container 06635ebd16bcd80820e278c24e246a541d7a17d8bf31e289f66c16af4dcbfb9e: Status 404 returned error can't find the container with id 06635ebd16bcd80820e278c24e246a541d7a17d8bf31e289f66c16af4dcbfb9e
Sep 11 13:39:44.968786 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:44.968765    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:39:45.830047 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:45.829942    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" event={"ID":"237efd5c-97dd-450c-8eec-9c3b996d6dc9","Type":"ContainerStarted","Data":"8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75"}
Sep 11 13:39:45.830047 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:45.830036    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" event={"ID":"237efd5c-97dd-450c-8eec-9c3b996d6dc9","Type":"ContainerStarted","Data":"06635ebd16bcd80820e278c24e246a541d7a17d8bf31e289f66c16af4dcbfb9e"}
Sep 11 13:39:45.830279 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:45.830137    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:45.850570 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:45.850515    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" podStartSLOduration=2.390934172 podStartE2EDuration="2.850499074s" totalImagesPullingTime="459.564902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:39:45.849397624 +0000 UTC m=+1202.061941426" watchObservedRunningTime="2026-09-11 13:39:45.850499074 +0000 UTC m=+1202.063042874"
Sep 11 13:39:51.840714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:51.840682    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:39:53.513986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:53.513942    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:39:56.833130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:56.833085    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:39:56.833555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:56.833161    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:39:58.919309 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:58.919272    2547 generic.go:356] "Generic (PLEG): container finished" podID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerID="6621d2cac4b3b16da346a83e47e426913584ef7993e943cf51e4e35debce1f02" exitCode=0
Sep 11 13:39:58.919790 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:58.919352    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" event={"ID":"292f6b11-6ab3-46fb-beb2-5ba0477e3150","Type":"ContainerDied","Data":"6621d2cac4b3b16da346a83e47e426913584ef7993e943cf51e4e35debce1f02"}
Sep 11 13:39:58.919839 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:58.919792    2547 scope.go:117] "RemoveContainer" containerID="6621d2cac4b3b16da346a83e47e426913584ef7993e943cf51e4e35debce1f02"
Sep 11 13:39:58.920970 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:58.920939    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:39:58.921045 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:58.921027    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:39:58.921085 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:58.921060    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:39:59.926725 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:39:59.926691    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" event={"ID":"292f6b11-6ab3-46fb-beb2-5ba0477e3150","Type":"ContainerStarted","Data":"1c1f0d7567cd1228c81727515f4768a91d12cf7ea74ce8009460f9883b356e74"}
Sep 11 13:40:00.571744 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:00.571696    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:40:00.572105 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:00.572075    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:40:00.572224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:00.572140    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 13:40:01.556107 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:01.556073    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"]
Sep 11 13:40:01.556603 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:01.556325    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" podUID="304f7ecc-84da-4c82-840d-1031ff6057af" containerName="maas-api" containerID="cri-o://28e587ccc94c905fb57351bc3704d614d96d47b469d1b822d8829241ea84888d" gracePeriod=30
Sep 11 13:40:01.575937 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:01.572319    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:40:01.575937 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:01.572382    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 13:40:01.946486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:01.946458    2547 generic.go:356] "Generic (PLEG): container finished" podID="304f7ecc-84da-4c82-840d-1031ff6057af" containerID="28e587ccc94c905fb57351bc3704d614d96d47b469d1b822d8829241ea84888d" exitCode=0
Sep 11 13:40:01.946607 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:01.946535    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" event={"ID":"304f7ecc-84da-4c82-840d-1031ff6057af","Type":"ContainerDied","Data":"28e587ccc94c905fb57351bc3704d614d96d47b469d1b822d8829241ea84888d"}
Sep 11 13:40:02.056541 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.056515    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:40:02.157630 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.157599    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-metrics-certs\") pod \"304f7ecc-84da-4c82-840d-1031ff6057af\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") "
Sep 11 13:40:02.157630 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.157636    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls\") pod \"304f7ecc-84da-4c82-840d-1031ff6057af\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") "
Sep 11 13:40:02.157898 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.157702    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjqlk\" (UniqueName: \"kubernetes.io/projected/304f7ecc-84da-4c82-840d-1031ff6057af-kube-api-access-pjqlk\") pod \"304f7ecc-84da-4c82-840d-1031ff6057af\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") "
Sep 11 13:40:02.157898 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.157736    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/304f7ecc-84da-4c82-840d-1031ff6057af-openshift-service-ca\") pod \"304f7ecc-84da-4c82-840d-1031ff6057af\" (UID: \"304f7ecc-84da-4c82-840d-1031ff6057af\") "
Sep 11 13:40:02.158156 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.158131    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304f7ecc-84da-4c82-840d-1031ff6057af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "304f7ecc-84da-4c82-840d-1031ff6057af" (UID: "304f7ecc-84da-4c82-840d-1031ff6057af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:40:02.159823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.159797    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "304f7ecc-84da-4c82-840d-1031ff6057af" (UID: "304f7ecc-84da-4c82-840d-1031ff6057af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:40:02.159945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.159870    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304f7ecc-84da-4c82-840d-1031ff6057af-kube-api-access-pjqlk" (OuterVolumeSpecName: "kube-api-access-pjqlk") pod "304f7ecc-84da-4c82-840d-1031ff6057af" (UID: "304f7ecc-84da-4c82-840d-1031ff6057af"). InnerVolumeSpecName "kube-api-access-pjqlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:40:02.159945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.159882    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "304f7ecc-84da-4c82-840d-1031ff6057af" (UID: "304f7ecc-84da-4c82-840d-1031ff6057af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:40:02.259236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.259211    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjqlk\" (UniqueName: \"kubernetes.io/projected/304f7ecc-84da-4c82-840d-1031ff6057af-kube-api-access-pjqlk\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:02.259236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.259238    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/304f7ecc-84da-4c82-840d-1031ff6057af-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:02.259378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.259248    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:02.259378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.259257    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/304f7ecc-84da-4c82-840d-1031ff6057af-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:02.572017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.571882    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:40:02.572017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.571978    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 13:40:02.953610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.953578    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"
Sep 11 13:40:02.953816 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.953629    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987" event={"ID":"304f7ecc-84da-4c82-840d-1031ff6057af","Type":"ContainerDied","Data":"8e09d2f5b44c914e24f0a3dc61b45df7ae8cb2cd155d5021bcbbb68c925a0a73"}
Sep 11 13:40:02.953816 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.953690    2547 scope.go:117] "RemoveContainer" containerID="28e587ccc94c905fb57351bc3704d614d96d47b469d1b822d8829241ea84888d"
Sep 11 13:40:02.973432 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.973385    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"]
Sep 11 13:40:02.978728 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:02.978679    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bfc5af-667c8b9db6-8s987"]
Sep 11 13:40:03.571796 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:03.571752    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:40:03.572039 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:03.571822    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 13:40:04.249543 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:04.249503    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="304f7ecc-84da-4c82-840d-1031ff6057af" path="/var/lib/kubelet/pods/304f7ecc-84da-4c82-840d-1031ff6057af/volumes"
Sep 11 13:40:04.572081 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:04.571979    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:40:04.572675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:04.572637    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 13:40:04.614927 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:04.614877    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:40:05.571737 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:05.571702    2547 patch_prober.go:28] interesting pod/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 11 13:40:05.571932 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:05.571757    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 11 13:40:06.575309 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:06.575277    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:40:06.575694 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:06.575559    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:40:06.576283 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:06.576262    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:40:14.250879 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.250837    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"]
Sep 11 13:40:14.251422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.251067    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" podUID="237efd5c-97dd-450c-8eec-9c3b996d6dc9" containerName="maas-api" containerID="cri-o://8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75" gracePeriod=30
Sep 11 13:40:14.504059 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.503982    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:40:14.579211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.579165    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-metrics-certs\") pod \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") "
Sep 11 13:40:14.579211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.579222    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj4j4\" (UniqueName: \"kubernetes.io/projected/237efd5c-97dd-450c-8eec-9c3b996d6dc9-kube-api-access-sj4j4\") pod \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") "
Sep 11 13:40:14.579554 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.579274    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls\") pod \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") "
Sep 11 13:40:14.579554 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.579291    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237efd5c-97dd-450c-8eec-9c3b996d6dc9-openshift-service-ca\") pod \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\" (UID: \"237efd5c-97dd-450c-8eec-9c3b996d6dc9\") "
Sep 11 13:40:14.579745 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.579720    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/237efd5c-97dd-450c-8eec-9c3b996d6dc9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "237efd5c-97dd-450c-8eec-9c3b996d6dc9" (UID: "237efd5c-97dd-450c-8eec-9c3b996d6dc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:40:14.581578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.581544    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "237efd5c-97dd-450c-8eec-9c3b996d6dc9" (UID: "237efd5c-97dd-450c-8eec-9c3b996d6dc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:40:14.581578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.581563    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "237efd5c-97dd-450c-8eec-9c3b996d6dc9" (UID: "237efd5c-97dd-450c-8eec-9c3b996d6dc9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:40:14.581787 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.581701    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237efd5c-97dd-450c-8eec-9c3b996d6dc9-kube-api-access-sj4j4" (OuterVolumeSpecName: "kube-api-access-sj4j4") pod "237efd5c-97dd-450c-8eec-9c3b996d6dc9" (UID: "237efd5c-97dd-450c-8eec-9c3b996d6dc9"). InnerVolumeSpecName "kube-api-access-sj4j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:40:14.680596 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.680563    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.680596 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.680594    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj4j4\" (UniqueName: \"kubernetes.io/projected/237efd5c-97dd-450c-8eec-9c3b996d6dc9-kube-api-access-sj4j4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.680596 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.680605    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237efd5c-97dd-450c-8eec-9c3b996d6dc9-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:14.680829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:14.680614    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237efd5c-97dd-450c-8eec-9c3b996d6dc9-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:15.030461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.030426    2547 generic.go:356] "Generic (PLEG): container finished" podID="237efd5c-97dd-450c-8eec-9c3b996d6dc9" containerID="8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75" exitCode=0
Sep 11 13:40:15.030674 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.030472    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"
Sep 11 13:40:15.030674 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.030514    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" event={"ID":"237efd5c-97dd-450c-8eec-9c3b996d6dc9","Type":"ContainerDied","Data":"8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75"}
Sep 11 13:40:15.030674 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.030573    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx" event={"ID":"237efd5c-97dd-450c-8eec-9c3b996d6dc9","Type":"ContainerDied","Data":"06635ebd16bcd80820e278c24e246a541d7a17d8bf31e289f66c16af4dcbfb9e"}
Sep 11 13:40:15.030674 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.030597    2547 scope.go:117] "RemoveContainer" containerID="8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75"
Sep 11 13:40:15.041251 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.041231    2547 scope.go:117] "RemoveContainer" containerID="8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75"
Sep 11 13:40:15.041644 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:40:15.041624    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75\": container with ID starting with 8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75 not found: ID does not exist" containerID="8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75"
Sep 11 13:40:15.041696 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.041674    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75"} err="failed to get container status \"8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75\": rpc error: code = NotFound desc = could not find container \"8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75\": container with ID starting with 8570b794a1276ffbfa949213fa8c742e17e099a4ac6a5a88f476e9ff2d89ef75 not found: ID does not exist"
Sep 11 13:40:15.055847 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.055811    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"]
Sep 11 13:40:15.061031 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.060996    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62b0dfd4-744b8466bb-kkgjx"]
Sep 11 13:40:15.847994 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.847960    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"]
Sep 11 13:40:15.848430 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.848412    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304f7ecc-84da-4c82-840d-1031ff6057af" containerName="maas-api"
Sep 11 13:40:15.848489 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.848436    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="304f7ecc-84da-4c82-840d-1031ff6057af" containerName="maas-api"
Sep 11 13:40:15.848489 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.848464    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237efd5c-97dd-450c-8eec-9c3b996d6dc9" containerName="maas-api"
Sep 11 13:40:15.848489 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.848474    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="237efd5c-97dd-450c-8eec-9c3b996d6dc9" containerName="maas-api"
Sep 11 13:40:15.848585 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.848566    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="237efd5c-97dd-450c-8eec-9c3b996d6dc9" containerName="maas-api"
Sep 11 13:40:15.848619 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.848585    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="304f7ecc-84da-4c82-840d-1031ff6057af" containerName="maas-api"
Sep 11 13:40:15.853459 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.853434    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:15.858120 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.858091    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-3dd80c-serving-cert\""
Sep 11 13:40:15.858291 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.858268    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:40:15.858371 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.858350    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:40:15.858443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.858369    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x5rkw\""
Sep 11 13:40:15.859174 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.859153    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:40:15.874204 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.874168    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"]
Sep 11 13:40:15.992986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.992943    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4918d6-e4ec-46f4-bda6-dd482afaa767-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:15.992986 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.992988    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:15.993226 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.993043    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:15.993226 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:15.993115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/5b4918d6-e4ec-46f4-bda6-dd482afaa767-kube-api-access-vjwvn\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.094331 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.094293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/5b4918d6-e4ec-46f4-bda6-dd482afaa767-kube-api-access-vjwvn\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.094500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.094351    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4918d6-e4ec-46f4-bda6-dd482afaa767-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.094500 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.094370    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.094587 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.094488    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.095144 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.095121    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4918d6-e4ec-46f4-bda6-dd482afaa767-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.097031 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.097000    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.097154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.097094    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.103435 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.103372    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/5b4918d6-e4ec-46f4-bda6-dd482afaa767-kube-api-access-vjwvn\") pod \"maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.165942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.165878    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:16.251875 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.251843    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="237efd5c-97dd-450c-8eec-9c3b996d6dc9" path="/var/lib/kubelet/pods/237efd5c-97dd-450c-8eec-9c3b996d6dc9/volumes"
Sep 11 13:40:16.456317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:16.456284    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"]
Sep 11 13:40:16.459160 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:40:16.459121    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4918d6_e4ec_46f4_bda6_dd482afaa767.slice/crio-eb8ee2df7d1872846cd1694f9c8d1733665002e2cad0cd493d0e791148ec6ac3 WatchSource:0}: Error finding container eb8ee2df7d1872846cd1694f9c8d1733665002e2cad0cd493d0e791148ec6ac3: Status 404 returned error can't find the container with id eb8ee2df7d1872846cd1694f9c8d1733665002e2cad0cd493d0e791148ec6ac3
Sep 11 13:40:17.050188 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:17.050146    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb" event={"ID":"5b4918d6-e4ec-46f4-bda6-dd482afaa767","Type":"ContainerStarted","Data":"ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38"}
Sep 11 13:40:17.050610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:17.050210    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb" event={"ID":"5b4918d6-e4ec-46f4-bda6-dd482afaa767","Type":"ContainerStarted","Data":"eb8ee2df7d1872846cd1694f9c8d1733665002e2cad0cd493d0e791148ec6ac3"}
Sep 11 13:40:17.050610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:17.050234    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:17.085185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:17.085118    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb" podStartSLOduration=1.6316216639999999 podStartE2EDuration="2.085097493s" totalImagesPullingTime="453.475829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:40:17.083752314 +0000 UTC m=+1233.296296113" watchObservedRunningTime="2026-09-11 13:40:17.085097493 +0000 UTC m=+1233.297641329"
Sep 11 13:40:19.222526 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:19.222492    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:40:21.898629 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:21.898591    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"]
Sep 11 13:40:21.899073 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:21.898841    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy" containerID="cri-o://1c1f0d7567cd1228c81727515f4768a91d12cf7ea74ce8009460f9883b356e74" gracePeriod=30
Sep 11 13:40:23.061733 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:23.061697    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:40:27.108616 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.108586    2547 generic.go:356] "Generic (PLEG): container finished" podID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerID="1c1f0d7567cd1228c81727515f4768a91d12cf7ea74ce8009460f9883b356e74" exitCode=0
Sep 11 13:40:27.109076 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.108654    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" event={"ID":"292f6b11-6ab3-46fb-beb2-5ba0477e3150","Type":"ContainerDied","Data":"1c1f0d7567cd1228c81727515f4768a91d12cf7ea74ce8009460f9883b356e74"}
Sep 11 13:40:27.109076 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.108708    2547 scope.go:117] "RemoveContainer" containerID="6621d2cac4b3b16da346a83e47e426913584ef7993e943cf51e4e35debce1f02"
Sep 11 13:40:27.154062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.154031    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:40:27.196347 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196250    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxz92\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-kube-api-access-bxz92\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196347 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196285    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istiod-ca-cert\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196347 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196314    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-podinfo\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196361    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-credential-socket\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196409    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-data\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196437    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-token\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196464    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-socket\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196502    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-envoy\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.196657 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196550    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-certs\") pod \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\" (UID: \"292f6b11-6ab3-46fb-beb2-5ba0477e3150\") "
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196670    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196713    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-data" (OuterVolumeSpecName: "istio-data") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196737    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196886    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.196901    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.197033    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.197056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.197052    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.197852 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.197065    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.198979 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.198898    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-kube-api-access-bxz92" (OuterVolumeSpecName: "kube-api-access-bxz92") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "kube-api-access-bxz92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:40:27.198979 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.198932    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:40:27.199149 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.199123    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:40:27.199149 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.199126    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-token" (OuterVolumeSpecName: "istio-token") pod "292f6b11-6ab3-46fb-beb2-5ba0477e3150" (UID: "292f6b11-6ab3-46fb-beb2-5ba0477e3150"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:40:27.297647 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.297601    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.297647 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.297643    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.297647 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.297652    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.297647 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.297660    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f6b11-6ab3-46fb-beb2-5ba0477e3150-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.297941 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.297668    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxz92\" (UniqueName: \"kubernetes.io/projected/292f6b11-6ab3-46fb-beb2-5ba0477e3150-kube-api-access-bxz92\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:27.297941 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:27.297678    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f6b11-6ab3-46fb-beb2-5ba0477e3150-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:40:28.115804 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:28.115769    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"
Sep 11 13:40:28.115804 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:28.115783    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd" event={"ID":"292f6b11-6ab3-46fb-beb2-5ba0477e3150","Type":"ContainerDied","Data":"a0d4c64e0bea730d9d91ac04a2f1feba84af5d3ccda53d979326c081202bd715"}
Sep 11 13:40:28.116328 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:28.115867    2547 scope.go:117] "RemoveContainer" containerID="1c1f0d7567cd1228c81727515f4768a91d12cf7ea74ce8009460f9883b356e74"
Sep 11 13:40:28.143813 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:28.143782    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"]
Sep 11 13:40:28.145904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:28.145879    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-62b0dfd4-openshift-default-6fd9df44b8-4sfsd"]
Sep 11 13:40:28.250621 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:28.250584    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" path="/var/lib/kubelet/pods/292f6b11-6ab3-46fb-beb2-5ba0477e3150/volumes"
Sep 11 13:40:39.665035 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.664946    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"]
Sep 11 13:40:39.665436 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.665346    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy"
Sep 11 13:40:39.665436 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.665360    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy"
Sep 11 13:40:39.665436 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.665423    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy"
Sep 11 13:40:39.665436 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.665434    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy"
Sep 11 13:40:39.671176 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.671130    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.678507 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.678471    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-d6ca2b-openshift-default-dockercfg-4r258\""
Sep 11 13:40:39.678654 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.678510    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:40:39.692890 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.692851    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"]
Sep 11 13:40:39.702715 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702672    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-envoy\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.702889 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702723    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603327cb-7cee-42c5-920d-c6bf4353c912-istiod-ca-cert\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.702889 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702791    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-certs\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.702889 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702863    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-credential-socket\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.703032 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702902    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gblj\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-kube-api-access-2gblj\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.703032 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702962    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-socket\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.703032 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.702990    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-data\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.703131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.703046    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-istio-token\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.703131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.703102    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603327cb-7cee-42c5-920d-c6bf4353c912-istio-podinfo\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804091 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804053    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-credential-socket\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804091 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gblj\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-kube-api-access-2gblj\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804123    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-socket\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804157    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-data\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804198    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-istio-token\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804569 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804381    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603327cb-7cee-42c5-920d-c6bf4353c912-istio-podinfo\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804569 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804429    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-envoy\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804764    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603327cb-7cee-42c5-920d-c6bf4353c912-istiod-ca-cert\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804941 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804524    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-credential-socket\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804941 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804616    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-data\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804941 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804844    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-certs\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.804941 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.804542    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-socket\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.805216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.805193    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-certs\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.805427 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.805404    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603327cb-7cee-42c5-920d-c6bf4353c912-istiod-ca-cert\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.806849 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.806826    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-envoy\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.807042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.807020    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603327cb-7cee-42c5-920d-c6bf4353c912-istio-podinfo\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.813422 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.813385    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-istio-token\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.813540 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.813465    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gblj\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-kube-api-access-2gblj\") pod \"e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") " pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:39.986626 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:39.986519    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:40.288017 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:40:40.287986    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod603327cb_7cee_42c5_920d_c6bf4353c912.slice/crio-faecf8d76798ded466a3d838f96755d9809b51aa37fcefb9e4f18958e121dd76 WatchSource:0}: Error finding container faecf8d76798ded466a3d838f96755d9809b51aa37fcefb9e4f18958e121dd76: Status 404 returned error can't find the container with id faecf8d76798ded466a3d838f96755d9809b51aa37fcefb9e4f18958e121dd76
Sep 11 13:40:40.288367 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:40.288344    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"]
Sep 11 13:40:40.290757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:40.290724    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:40:40.290820 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:40.290806    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:40:40.290858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:40.290834    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:40:41.191429 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.191388    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" event={"ID":"603327cb-7cee-42c5-920d-c6bf4353c912","Type":"ContainerStarted","Data":"87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"}
Sep 11 13:40:41.191906 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.191441    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" event={"ID":"603327cb-7cee-42c5-920d-c6bf4353c912","Type":"ContainerStarted","Data":"faecf8d76798ded466a3d838f96755d9809b51aa37fcefb9e4f18958e121dd76"}
Sep 11 13:40:41.234061 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.233992    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podStartSLOduration=2.233972604 podStartE2EDuration="2.233972604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:40:41.230606406 +0000 UTC m=+1257.443150219" watchObservedRunningTime="2026-09-11 13:40:41.233972604 +0000 UTC m=+1257.446516405"
Sep 11 13:40:41.986960 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.986906    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:41.990007 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.989976    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"]
Sep 11 13:40:41.990432 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.990416    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy"
Sep 11 13:40:41.990543 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.990436    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="292f6b11-6ab3-46fb-beb2-5ba0477e3150" containerName="istio-proxy"
Sep 11 13:40:41.993900 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.993872    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:41.994036 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.993961    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:41.999829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:41.999805    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-7bfa93-serving-cert\""
Sep 11 13:40:42.008632 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.008596    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"]
Sep 11 13:40:42.028079 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.028027    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c294b55-c12f-43f5-9950-3ac1937f0208-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.028270 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.028112    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.028270 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.028156    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.028270 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.028229    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzgzh\" (UniqueName: \"kubernetes.io/projected/6c294b55-c12f-43f5-9950-3ac1937f0208-kube-api-access-pzgzh\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.129431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.129376    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzgzh\" (UniqueName: \"kubernetes.io/projected/6c294b55-c12f-43f5-9950-3ac1937f0208-kube-api-access-pzgzh\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.129644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.129519    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c294b55-c12f-43f5-9950-3ac1937f0208-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.129644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.129601    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.129760 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.129651    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.129807 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:40:42.129772    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-serving-cert: secret "maas-api-e2e-shared-a-w2-7bfa93-serving-cert" not found
Sep 11 13:40:42.129859 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:40:42.129844    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls podName:6c294b55-c12f-43f5-9950-3ac1937f0208 nodeName:}" failed. No retries permitted until 2026-09-11 13:40:42.629823531 +0000 UTC m=+1258.842367314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls") pod "maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" (UID: "6c294b55-c12f-43f5-9950-3ac1937f0208") : secret "maas-api-e2e-shared-a-w2-7bfa93-serving-cert" not found
Sep 11 13:40:42.130335 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.130318    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c294b55-c12f-43f5-9950-3ac1937f0208-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.132211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.132187    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.143949 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.143905    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzgzh\" (UniqueName: \"kubernetes.io/projected/6c294b55-c12f-43f5-9950-3ac1937f0208-kube-api-access-pzgzh\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.198590 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.198554    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:42.199702 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.199677    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:40:42.634378 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.634335    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.636908 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.636885    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:42.907618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:42.907518    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:43.197786 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:43.197753    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"]
Sep 11 13:40:43.198184 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:40:43.198156    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c294b55_c12f_43f5_9950_3ac1937f0208.slice/crio-4e7170caca81c39cf4cc29915b72f62f8634856638cd79a614c231218e704c47 WatchSource:0}: Error finding container 4e7170caca81c39cf4cc29915b72f62f8634856638cd79a614c231218e704c47: Status 404 returned error can't find the container with id 4e7170caca81c39cf4cc29915b72f62f8634856638cd79a614c231218e704c47
Sep 11 13:40:43.206093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:43.206064    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" event={"ID":"6c294b55-c12f-43f5-9950-3ac1937f0208","Type":"ContainerStarted","Data":"4e7170caca81c39cf4cc29915b72f62f8634856638cd79a614c231218e704c47"}
Sep 11 13:40:44.213549 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:44.213504    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" event={"ID":"6c294b55-c12f-43f5-9950-3ac1937f0208","Type":"ContainerStarted","Data":"50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d"}
Sep 11 13:40:44.213962 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:44.213660    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:44.255525 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:44.255472    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" podStartSLOduration=2.9189782810000002 podStartE2EDuration="3.255453702s" totalImagesPullingTime="336.475421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:40:44.248640453 +0000 UTC m=+1260.461184255" watchObservedRunningTime="2026-09-11 13:40:44.255453702 +0000 UTC m=+1260.467997502"
Sep 11 13:40:45.832738 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:45.832693    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:40:46.943591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:46.943553    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"]
Sep 11 13:40:46.948458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:46.948437    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:46.951282 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:46.951250    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-d6ca2b-serving-cert\""
Sep 11 13:40:46.958631 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:46.958602    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"]
Sep 11 13:40:47.080970 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.080890    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.081154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.081005    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e3e456-8190-42c0-bbde-802377f3e0ce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.081154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.081042    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6njz\" (UniqueName: \"kubernetes.io/projected/11e3e456-8190-42c0-bbde-802377f3e0ce-kube-api-access-d6njz\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.081154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.081060    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.182299 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.182257    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.182521 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.182349    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e3e456-8190-42c0-bbde-802377f3e0ce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.182521 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:40:47.182395    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-serving-cert: secret "maas-api-e2e-shared-b-w3-d6ca2b-serving-cert" not found
Sep 11 13:40:47.182521 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.182401    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6njz\" (UniqueName: \"kubernetes.io/projected/11e3e456-8190-42c0-bbde-802377f3e0ce-kube-api-access-d6njz\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.182521 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:40:47.182514    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls podName:11e3e456-8190-42c0-bbde-802377f3e0ce nodeName:}" failed. No retries permitted until 2026-09-11 13:40:47.682492049 +0000 UTC m=+1263.895035847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls") pod "maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" (UID: "11e3e456-8190-42c0-bbde-802377f3e0ce") : secret "maas-api-e2e-shared-b-w3-d6ca2b-serving-cert" not found
Sep 11 13:40:47.182749 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.182553    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.183181 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.183162    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e3e456-8190-42c0-bbde-802377f3e0ce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.185323 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.185300    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.200023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.199952    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6njz\" (UniqueName: \"kubernetes.io/projected/11e3e456-8190-42c0-bbde-802377f3e0ce-kube-api-access-d6njz\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.688186 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.688145    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.690610 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.690583    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:47.860998 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:47.860960    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:48.143765 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:48.142047    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"]
Sep 11 13:40:48.146685 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:40:48.146647    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e3e456_8190_42c0_bbde_802377f3e0ce.slice/crio-67c5b662fc51fbb07b220e1edcd64efb07dbf21a65e75c10b6ee2cad3d89922d WatchSource:0}: Error finding container 67c5b662fc51fbb07b220e1edcd64efb07dbf21a65e75c10b6ee2cad3d89922d: Status 404 returned error can't find the container with id 67c5b662fc51fbb07b220e1edcd64efb07dbf21a65e75c10b6ee2cad3d89922d
Sep 11 13:40:48.238376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:48.238339    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" event={"ID":"11e3e456-8190-42c0-bbde-802377f3e0ce","Type":"ContainerStarted","Data":"67c5b662fc51fbb07b220e1edcd64efb07dbf21a65e75c10b6ee2cad3d89922d"}
Sep 11 13:40:49.245395 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:49.245350    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" event={"ID":"11e3e456-8190-42c0-bbde-802377f3e0ce","Type":"ContainerStarted","Data":"3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff"}
Sep 11 13:40:49.245811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:49.245429    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:49.269628 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:49.269568    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" podStartSLOduration=2.895282462 podStartE2EDuration="3.269551612s" totalImagesPullingTime="374.26915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:40:49.269357011 +0000 UTC m=+1265.481900811" watchObservedRunningTime="2026-09-11 13:40:49.269551612 +0000 UTC m=+1265.482095409"
Sep 11 13:40:50.224995 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:50.224964    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:40:55.258513 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:55.258481    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:40:56.715798 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:40:56.715761    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:41:03.337152 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:03.337117    2547 generic.go:356] "Generic (PLEG): container finished" podID="603327cb-7cee-42c5-920d-c6bf4353c912" containerID="87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a" exitCode=0
Sep 11 13:41:03.337709 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:03.337201    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" event={"ID":"603327cb-7cee-42c5-920d-c6bf4353c912","Type":"ContainerDied","Data":"87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"}
Sep 11 13:41:03.337795 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:03.337774    2547 scope.go:117] "RemoveContainer" containerID="87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"
Sep 11 13:41:03.338950 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:03.338905    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:41:03.339025 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:03.338987    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:41:03.339067 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:03.339024    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 13:41:04.346602 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:04.346564    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" event={"ID":"603327cb-7cee-42c5-920d-c6bf4353c912","Type":"ContainerStarted","Data":"15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b"}
Sep 11 13:41:04.987250 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:04.987196    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:41:04.987503 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:04.987466    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 13:41:04.987632 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:04.987540    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 13:41:05.987826 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:05.987786    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 13:41:05.988369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:05.987868    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 13:41:06.987758 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:06.987717    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 13:41:06.987976 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:06.987780    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 13:41:07.987990 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:07.987946    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 13:41:07.988376 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:07.988031    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 13:41:08.987343 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:08.987303    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 11 13:41:08.987542 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:08.987367    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 11 13:41:09.991649 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:09.991614    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:41:09.992077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:09.991904    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:41:09.992802 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:09.992780    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:41:11.726075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.726035    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"]
Sep 11 13:41:11.730393 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.730364    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.733123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.733096    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-32b673-serving-cert\""
Sep 11 13:41:11.744429 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.744400    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"]
Sep 11 13:41:11.827177 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.827137    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.827177 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.827177    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.827389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.827230    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25c07d29-c86e-4365-a4b9-0047517a4df9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.827389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.827304    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxslk\" (UniqueName: \"kubernetes.io/projected/25c07d29-c86e-4365-a4b9-0047517a4df9-kube-api-access-pxslk\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.927845 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.927801    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.928084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.927854    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.928084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.927897    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25c07d29-c86e-4365-a4b9-0047517a4df9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.928084 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:11.927992    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-serving-cert: secret "maas-api-e2e-shared-b-w2-32b673-serving-cert" not found
Sep 11 13:41:11.928084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.928050    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxslk\" (UniqueName: \"kubernetes.io/projected/25c07d29-c86e-4365-a4b9-0047517a4df9-kube-api-access-pxslk\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.928084 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:11.928073    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls podName:25c07d29-c86e-4365-a4b9-0047517a4df9 nodeName:}" failed. No retries permitted until 2026-09-11 13:41:12.42805185 +0000 UTC m=+1288.640595634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls") pod "maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" (UID: "25c07d29-c86e-4365-a4b9-0047517a4df9") : secret "maas-api-e2e-shared-b-w2-32b673-serving-cert" not found
Sep 11 13:41:11.928653 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.928634    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25c07d29-c86e-4365-a4b9-0047517a4df9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.930352 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.930335    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:11.940079 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:11.940021    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxslk\" (UniqueName: \"kubernetes.io/projected/25c07d29-c86e-4365-a4b9-0047517a4df9-kube-api-access-pxslk\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:12.432288 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:12.432230    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:12.434830 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:12.434798    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:12.644259 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:12.644206    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:12.921715 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:12.921685    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"]
Sep 11 13:41:12.923637 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:41:12.923606    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c07d29_c86e_4365_a4b9_0047517a4df9.slice/crio-a8f269051674d132446c3e9f48441d273a8143469ff6a850db1d31ee7e811673 WatchSource:0}: Error finding container a8f269051674d132446c3e9f48441d273a8143469ff6a850db1d31ee7e811673: Status 404 returned error can't find the container with id a8f269051674d132446c3e9f48441d273a8143469ff6a850db1d31ee7e811673
Sep 11 13:41:13.404402 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:13.404365    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" event={"ID":"25c07d29-c86e-4365-a4b9-0047517a4df9","Type":"ContainerStarted","Data":"6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c"}
Sep 11 13:41:13.404574 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:13.404427    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" event={"ID":"25c07d29-c86e-4365-a4b9-0047517a4df9","Type":"ContainerStarted","Data":"a8f269051674d132446c3e9f48441d273a8143469ff6a850db1d31ee7e811673"}
Sep 11 13:41:13.404631 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:13.404610    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:13.424844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:13.424618    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" podStartSLOduration=2.088417496 podStartE2EDuration="2.424595179s" totalImagesPullingTime="336.177683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:13.423757514 +0000 UTC m=+1289.636301315" watchObservedRunningTime="2026-09-11 13:41:13.424595179 +0000 UTC m=+1289.637138983"
Sep 11 13:41:17.222299 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:17.222253    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:41:19.416159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:19.416123    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:41:33.115768 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:33.115722    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:41:35.158845 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.158808    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-61fe22"]
Sep 11 13:41:35.163783 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.163762    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:35.166714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.166454    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jcb7l\""
Sep 11 13:41:35.168307 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.168278    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-61fe22"]
Sep 11 13:41:35.248835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.248791    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6nbg\" (UniqueName: \"kubernetes.io/projected/5d754786-e6c1-45c7-9fe1-51c7fd605ba1-kube-api-access-g6nbg\") pod \"test-curl-7740-61fe22\" (UID: \"5d754786-e6c1-45c7-9fe1-51c7fd605ba1\") " pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:35.350608 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.350518    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6nbg\" (UniqueName: \"kubernetes.io/projected/5d754786-e6c1-45c7-9fe1-51c7fd605ba1-kube-api-access-g6nbg\") pod \"test-curl-7740-61fe22\" (UID: \"5d754786-e6c1-45c7-9fe1-51c7fd605ba1\") " pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:35.360198 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.360167    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6nbg\" (UniqueName: \"kubernetes.io/projected/5d754786-e6c1-45c7-9fe1-51c7fd605ba1-kube-api-access-g6nbg\") pod \"test-curl-7740-61fe22\" (UID: \"5d754786-e6c1-45c7-9fe1-51c7fd605ba1\") " pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:35.475547 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.475436    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:35.756055 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:35.756024    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-61fe22"]
Sep 11 13:41:35.757621 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:41:35.757592    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d754786_e6c1_45c7_9fe1_51c7fd605ba1.slice/crio-4806ed60d0c21432a40eaf87a450020f7ab185adf26c9ed8210a273983e05fb6 WatchSource:0}: Error finding container 4806ed60d0c21432a40eaf87a450020f7ab185adf26c9ed8210a273983e05fb6: Status 404 returned error can't find the container with id 4806ed60d0c21432a40eaf87a450020f7ab185adf26c9ed8210a273983e05fb6
Sep 11 13:41:36.542184 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:36.542144    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-61fe22" event={"ID":"5d754786-e6c1-45c7-9fe1-51c7fd605ba1","Type":"ContainerStarted","Data":"3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2"}
Sep 11 13:41:36.542573 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:36.542195    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-61fe22" event={"ID":"5d754786-e6c1-45c7-9fe1-51c7fd605ba1","Type":"ContainerStarted","Data":"4806ed60d0c21432a40eaf87a450020f7ab185adf26c9ed8210a273983e05fb6"}
Sep 11 13:41:36.567971 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:36.567888    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7740-61fe22" podStartSLOduration=1.5678713279999998 podStartE2EDuration="1.567871328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:36.565451332 +0000 UTC m=+1312.777995131" watchObservedRunningTime="2026-09-11 13:41:36.567871328 +0000 UTC m=+1312.780415127"
Sep 11 13:41:37.330543 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.330503    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-61fe22"]
Sep 11 13:41:37.335265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.335173    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-61fe22"]
Sep 11 13:41:37.462527 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.462491    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-1ffb20"]
Sep 11 13:41:37.462898 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.462885    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" containerName="test-curl-7740-61fe22"
Sep 11 13:41:37.462979 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.462899    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" containerName="test-curl-7740-61fe22"
Sep 11 13:41:37.463021 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.462984    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" containerName="test-curl-7740-61fe22"
Sep 11 13:41:37.466097 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.466076    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:37.471509 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.471477    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-1ffb20"]
Sep 11 13:41:37.547587 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:37.547552    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7740-61fe22" container="test-curl-7740-61fe22"
Sep 11 13:41:37.571996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.571960    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm776\" (UniqueName: \"kubernetes.io/projected/511a0ae2-5e1e-438a-9b67-dc9a79366237-kube-api-access-hm776\") pod \"test-curl-7740-1ffb20\" (UID: \"511a0ae2-5e1e-438a-9b67-dc9a79366237\") " pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:37.673252 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.673210    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm776\" (UniqueName: \"kubernetes.io/projected/511a0ae2-5e1e-438a-9b67-dc9a79366237-kube-api-access-hm776\") pod \"test-curl-7740-1ffb20\" (UID: \"511a0ae2-5e1e-438a-9b67-dc9a79366237\") " pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:37.682252 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.682221    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm776\" (UniqueName: \"kubernetes.io/projected/511a0ae2-5e1e-438a-9b67-dc9a79366237-kube-api-access-hm776\") pod \"test-curl-7740-1ffb20\" (UID: \"511a0ae2-5e1e-438a-9b67-dc9a79366237\") " pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:37.777310 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:37.777270    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:38.052350 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:38.052322    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-1ffb20"]
Sep 11 13:41:38.053662 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:41:38.053629    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod511a0ae2_5e1e_438a_9b67_dc9a79366237.slice/crio-faa02e8798df2ad7039f85697121c3bf0ff3faaf3b3d83ad71c81ac0edb83e1d WatchSource:0}: Error finding container faa02e8798df2ad7039f85697121c3bf0ff3faaf3b3d83ad71c81ac0edb83e1d: Status 404 returned error can't find the container with id faa02e8798df2ad7039f85697121c3bf0ff3faaf3b3d83ad71c81ac0edb83e1d
Sep 11 13:41:38.554582 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:38.554540    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-1ffb20" event={"ID":"511a0ae2-5e1e-438a-9b67-dc9a79366237","Type":"ContainerStarted","Data":"057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984"}
Sep 11 13:41:38.554582 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:38.554589    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-1ffb20" event={"ID":"511a0ae2-5e1e-438a-9b67-dc9a79366237","Type":"ContainerStarted","Data":"faa02e8798df2ad7039f85697121c3bf0ff3faaf3b3d83ad71c81ac0edb83e1d"}
Sep 11 13:41:38.555111 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:38.554646    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7740-61fe22" podUID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" containerName="test-curl-7740-61fe22" containerID="cri-o://3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2" gracePeriod=2
Sep 11 13:41:38.570868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:38.570811    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7740-1ffb20" podStartSLOduration=1.5707928629999999 podStartE2EDuration="1.570792863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:38.570246102 +0000 UTC m=+1314.782789903" watchObservedRunningTime="2026-09-11 13:41:38.570792863 +0000 UTC m=+1314.783336713"
Sep 11 13:41:39.219352 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.219313    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-1ffb20"]
Sep 11 13:41:39.223712 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.223612    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-1ffb20"]
Sep 11 13:41:39.353943 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.353892    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-1aa16b"]
Sep 11 13:41:39.354345 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.354331    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" containerName="test-curl-7740-1ffb20"
Sep 11 13:41:39.354411 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.354347    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" containerName="test-curl-7740-1ffb20"
Sep 11 13:41:39.354411 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.354409    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" containerName="test-curl-7740-1ffb20"
Sep 11 13:41:39.357586 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.357566    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:39.363578 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.363545    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-1aa16b"]
Sep 11 13:41:39.492790 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.492686    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhgt\" (UniqueName: \"kubernetes.io/projected/4587d7ce-d78e-4602-a9d3-07b2840cc5b9-kube-api-access-nmhgt\") pod \"test-curl-7740-1aa16b\" (UID: \"4587d7ce-d78e-4602-a9d3-07b2840cc5b9\") " pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:39.560331 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:39.560300    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7740-1ffb20" container="test-curl-7740-1ffb20"
Sep 11 13:41:39.594221 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.594179    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhgt\" (UniqueName: \"kubernetes.io/projected/4587d7ce-d78e-4602-a9d3-07b2840cc5b9-kube-api-access-nmhgt\") pod \"test-curl-7740-1aa16b\" (UID: \"4587d7ce-d78e-4602-a9d3-07b2840cc5b9\") " pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:39.603059 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.603024    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhgt\" (UniqueName: \"kubernetes.io/projected/4587d7ce-d78e-4602-a9d3-07b2840cc5b9-kube-api-access-nmhgt\") pod \"test-curl-7740-1aa16b\" (UID: \"4587d7ce-d78e-4602-a9d3-07b2840cc5b9\") " pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:39.668872 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.668833    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:39.943345 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:39.943319    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-1aa16b"]
Sep 11 13:41:39.945411 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:41:39.945385    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4587d7ce_d78e_4602_a9d3_07b2840cc5b9.slice/crio-9974325a442124076bd1e3eaf6d9a15f41cab8409f7c46dcfe9152c7bf9a267d WatchSource:0}: Error finding container 9974325a442124076bd1e3eaf6d9a15f41cab8409f7c46dcfe9152c7bf9a267d: Status 404 returned error can't find the container with id 9974325a442124076bd1e3eaf6d9a15f41cab8409f7c46dcfe9152c7bf9a267d
Sep 11 13:41:40.567676 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.567633    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-1aa16b" event={"ID":"4587d7ce-d78e-4602-a9d3-07b2840cc5b9","Type":"ContainerStarted","Data":"8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74"}
Sep 11 13:41:40.568046 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.567693    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-1aa16b" event={"ID":"4587d7ce-d78e-4602-a9d3-07b2840cc5b9","Type":"ContainerStarted","Data":"9974325a442124076bd1e3eaf6d9a15f41cab8409f7c46dcfe9152c7bf9a267d"}
Sep 11 13:41:40.568046 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.567704    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7740-1ffb20" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" containerName="test-curl-7740-1ffb20" containerID="cri-o://057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984" gracePeriod=2
Sep 11 13:41:40.586999 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.586905    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7740-1aa16b" podStartSLOduration=1.5868875409999998 podStartE2EDuration="1.586887541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:40.584863646 +0000 UTC m=+1316.797407861" watchObservedRunningTime="2026-09-11 13:41:40.586887541 +0000 UTC m=+1316.799431340"
Sep 11 13:41:40.752707 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.752680    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:40.906136 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.906094    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6nbg\" (UniqueName: \"kubernetes.io/projected/5d754786-e6c1-45c7-9fe1-51c7fd605ba1-kube-api-access-g6nbg\") pod \"5d754786-e6c1-45c7-9fe1-51c7fd605ba1\" (UID: \"5d754786-e6c1-45c7-9fe1-51c7fd605ba1\") "
Sep 11 13:41:40.908275 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:40.908245    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d754786-e6c1-45c7-9fe1-51c7fd605ba1-kube-api-access-g6nbg" (OuterVolumeSpecName: "kube-api-access-g6nbg") pod "5d754786-e6c1-45c7-9fe1-51c7fd605ba1" (UID: "5d754786-e6c1-45c7-9fe1-51c7fd605ba1"). InnerVolumeSpecName "kube-api-access-g6nbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:41:41.007122 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.007086    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6nbg\" (UniqueName: \"kubernetes.io/projected/5d754786-e6c1-45c7-9fe1-51c7fd605ba1-kube-api-access-g6nbg\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:41:41.247216 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.247123    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-1aa16b"]
Sep 11 13:41:41.257036 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.257002    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-1aa16b"]
Sep 11 13:41:41.381238 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.381202    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7740-a0a838"]
Sep 11 13:41:41.381646 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.381630    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" containerName="test-curl-7740-1aa16b"
Sep 11 13:41:41.381704 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.381650    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" containerName="test-curl-7740-1aa16b"
Sep 11 13:41:41.381746 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.381725    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" containerName="test-curl-7740-1aa16b"
Sep 11 13:41:41.384922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.384896    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:41.390635 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.390600    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-a0a838"]
Sep 11 13:41:41.512848 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.512743    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8h22\" (UniqueName: \"kubernetes.io/projected/b9078e56-8e93-4b9d-855d-3c622fa1b852-kube-api-access-j8h22\") pod \"test-curl-7740-a0a838\" (UID: \"b9078e56-8e93-4b9d-855d-3c622fa1b852\") " pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:41.575558 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.575516    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" containerID="3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2" exitCode=137
Sep 11 13:41:41.575558 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.575555    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:41.576020 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.575639    2547 scope.go:117] "RemoveContainer" containerID="3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2"
Sep 11 13:41:41.576020 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:41.575954    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7740-1aa16b" container="test-curl-7740-1aa16b"
Sep 11 13:41:41.585258 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.585238    2547 scope.go:117] "RemoveContainer" containerID="3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2"
Sep 11 13:41:41.585610 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:41.585591    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2\": container with ID starting with 3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2 not found: ID does not exist" containerID="3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2"
Sep 11 13:41:41.585662 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.585621    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2"} err="failed to get container status \"3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2\": rpc error: code = NotFound desc = could not find container \"3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2\": container with ID starting with 3f61d246b804b98df5bcb37494e6d292b05f6d4c98da3bac4905f3196eacc8e2 not found: ID does not exist"
Sep 11 13:41:41.587213 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:41.587186    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-61fe22\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" pod="opendatahub/test-curl-7740-61fe22"
Sep 11 13:41:41.613837 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.613792    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8h22\" (UniqueName: \"kubernetes.io/projected/b9078e56-8e93-4b9d-855d-3c622fa1b852-kube-api-access-j8h22\") pod \"test-curl-7740-a0a838\" (UID: \"b9078e56-8e93-4b9d-855d-3c622fa1b852\") " pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:41.623042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.623014    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8h22\" (UniqueName: \"kubernetes.io/projected/b9078e56-8e93-4b9d-855d-3c622fa1b852-kube-api-access-j8h22\") pod \"test-curl-7740-a0a838\" (UID: \"b9078e56-8e93-4b9d-855d-3c622fa1b852\") " pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:41.696781 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.696742    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:41.972154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:41.972128    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7740-a0a838"]
Sep 11 13:41:41.973928 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:41:41.973888    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9078e56_8e93_4b9d_855d_3c622fa1b852.slice/crio-a6a4227d59d357fe29469ab9255cadc95a533d1cb64a95582d729bb678eda5e9 WatchSource:0}: Error finding container a6a4227d59d357fe29469ab9255cadc95a533d1cb64a95582d729bb678eda5e9: Status 404 returned error can't find the container with id a6a4227d59d357fe29469ab9255cadc95a533d1cb64a95582d729bb678eda5e9
Sep 11 13:41:42.250078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.249982    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d754786-e6c1-45c7-9fe1-51c7fd605ba1" path="/var/lib/kubelet/pods/5d754786-e6c1-45c7-9fe1-51c7fd605ba1/volumes"
Sep 11 13:41:42.583920 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.583880    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-a0a838" event={"ID":"b9078e56-8e93-4b9d-855d-3c622fa1b852","Type":"ContainerStarted","Data":"1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945"}
Sep 11 13:41:42.584392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.583949    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7740-a0a838" event={"ID":"b9078e56-8e93-4b9d-855d-3c622fa1b852","Type":"ContainerStarted","Data":"a6a4227d59d357fe29469ab9255cadc95a533d1cb64a95582d729bb678eda5e9"}
Sep 11 13:41:42.584392 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.584035    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7740-1aa16b" podUID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" containerName="test-curl-7740-1aa16b" containerID="cri-o://8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74" gracePeriod=2
Sep 11 13:41:42.606128 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.606075    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7740-a0a838" podStartSLOduration=1.60605601 podStartE2EDuration="1.60605601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:42.603845313 +0000 UTC m=+1318.816389118" watchObservedRunningTime="2026-09-11 13:41:42.60605601 +0000 UTC m=+1318.818599804"
Sep 11 13:41:42.760972 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.760946    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:42.926344 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.926301    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm776\" (UniqueName: \"kubernetes.io/projected/511a0ae2-5e1e-438a-9b67-dc9a79366237-kube-api-access-hm776\") pod \"511a0ae2-5e1e-438a-9b67-dc9a79366237\" (UID: \"511a0ae2-5e1e-438a-9b67-dc9a79366237\") "
Sep 11 13:41:42.928497 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:42.928462    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/511a0ae2-5e1e-438a-9b67-dc9a79366237-kube-api-access-hm776" (OuterVolumeSpecName: "kube-api-access-hm776") pod "511a0ae2-5e1e-438a-9b67-dc9a79366237" (UID: "511a0ae2-5e1e-438a-9b67-dc9a79366237"). InnerVolumeSpecName "kube-api-access-hm776". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:41:43.028093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.028052    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm776\" (UniqueName: \"kubernetes.io/projected/511a0ae2-5e1e-438a-9b67-dc9a79366237-kube-api-access-hm776\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:41:43.263580 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.263475    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7740-a0a838"]
Sep 11 13:41:43.267939 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.267893    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7740-a0a838"]
Sep 11 13:41:43.592008 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.591903    2547 generic.go:356] "Generic (PLEG): container finished" podID="511a0ae2-5e1e-438a-9b67-dc9a79366237" containerID="057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984" exitCode=137
Sep 11 13:41:43.592008 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.591964    2547 scope.go:117] "RemoveContainer" containerID="057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984"
Sep 11 13:41:43.592008 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.591985    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:43.592513 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:43.592307    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7740-a0a838" container="test-curl-7740-a0a838"
Sep 11 13:41:43.601339 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.601317    2547 scope.go:117] "RemoveContainer" containerID="057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984"
Sep 11 13:41:43.601692 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:43.601666    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984\": container with ID starting with 057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984 not found: ID does not exist" containerID="057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984"
Sep 11 13:41:43.601745 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:43.601701    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984"} err="failed to get container status \"057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984\": rpc error: code = NotFound desc = could not find container \"057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984\": container with ID starting with 057005943aeaad75a04a309d48f822f8dd690f09c8983b9faa8dccb7f0752984 not found: ID does not exist"
Sep 11 13:41:43.603249 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:43.603220    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-1ffb20\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:44.248695 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:44.248652    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-1ffb20\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" pod="opendatahub/test-curl-7740-1ffb20"
Sep 11 13:41:44.250064 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:44.250043    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="511a0ae2-5e1e-438a-9b67-dc9a79366237" path="/var/lib/kubelet/pods/511a0ae2-5e1e-438a-9b67-dc9a79366237/volumes"
Sep 11 13:41:44.598048 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:44.598005    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7740-a0a838" podUID="b9078e56-8e93-4b9d-855d-3c622fa1b852" containerName="test-curl-7740-a0a838" containerID="cri-o://1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945" gracePeriod=2
Sep 11 13:41:44.776635 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:44.776606    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:44.946766 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:44.946720    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmhgt\" (UniqueName: \"kubernetes.io/projected/4587d7ce-d78e-4602-a9d3-07b2840cc5b9-kube-api-access-nmhgt\") pod \"4587d7ce-d78e-4602-a9d3-07b2840cc5b9\" (UID: \"4587d7ce-d78e-4602-a9d3-07b2840cc5b9\") "
Sep 11 13:41:44.948864 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:44.948837    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4587d7ce-d78e-4602-a9d3-07b2840cc5b9-kube-api-access-nmhgt" (OuterVolumeSpecName: "kube-api-access-nmhgt") pod "4587d7ce-d78e-4602-a9d3-07b2840cc5b9" (UID: "4587d7ce-d78e-4602-a9d3-07b2840cc5b9"). InnerVolumeSpecName "kube-api-access-nmhgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:41:45.048063 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:45.048016    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmhgt\" (UniqueName: \"kubernetes.io/projected/4587d7ce-d78e-4602-a9d3-07b2840cc5b9-kube-api-access-nmhgt\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:41:45.605484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:45.605445    2547 generic.go:356] "Generic (PLEG): container finished" podID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" containerID="8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74" exitCode=137
Sep 11 13:41:45.605484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:45.605487    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:45.606061 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:45.605552    2547 scope.go:117] "RemoveContainer" containerID="8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74"
Sep 11 13:41:45.615439 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:45.615419    2547 scope.go:117] "RemoveContainer" containerID="8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74"
Sep 11 13:41:45.615774 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:45.615757    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74\": container with ID starting with 8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74 not found: ID does not exist" containerID="8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74"
Sep 11 13:41:45.615810 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:45.615784    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74"} err="failed to get container status \"8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74\": rpc error: code = NotFound desc = could not find container \"8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74\": container with ID starting with 8a8109b69190cdd76313eefd5bd377ccd38037f331a86bd428f62e7e829b5c74 not found: ID does not exist"
Sep 11 13:41:45.617997 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:45.617971    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-1aa16b\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" pod="opendatahub/test-curl-7740-1aa16b"
Sep 11 13:41:46.249434 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:46.249396    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4587d7ce-d78e-4602-a9d3-07b2840cc5b9" path="/var/lib/kubelet/pods/4587d7ce-d78e-4602-a9d3-07b2840cc5b9/volumes"
Sep 11 13:41:46.759800 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:46.759765    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:46.863761 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:46.863666    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8h22\" (UniqueName: \"kubernetes.io/projected/b9078e56-8e93-4b9d-855d-3c622fa1b852-kube-api-access-j8h22\") pod \"b9078e56-8e93-4b9d-855d-3c622fa1b852\" (UID: \"b9078e56-8e93-4b9d-855d-3c622fa1b852\") "
Sep 11 13:41:46.865858 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:46.865828    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9078e56-8e93-4b9d-855d-3c622fa1b852-kube-api-access-j8h22" (OuterVolumeSpecName: "kube-api-access-j8h22") pod "b9078e56-8e93-4b9d-855d-3c622fa1b852" (UID: "b9078e56-8e93-4b9d-855d-3c622fa1b852"). InnerVolumeSpecName "kube-api-access-j8h22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:41:46.964615 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:46.964560    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8h22\" (UniqueName: \"kubernetes.io/projected/b9078e56-8e93-4b9d-855d-3c622fa1b852-kube-api-access-j8h22\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:41:47.625794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:47.625751    2547 generic.go:356] "Generic (PLEG): container finished" podID="b9078e56-8e93-4b9d-855d-3c622fa1b852" containerID="1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945" exitCode=137
Sep 11 13:41:47.626001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:47.625805    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:47.626001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:47.625850    2547 scope.go:117] "RemoveContainer" containerID="1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945"
Sep 11 13:41:47.635584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:47.635565    2547 scope.go:117] "RemoveContainer" containerID="1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945"
Sep 11 13:41:47.635950 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:47.635900    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945\": container with ID starting with 1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945 not found: ID does not exist" containerID="1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945"
Sep 11 13:41:47.636020 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:47.635964    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945"} err="failed to get container status \"1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945\": rpc error: code = NotFound desc = could not find container \"1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945\": container with ID starting with 1b2c0fab0154e1298a271ea93916f3abda45ab92e1869d4f1895f9224458d945 not found: ID does not exist"
Sep 11 13:41:47.637862 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:41:47.637840    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7740-a0a838\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="b9078e56-8e93-4b9d-855d-3c622fa1b852" pod="opendatahub/test-curl-7740-a0a838"
Sep 11 13:41:48.250306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:48.250269    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9078e56-8e93-4b9d-855d-3c622fa1b852" path="/var/lib/kubelet/pods/b9078e56-8e93-4b9d-855d-3c622fa1b852/volumes"
Sep 11 13:41:51.384700 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.384662    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"]
Sep 11 13:41:51.385299 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.385281    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9078e56-8e93-4b9d-855d-3c622fa1b852" containerName="test-curl-7740-a0a838"
Sep 11 13:41:51.385357 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.385303    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9078e56-8e93-4b9d-855d-3c622fa1b852" containerName="test-curl-7740-a0a838"
Sep 11 13:41:51.385416 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.385405    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9078e56-8e93-4b9d-855d-3c622fa1b852" containerName="test-curl-7740-a0a838"
Sep 11 13:41:51.390484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.390445    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.393308 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.393283    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ceb67528-serving-cert\""
Sep 11 13:41:51.401272 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.401243    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"]
Sep 11 13:41:51.507476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.507430    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35497b5-14c0-4a85-9b14-8f1d023c90c5-openshift-service-ca\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.507476 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.507475    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whwn\" (UniqueName: \"kubernetes.io/projected/f35497b5-14c0-4a85-9b14-8f1d023c90c5-kube-api-access-2whwn\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.507745 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.507565    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-metrics-certs\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.507745 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.507651    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-maas-api-tls\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.608337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.608293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35497b5-14c0-4a85-9b14-8f1d023c90c5-openshift-service-ca\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.608337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.608335    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whwn\" (UniqueName: \"kubernetes.io/projected/f35497b5-14c0-4a85-9b14-8f1d023c90c5-kube-api-access-2whwn\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.608613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.608366    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-metrics-certs\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.608613 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.608403    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-maas-api-tls\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.609131 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.609105    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35497b5-14c0-4a85-9b14-8f1d023c90c5-openshift-service-ca\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.611111 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.611084    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-maas-api-tls\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.611220 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.611087    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-metrics-certs\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.617804 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.617772    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whwn\" (UniqueName: \"kubernetes.io/projected/f35497b5-14c0-4a85-9b14-8f1d023c90c5-kube-api-access-2whwn\") pod \"maas-api-e2e-mt-ceb67528-57d676db8-mrdvr\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.705385 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.705282    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:51.991612 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:51.991579    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"]
Sep 11 13:41:51.994325 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:41:51.994291    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35497b5_14c0_4a85_9b14_8f1d023c90c5.slice/crio-9944d07c994c35a50dbc912ab322170cafce1150a41a1a3f273d30b119f7e4e0 WatchSource:0}: Error finding container 9944d07c994c35a50dbc912ab322170cafce1150a41a1a3f273d30b119f7e4e0: Status 404 returned error can't find the container with id 9944d07c994c35a50dbc912ab322170cafce1150a41a1a3f273d30b119f7e4e0
Sep 11 13:41:52.657532 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:52.657499    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr" event={"ID":"f35497b5-14c0-4a85-9b14-8f1d023c90c5","Type":"ContainerStarted","Data":"9944d07c994c35a50dbc912ab322170cafce1150a41a1a3f273d30b119f7e4e0"}
Sep 11 13:41:53.665361 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:53.665324    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr" event={"ID":"f35497b5-14c0-4a85-9b14-8f1d023c90c5","Type":"ContainerStarted","Data":"255fb353e13c2f366130e8d2313cfe75998cdc7cbd51af6e76c1dda1c9fa065b"}
Sep 11 13:41:53.665778 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:53.665387    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:41:53.687420 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:53.687346    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr" podStartSLOduration=2.069711245 podStartE2EDuration="2.687326448s" totalImagesPullingTime="617.615203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:41:53.684697601 +0000 UTC m=+1329.897241402" watchObservedRunningTime="2026-09-11 13:41:53.687326448 +0000 UTC m=+1329.899870245"
Sep 11 13:41:58.115443 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:58.115399    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:41:59.676568 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:41:59.676538    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:42:16.029448 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:42:16.029368    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:42:29.016159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:42:29.016115    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:42:46.506075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:42:46.506036    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:43:05.332705 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:05.332667    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:43:22.903994 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:22.903951    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:43:29.064207 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.064168    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"]
Sep 11 13:43:29.064679 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.064429    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr" podUID="f35497b5-14c0-4a85-9b14-8f1d023c90c5" containerName="maas-api" containerID="cri-o://255fb353e13c2f366130e8d2313cfe75998cdc7cbd51af6e76c1dda1c9fa065b" gracePeriod=30
Sep 11 13:43:29.222022 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.221989    2547 generic.go:356] "Generic (PLEG): container finished" podID="f35497b5-14c0-4a85-9b14-8f1d023c90c5" containerID="255fb353e13c2f366130e8d2313cfe75998cdc7cbd51af6e76c1dda1c9fa065b" exitCode=0
Sep 11 13:43:29.222197 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.222060    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr" event={"ID":"f35497b5-14c0-4a85-9b14-8f1d023c90c5","Type":"ContainerDied","Data":"255fb353e13c2f366130e8d2313cfe75998cdc7cbd51af6e76c1dda1c9fa065b"}
Sep 11 13:43:29.325719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.325651    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:43:29.409454 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.409416    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2whwn\" (UniqueName: \"kubernetes.io/projected/f35497b5-14c0-4a85-9b14-8f1d023c90c5-kube-api-access-2whwn\") pod \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") "
Sep 11 13:43:29.409626 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.409514    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-metrics-certs\") pod \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") "
Sep 11 13:43:29.409670 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.409621    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35497b5-14c0-4a85-9b14-8f1d023c90c5-openshift-service-ca\") pod \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") "
Sep 11 13:43:29.409708 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.409667    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-maas-api-tls\") pod \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\" (UID: \"f35497b5-14c0-4a85-9b14-8f1d023c90c5\") "
Sep 11 13:43:29.410011 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.409966    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f35497b5-14c0-4a85-9b14-8f1d023c90c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f35497b5-14c0-4a85-9b14-8f1d023c90c5" (UID: "f35497b5-14c0-4a85-9b14-8f1d023c90c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:43:29.410142 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.410083    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f35497b5-14c0-4a85-9b14-8f1d023c90c5-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:43:29.411814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.411786    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f35497b5-14c0-4a85-9b14-8f1d023c90c5" (UID: "f35497b5-14c0-4a85-9b14-8f1d023c90c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:43:29.411995 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.411906    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f35497b5-14c0-4a85-9b14-8f1d023c90c5-kube-api-access-2whwn" (OuterVolumeSpecName: "kube-api-access-2whwn") pod "f35497b5-14c0-4a85-9b14-8f1d023c90c5" (UID: "f35497b5-14c0-4a85-9b14-8f1d023c90c5"). InnerVolumeSpecName "kube-api-access-2whwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:43:29.412186 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.412167    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f35497b5-14c0-4a85-9b14-8f1d023c90c5" (UID: "f35497b5-14c0-4a85-9b14-8f1d023c90c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:43:29.510758 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.510723    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:43:29.510758 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.510757    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f35497b5-14c0-4a85-9b14-8f1d023c90c5-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:43:29.511034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:29.510767    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2whwn\" (UniqueName: \"kubernetes.io/projected/f35497b5-14c0-4a85-9b14-8f1d023c90c5-kube-api-access-2whwn\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:43:30.229544 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:30.229508    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"
Sep 11 13:43:30.229969 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:30.229520    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr" event={"ID":"f35497b5-14c0-4a85-9b14-8f1d023c90c5","Type":"ContainerDied","Data":"9944d07c994c35a50dbc912ab322170cafce1150a41a1a3f273d30b119f7e4e0"}
Sep 11 13:43:30.229969 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:30.229648    2547 scope.go:117] "RemoveContainer" containerID="255fb353e13c2f366130e8d2313cfe75998cdc7cbd51af6e76c1dda1c9fa065b"
Sep 11 13:43:30.257988 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:30.257940    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"]
Sep 11 13:43:30.261370 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:30.261337    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ceb67528-57d676db8-mrdvr"]
Sep 11 13:43:32.253444 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:32.253400    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f35497b5-14c0-4a85-9b14-8f1d023c90c5" path="/var/lib/kubelet/pods/f35497b5-14c0-4a85-9b14-8f1d023c90c5/volumes"
Sep 11 13:43:43.810826 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:43.810785    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:43:57.128190 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:43:57.128150    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:44:08.211226 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.211179    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7743-e59708"]
Sep 11 13:44:08.211634 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.211572    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f35497b5-14c0-4a85-9b14-8f1d023c90c5" containerName="maas-api"
Sep 11 13:44:08.211634 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.211589    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f35497b5-14c0-4a85-9b14-8f1d023c90c5" containerName="maas-api"
Sep 11 13:44:08.211710 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.211675    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f35497b5-14c0-4a85-9b14-8f1d023c90c5" containerName="maas-api"
Sep 11 13:44:08.216191 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.216166    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:08.219465 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.219434    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jcb7l\""
Sep 11 13:44:08.234463 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.234426    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7743-e59708"]
Sep 11 13:44:08.363308 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.363265    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns67t\" (UniqueName: \"kubernetes.io/projected/a5b56673-6d57-465d-98ef-1de02a3a39db-kube-api-access-ns67t\") pod \"test-curl-7743-e59708\" (UID: \"a5b56673-6d57-465d-98ef-1de02a3a39db\") " pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:08.465260 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.465158    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns67t\" (UniqueName: \"kubernetes.io/projected/a5b56673-6d57-465d-98ef-1de02a3a39db-kube-api-access-ns67t\") pod \"test-curl-7743-e59708\" (UID: \"a5b56673-6d57-465d-98ef-1de02a3a39db\") " pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:08.477488 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.477457    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns67t\" (UniqueName: \"kubernetes.io/projected/a5b56673-6d57-465d-98ef-1de02a3a39db-kube-api-access-ns67t\") pod \"test-curl-7743-e59708\" (UID: \"a5b56673-6d57-465d-98ef-1de02a3a39db\") " pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:08.526194 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.526158    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:08.810285 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:08.810174    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7743-e59708"]
Sep 11 13:44:08.821205 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:44:08.821162    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5b56673_6d57_465d_98ef_1de02a3a39db.slice/crio-fc3ae83098b7a56613f28ab69dff8baf5afff655c1a3196f8c097533f8c950dd WatchSource:0}: Error finding container fc3ae83098b7a56613f28ab69dff8baf5afff655c1a3196f8c097533f8c950dd: Status 404 returned error can't find the container with id fc3ae83098b7a56613f28ab69dff8baf5afff655c1a3196f8c097533f8c950dd
Sep 11 13:44:09.451812 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:09.451767    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7743-e59708" event={"ID":"a5b56673-6d57-465d-98ef-1de02a3a39db","Type":"ContainerStarted","Data":"b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685"}
Sep 11 13:44:09.452241 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:09.451826    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7743-e59708" event={"ID":"a5b56673-6d57-465d-98ef-1de02a3a39db","Type":"ContainerStarted","Data":"fc3ae83098b7a56613f28ab69dff8baf5afff655c1a3196f8c097533f8c950dd"}
Sep 11 13:44:09.477496 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:09.477440    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7743-e59708" podStartSLOduration=1.477424202 podStartE2EDuration="1.477424202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:44:09.476051967 +0000 UTC m=+1465.688595781" watchObservedRunningTime="2026-09-11 13:44:09.477424202 +0000 UTC m=+1465.689968052"
Sep 11 13:44:10.294382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:10.294293    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7743-e59708"]
Sep 11 13:44:10.303505 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:10.303470    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7743-e59708"]
Sep 11 13:44:10.457147 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:44:10.457110    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7743-e59708" container="test-curl-7743-e59708"
Sep 11 13:44:11.463320 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:11.463276    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7743-e59708" podUID="a5b56673-6d57-465d-98ef-1de02a3a39db" containerName="test-curl-7743-e59708" containerID="cri-o://b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685" gracePeriod=2
Sep 11 13:44:11.467655 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:44:11.467621    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7743-e59708\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="a5b56673-6d57-465d-98ef-1de02a3a39db" pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:12.272618 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:12.272577    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:44:13.609765 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:13.609731    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:13.715817 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:13.715772    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns67t\" (UniqueName: \"kubernetes.io/projected/a5b56673-6d57-465d-98ef-1de02a3a39db-kube-api-access-ns67t\") pod \"a5b56673-6d57-465d-98ef-1de02a3a39db\" (UID: \"a5b56673-6d57-465d-98ef-1de02a3a39db\") "
Sep 11 13:44:13.717891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:13.717825    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5b56673-6d57-465d-98ef-1de02a3a39db-kube-api-access-ns67t" (OuterVolumeSpecName: "kube-api-access-ns67t") pod "a5b56673-6d57-465d-98ef-1de02a3a39db" (UID: "a5b56673-6d57-465d-98ef-1de02a3a39db"). InnerVolumeSpecName "kube-api-access-ns67t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:44:13.817277 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:13.817224    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns67t\" (UniqueName: \"kubernetes.io/projected/a5b56673-6d57-465d-98ef-1de02a3a39db-kube-api-access-ns67t\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:44:14.249642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:14.249605    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5b56673-6d57-465d-98ef-1de02a3a39db" path="/var/lib/kubelet/pods/a5b56673-6d57-465d-98ef-1de02a3a39db/volumes"
Sep 11 13:44:14.481739 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:14.481706    2547 generic.go:356] "Generic (PLEG): container finished" podID="a5b56673-6d57-465d-98ef-1de02a3a39db" containerID="b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685" exitCode=137
Sep 11 13:44:14.481946 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:14.481755    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-e59708"
Sep 11 13:44:14.481946 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:14.481766    2547 scope.go:117] "RemoveContainer" containerID="b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685"
Sep 11 13:44:14.491176 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:14.491146    2547 scope.go:117] "RemoveContainer" containerID="b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685"
Sep 11 13:44:14.491566 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:44:14.491546    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685\": container with ID starting with b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685 not found: ID does not exist" containerID="b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685"
Sep 11 13:44:14.491636 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:14.491576    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685"} err="failed to get container status \"b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685\": rpc error: code = NotFound desc = could not find container \"b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685\": container with ID starting with b447b64177fd82bed3a9a1b95230e55e70db5f1a7d095bd1576f9e4521f8d685 not found: ID does not exist"
Sep 11 13:44:26.719713 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:26.719674    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:44:39.132628 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:39.132585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:44:44.291591 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:44.291555    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:44:44.298959 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:44.298929    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:44:52.637748 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:44:52.637706    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:45:04.935932 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:04.935875    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:45:16.736719 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:16.736635    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:45:33.811231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:33.811191    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:45:36.935700 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.935667    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"]
Sep 11 13:45:36.936182 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.936080    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5b56673-6d57-465d-98ef-1de02a3a39db" containerName="test-curl-7743-e59708"
Sep 11 13:45:36.936182 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.936093    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5b56673-6d57-465d-98ef-1de02a3a39db" containerName="test-curl-7743-e59708"
Sep 11 13:45:36.936182 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.936161    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5b56673-6d57-465d-98ef-1de02a3a39db" containerName="test-curl-7743-e59708"
Sep 11 13:45:36.939508 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.939483    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:36.942325 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.942303    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-65a9ed-serving-cert\""
Sep 11 13:45:36.956764 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:36.956736    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"]
Sep 11 13:45:37.039545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.039508    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-maas-api-tls\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.039545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.039549    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-metrics-certs\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.039777 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.039655    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6g4\" (UniqueName: \"kubernetes.io/projected/af5d4fa7-a685-4bb5-ad3e-558906a04907-kube-api-access-vc6g4\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.039823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.039776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af5d4fa7-a685-4bb5-ad3e-558906a04907-openshift-service-ca\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.140641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.140607    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af5d4fa7-a685-4bb5-ad3e-558906a04907-openshift-service-ca\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.140641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.140650    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-maas-api-tls\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.140894 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.140672    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-metrics-certs\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.140894 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.140800    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6g4\" (UniqueName: \"kubernetes.io/projected/af5d4fa7-a685-4bb5-ad3e-558906a04907-kube-api-access-vc6g4\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.141442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.141413    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af5d4fa7-a685-4bb5-ad3e-558906a04907-openshift-service-ca\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.143254 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.143230    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-metrics-certs\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.143254 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.143245    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-maas-api-tls\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.151004 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.150981    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6g4\" (UniqueName: \"kubernetes.io/projected/af5d4fa7-a685-4bb5-ad3e-558906a04907-kube-api-access-vc6g4\") pod \"maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.251300 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.251209    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:37.374903 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.374866    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7743-5c5b04"]
Sep 11 13:45:37.378716 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.378693    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:37.383958 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.383904    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jcb7l\""
Sep 11 13:45:37.391223 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.391197    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7743-5c5b04"]
Sep 11 13:45:37.534426 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.534394    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"]
Sep 11 13:45:37.535622 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:45:37.535598    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf5d4fa7_a685_4bb5_ad3e_558906a04907.slice/crio-6ee270c2f8f03717b04619a11be9bb1866963244daa65aadd38a726333560fe5 WatchSource:0}: Error finding container 6ee270c2f8f03717b04619a11be9bb1866963244daa65aadd38a726333560fe5: Status 404 returned error can't find the container with id 6ee270c2f8f03717b04619a11be9bb1866963244daa65aadd38a726333560fe5
Sep 11 13:45:37.537411 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.537389    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:45:37.544543 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.544517    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfsk4\" (UniqueName: \"kubernetes.io/projected/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95-kube-api-access-mfsk4\") pod \"test-curl-7743-5c5b04\" (UID: \"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95\") " pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:37.645135 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.645099    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfsk4\" (UniqueName: \"kubernetes.io/projected/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95-kube-api-access-mfsk4\") pod \"test-curl-7743-5c5b04\" (UID: \"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95\") " pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:37.653922 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.653894    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfsk4\" (UniqueName: \"kubernetes.io/projected/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95-kube-api-access-mfsk4\") pod \"test-curl-7743-5c5b04\" (UID: \"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95\") " pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:37.689574 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.689529    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:37.957457 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.957421    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg" event={"ID":"af5d4fa7-a685-4bb5-ad3e-558906a04907","Type":"ContainerStarted","Data":"6ee270c2f8f03717b04619a11be9bb1866963244daa65aadd38a726333560fe5"}
Sep 11 13:45:37.974236 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:37.974208    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7743-5c5b04"]
Sep 11 13:45:37.975733 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:45:37.975711    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e7e43cd_c47f_48ae_8813_ee5bbeb2cc95.slice/crio-8730e9a6034732aaaa8792b23eaf5608fca4f8ae823fba9450c1fb730cda98bf WatchSource:0}: Error finding container 8730e9a6034732aaaa8792b23eaf5608fca4f8ae823fba9450c1fb730cda98bf: Status 404 returned error can't find the container with id 8730e9a6034732aaaa8792b23eaf5608fca4f8ae823fba9450c1fb730cda98bf
Sep 11 13:45:38.965237 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:38.965177    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7743-5c5b04" event={"ID":"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95","Type":"ContainerStarted","Data":"d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136"}
Sep 11 13:45:38.965237 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:38.965242    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7743-5c5b04" event={"ID":"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95","Type":"ContainerStarted","Data":"8730e9a6034732aaaa8792b23eaf5608fca4f8ae823fba9450c1fb730cda98bf"}
Sep 11 13:45:38.966870 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:38.966843    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg" event={"ID":"af5d4fa7-a685-4bb5-ad3e-558906a04907","Type":"ContainerStarted","Data":"1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de"}
Sep 11 13:45:38.966980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:38.966965    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:38.986423 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:38.986361    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7743-5c5b04" podStartSLOduration=1.986341999 podStartE2EDuration="1.986341999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:45:38.984852347 +0000 UTC m=+1555.197396147" watchObservedRunningTime="2026-09-11 13:45:38.986341999 +0000 UTC m=+1555.198885793"
Sep 11 13:45:39.016642 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.016584    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg" podStartSLOduration=2.545801886 podStartE2EDuration="3.016565242s" totalImagesPullingTime="470.763356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:45:39.014311095 +0000 UTC m=+1555.226854896" watchObservedRunningTime="2026-09-11 13:45:39.016565242 +0000 UTC m=+1555.229109043"
Sep 11 13:45:39.748251 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.748210    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7743-5c5b04"]
Sep 11 13:45:39.751705 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.751673    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7743-5c5b04"]
Sep 11 13:45:39.892490 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.892451    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7743-f555b7"]
Sep 11 13:45:39.892904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.892888    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" containerName="test-curl-7743-5c5b04"
Sep 11 13:45:39.893008 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.892905    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" containerName="test-curl-7743-5c5b04"
Sep 11 13:45:39.893008 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.892996    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" containerName="test-curl-7743-5c5b04"
Sep 11 13:45:39.896367 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.896346    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:39.903823 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:39.903794    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7743-f555b7"]
Sep 11 13:45:39.972836 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:39.972803    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7743-5c5b04" container="test-curl-7743-5c5b04"
Sep 11 13:45:40.069052 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.069017    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9n9\" (UniqueName: \"kubernetes.io/projected/691a7e76-23a5-40ca-b76c-3f4445b91d29-kube-api-access-4q9n9\") pod \"test-curl-7743-f555b7\" (UID: \"691a7e76-23a5-40ca-b76c-3f4445b91d29\") " pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:40.170677 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.170572    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9n9\" (UniqueName: \"kubernetes.io/projected/691a7e76-23a5-40ca-b76c-3f4445b91d29-kube-api-access-4q9n9\") pod \"test-curl-7743-f555b7\" (UID: \"691a7e76-23a5-40ca-b76c-3f4445b91d29\") " pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:40.180639 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.180606    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9n9\" (UniqueName: \"kubernetes.io/projected/691a7e76-23a5-40ca-b76c-3f4445b91d29-kube-api-access-4q9n9\") pod \"test-curl-7743-f555b7\" (UID: \"691a7e76-23a5-40ca-b76c-3f4445b91d29\") " pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:40.207324 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.207282    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:40.491351 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.491325    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7743-f555b7"]
Sep 11 13:45:40.493451 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:45:40.493413    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod691a7e76_23a5_40ca_b76c_3f4445b91d29.slice/crio-d2986e47453db402f7b25377f200b94209905b70167276333d18a4c081b8a6a5 WatchSource:0}: Error finding container d2986e47453db402f7b25377f200b94209905b70167276333d18a4c081b8a6a5: Status 404 returned error can't find the container with id d2986e47453db402f7b25377f200b94209905b70167276333d18a4c081b8a6a5
Sep 11 13:45:40.981083 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.981041    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7743-f555b7" event={"ID":"691a7e76-23a5-40ca-b76c-3f4445b91d29","Type":"ContainerStarted","Data":"b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2"}
Sep 11 13:45:40.981557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.981093    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7743-f555b7" event={"ID":"691a7e76-23a5-40ca-b76c-3f4445b91d29","Type":"ContainerStarted","Data":"d2986e47453db402f7b25377f200b94209905b70167276333d18a4c081b8a6a5"}
Sep 11 13:45:40.981557 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:40.981136    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7743-5c5b04" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" containerName="test-curl-7743-5c5b04" containerID="cri-o://d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136" gracePeriod=2
Sep 11 13:45:41.009210 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:41.009096    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7743-f555b7" podStartSLOduration=2.009078915 podStartE2EDuration="2.009078915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:45:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:45:41.00794806 +0000 UTC m=+1557.220491861" watchObservedRunningTime="2026-09-11 13:45:41.009078915 +0000 UTC m=+1557.221622715"
Sep 11 13:45:41.696175 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:41.696081    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7743-f555b7"]
Sep 11 13:45:41.704154 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:41.704115    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7743-f555b7"]
Sep 11 13:45:41.988250 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:41.988162    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7743-f555b7" container="test-curl-7743-f555b7"
Sep 11 13:45:42.993826 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:42.993785    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7743-f555b7" podUID="691a7e76-23a5-40ca-b76c-3f4445b91d29" containerName="test-curl-7743-f555b7" containerID="cri-o://b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2" gracePeriod=2
Sep 11 13:45:43.148814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:43.148788    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:43.195663 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:43.195626    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfsk4\" (UniqueName: \"kubernetes.io/projected/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95-kube-api-access-mfsk4\") pod \"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95\" (UID: \"9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95\") "
Sep 11 13:45:43.197756 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:43.197727    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95-kube-api-access-mfsk4" (OuterVolumeSpecName: "kube-api-access-mfsk4") pod "9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" (UID: "9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95"). InnerVolumeSpecName "kube-api-access-mfsk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:45:43.297041 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:43.296946    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfsk4\" (UniqueName: \"kubernetes.io/projected/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95-kube-api-access-mfsk4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:45:44.001177 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.001139    2547 generic.go:356] "Generic (PLEG): container finished" podID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" containerID="d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136" exitCode=137
Sep 11 13:45:44.001177 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.001178    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:44.001793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.001245    2547 scope.go:117] "RemoveContainer" containerID="d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136"
Sep 11 13:45:44.011809 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.011785    2547 scope.go:117] "RemoveContainer" containerID="d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136"
Sep 11 13:45:44.012241 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:44.012216    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136\": container with ID starting with d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136 not found: ID does not exist" containerID="d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136"
Sep 11 13:45:44.012309 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.012251    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136"} err="failed to get container status \"d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136\": rpc error: code = NotFound desc = could not find container \"d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136\": container with ID starting with d1d9eaf344bdf91aade2b53b0939befbfb9b2d53d3f02c5f9a48423d9c1c0136 not found: ID does not exist"
Sep 11 13:45:44.014057 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:44.014037    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7743-5c5b04\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:44.248019 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:44.247976    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7743-5c5b04\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" pod="opendatahub/test-curl-7743-5c5b04"
Sep 11 13:45:44.249588 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.249565    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95" path="/var/lib/kubelet/pods/9e7e43cd-c47f-48ae-8813-ee5bbeb2cc95/volumes"
Sep 11 13:45:44.977969 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:44.977940    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:45:45.188175 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:45.188148    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:45.214942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:45.214898    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9n9\" (UniqueName: \"kubernetes.io/projected/691a7e76-23a5-40ca-b76c-3f4445b91d29-kube-api-access-4q9n9\") pod \"691a7e76-23a5-40ca-b76c-3f4445b91d29\" (UID: \"691a7e76-23a5-40ca-b76c-3f4445b91d29\") "
Sep 11 13:45:45.217056 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:45.217026    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691a7e76-23a5-40ca-b76c-3f4445b91d29-kube-api-access-4q9n9" (OuterVolumeSpecName: "kube-api-access-4q9n9") pod "691a7e76-23a5-40ca-b76c-3f4445b91d29" (UID: "691a7e76-23a5-40ca-b76c-3f4445b91d29"). InnerVolumeSpecName "kube-api-access-4q9n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:45:45.316157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:45.316063    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q9n9\" (UniqueName: \"kubernetes.io/projected/691a7e76-23a5-40ca-b76c-3f4445b91d29-kube-api-access-4q9n9\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:45:46.013895 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:46.013860    2547 generic.go:356] "Generic (PLEG): container finished" podID="691a7e76-23a5-40ca-b76c-3f4445b91d29" containerID="b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2" exitCode=137
Sep 11 13:45:46.014093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:46.013907    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:46.014093 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:46.013963    2547 scope.go:117] "RemoveContainer" containerID="b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2"
Sep 11 13:45:46.023434 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:46.023413    2547 scope.go:117] "RemoveContainer" containerID="b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2"
Sep 11 13:45:46.023745 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:46.023719    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2\": container with ID starting with b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2 not found: ID does not exist" containerID="b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2"
Sep 11 13:45:46.023843 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:46.023752    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2"} err="failed to get container status \"b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2\": rpc error: code = NotFound desc = could not find container \"b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2\": container with ID starting with b05ef3fc7ce611bf6d1638d05be4c025f8ce3e169f29007d99ee4256743caab2 not found: ID does not exist"
Sep 11 13:45:46.024630 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:45:46.024607    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7743-f555b7\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="691a7e76-23a5-40ca-b76c-3f4445b91d29" pod="opendatahub/test-curl-7743-f555b7"
Sep 11 13:45:46.249001 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:46.248965    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="691a7e76-23a5-40ca-b76c-3f4445b91d29" path="/var/lib/kubelet/pods/691a7e76-23a5-40ca-b76c-3f4445b91d29/volumes"
Sep 11 13:45:52.537573 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:45:52.537535    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:46:03.875559 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:03.875513    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:46:10.068415 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.068377    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"]
Sep 11 13:46:10.069042 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.069024    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691a7e76-23a5-40ca-b76c-3f4445b91d29" containerName="test-curl-7743-f555b7"
Sep 11 13:46:10.069125 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.069046    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="691a7e76-23a5-40ca-b76c-3f4445b91d29" containerName="test-curl-7743-f555b7"
Sep 11 13:46:10.069192 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.069173    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="691a7e76-23a5-40ca-b76c-3f4445b91d29" containerName="test-curl-7743-f555b7"
Sep 11 13:46:10.072904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.072878    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.078418 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.078385    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ab77a5-serving-cert\""
Sep 11 13:46:10.089964 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.089936    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"]
Sep 11 13:46:10.146644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.146609    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-metrics-certs\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.146835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.146679    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cdde98-b905-4b0c-bbd0-f870faea635e-openshift-service-ca\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.146835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.146773    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.146835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.146808    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tsnx\" (UniqueName: \"kubernetes.io/projected/a3cdde98-b905-4b0c-bbd0-f870faea635e-kube-api-access-7tsnx\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.247278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.247246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.247484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.247286    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsnx\" (UniqueName: \"kubernetes.io/projected/a3cdde98-b905-4b0c-bbd0-f870faea635e-kube-api-access-7tsnx\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.247484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.247319    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-metrics-certs\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.247484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.247375    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cdde98-b905-4b0c-bbd0-f870faea635e-openshift-service-ca\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.247484 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:46:10.247447    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-serving-cert: secret "maas-api-e2e-api-b-ab77a5-serving-cert" not found
Sep 11 13:46:10.247707 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:46:10.247527    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls podName:a3cdde98-b905-4b0c-bbd0-f870faea635e nodeName:}" failed. No retries permitted until 2026-09-11 13:46:10.747505465 +0000 UTC m=+1586.960049263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls") pod "maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" (UID: "a3cdde98-b905-4b0c-bbd0-f870faea635e") : secret "maas-api-e2e-api-b-ab77a5-serving-cert" not found
Sep 11 13:46:10.248117 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.248093    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cdde98-b905-4b0c-bbd0-f870faea635e-openshift-service-ca\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.249902 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.249881    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-metrics-certs\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.263246 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.263221    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tsnx\" (UniqueName: \"kubernetes.io/projected/a3cdde98-b905-4b0c-bbd0-f870faea635e-kube-api-access-7tsnx\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.753669 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.753629    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.756101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.756077    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls\") pod \"maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:10.983904 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:10.983863    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:11.272641 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:11.272613    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"]
Sep 11 13:46:11.273712 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:46:11.273685    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3cdde98_b905_4b0c_bbd0_f870faea635e.slice/crio-7dd00c323d4980fc25e88bec58734057e63ee23a5b532a4c5226abe981b5450e WatchSource:0}: Error finding container 7dd00c323d4980fc25e88bec58734057e63ee23a5b532a4c5226abe981b5450e: Status 404 returned error can't find the container with id 7dd00c323d4980fc25e88bec58734057e63ee23a5b532a4c5226abe981b5450e
Sep 11 13:46:12.171035 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:12.170981    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" event={"ID":"a3cdde98-b905-4b0c-bbd0-f870faea635e","Type":"ContainerStarted","Data":"c50c05991b177d839e74a1f824760c50180ea53ed6b32ae916d079615812eaac"}
Sep 11 13:46:12.171224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:12.171150    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:12.171224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:12.171173    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" event={"ID":"a3cdde98-b905-4b0c-bbd0-f870faea635e","Type":"ContainerStarted","Data":"7dd00c323d4980fc25e88bec58734057e63ee23a5b532a4c5226abe981b5450e"}
Sep 11 13:46:12.197086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:12.197030    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" podStartSLOduration=1.769031588 podStartE2EDuration="2.197011889s" totalImagesPullingTime="427.980301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:46:12.195410842 +0000 UTC m=+1588.407954641" watchObservedRunningTime="2026-09-11 13:46:12.197011889 +0000 UTC m=+1588.409555708"
Sep 11 13:46:18.182571 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:18.182539    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:46:25.187615 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:25.187570    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:46:50.480842 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:50.480797    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:46:56.150962 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.150921    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"]
Sep 11 13:46:56.151446 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.151163    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg" podUID="af5d4fa7-a685-4bb5-ad3e-558906a04907" containerName="maas-api" containerID="cri-o://1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de" gracePeriod=30
Sep 11 13:46:56.413588 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.413520    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:46:56.433834 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.433798    2547 generic.go:356] "Generic (PLEG): container finished" podID="af5d4fa7-a685-4bb5-ad3e-558906a04907" containerID="1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de" exitCode=0
Sep 11 13:46:56.434038 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.433842    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"
Sep 11 13:46:56.434038 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.433852    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg" event={"ID":"af5d4fa7-a685-4bb5-ad3e-558906a04907","Type":"ContainerDied","Data":"1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de"}
Sep 11 13:46:56.434038 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.433901    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg" event={"ID":"af5d4fa7-a685-4bb5-ad3e-558906a04907","Type":"ContainerDied","Data":"6ee270c2f8f03717b04619a11be9bb1866963244daa65aadd38a726333560fe5"}
Sep 11 13:46:56.434038 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.433936    2547 scope.go:117] "RemoveContainer" containerID="1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de"
Sep 11 13:46:56.443295 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.443272    2547 scope.go:117] "RemoveContainer" containerID="1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de"
Sep 11 13:46:56.443624 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:46:56.443598    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de\": container with ID starting with 1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de not found: ID does not exist" containerID="1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de"
Sep 11 13:46:56.443672 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.443634    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de"} err="failed to get container status \"1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de\": rpc error: code = NotFound desc = could not find container \"1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de\": container with ID starting with 1cf241261acb2aeb19a8d4390bb0a8eea61ce708e3fedaff3545a36f7e57d9de not found: ID does not exist"
Sep 11 13:46:56.503973 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.503934    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af5d4fa7-a685-4bb5-ad3e-558906a04907-openshift-service-ca\") pod \"af5d4fa7-a685-4bb5-ad3e-558906a04907\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") "
Sep 11 13:46:56.504149 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.504010    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-maas-api-tls\") pod \"af5d4fa7-a685-4bb5-ad3e-558906a04907\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") "
Sep 11 13:46:56.504149 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.504110    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc6g4\" (UniqueName: \"kubernetes.io/projected/af5d4fa7-a685-4bb5-ad3e-558906a04907-kube-api-access-vc6g4\") pod \"af5d4fa7-a685-4bb5-ad3e-558906a04907\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") "
Sep 11 13:46:56.504239 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.504160    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-metrics-certs\") pod \"af5d4fa7-a685-4bb5-ad3e-558906a04907\" (UID: \"af5d4fa7-a685-4bb5-ad3e-558906a04907\") "
Sep 11 13:46:56.504391 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.504370    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af5d4fa7-a685-4bb5-ad3e-558906a04907-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af5d4fa7-a685-4bb5-ad3e-558906a04907" (UID: "af5d4fa7-a685-4bb5-ad3e-558906a04907"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:46:56.504520 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.504505    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af5d4fa7-a685-4bb5-ad3e-558906a04907-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:46:56.506334 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.506305    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "af5d4fa7-a685-4bb5-ad3e-558906a04907" (UID: "af5d4fa7-a685-4bb5-ad3e-558906a04907"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:46:56.506334 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.506324    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af5d4fa7-a685-4bb5-ad3e-558906a04907" (UID: "af5d4fa7-a685-4bb5-ad3e-558906a04907"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:46:56.506493 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.506324    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af5d4fa7-a685-4bb5-ad3e-558906a04907-kube-api-access-vc6g4" (OuterVolumeSpecName: "kube-api-access-vc6g4") pod "af5d4fa7-a685-4bb5-ad3e-558906a04907" (UID: "af5d4fa7-a685-4bb5-ad3e-558906a04907"). InnerVolumeSpecName "kube-api-access-vc6g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:46:56.605703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.605659    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:46:56.605703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.605691    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af5d4fa7-a685-4bb5-ad3e-558906a04907-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:46:56.605703 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.605702    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc6g4\" (UniqueName: \"kubernetes.io/projected/af5d4fa7-a685-4bb5-ad3e-558906a04907-kube-api-access-vc6g4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:46:56.775607 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.775574    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"]
Sep 11 13:46:56.777970 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:56.777947    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-65a9ed-5b7ddd946c-zxrpg"]
Sep 11 13:46:58.249523 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:46:58.249487    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af5d4fa7-a685-4bb5-ad3e-558906a04907" path="/var/lib/kubelet/pods/af5d4fa7-a685-4bb5-ad3e-558906a04907/volumes"
Sep 11 13:47:11.142990 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:11.142942    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:47:22.329679 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.329642    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"]
Sep 11 13:47:22.330096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.329858    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" podUID="a3cdde98-b905-4b0c-bbd0-f870faea635e" containerName="maas-api" containerID="cri-o://c50c05991b177d839e74a1f824760c50180ea53ed6b32ae916d079615812eaac" gracePeriod=30
Sep 11 13:47:22.588211 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.588126    2547 generic.go:356] "Generic (PLEG): container finished" podID="a3cdde98-b905-4b0c-bbd0-f870faea635e" containerID="c50c05991b177d839e74a1f824760c50180ea53ed6b32ae916d079615812eaac" exitCode=0
Sep 11 13:47:22.588358 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.588202    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" event={"ID":"a3cdde98-b905-4b0c-bbd0-f870faea635e","Type":"ContainerDied","Data":"c50c05991b177d839e74a1f824760c50180ea53ed6b32ae916d079615812eaac"}
Sep 11 13:47:22.588358 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.588239    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:47:22.588358 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.588253    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl" event={"ID":"a3cdde98-b905-4b0c-bbd0-f870faea635e","Type":"ContainerDied","Data":"7dd00c323d4980fc25e88bec58734057e63ee23a5b532a4c5226abe981b5450e"}
Sep 11 13:47:22.588358 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.588269    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd00c323d4980fc25e88bec58734057e63ee23a5b532a4c5226abe981b5450e"
Sep 11 13:47:22.668033 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.667995    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cdde98-b905-4b0c-bbd0-f870faea635e-openshift-service-ca\") pod \"a3cdde98-b905-4b0c-bbd0-f870faea635e\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") "
Sep 11 13:47:22.668227 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.668057    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tsnx\" (UniqueName: \"kubernetes.io/projected/a3cdde98-b905-4b0c-bbd0-f870faea635e-kube-api-access-7tsnx\") pod \"a3cdde98-b905-4b0c-bbd0-f870faea635e\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") "
Sep 11 13:47:22.668227 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.668133    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls\") pod \"a3cdde98-b905-4b0c-bbd0-f870faea635e\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") "
Sep 11 13:47:22.668227 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.668189    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-metrics-certs\") pod \"a3cdde98-b905-4b0c-bbd0-f870faea635e\" (UID: \"a3cdde98-b905-4b0c-bbd0-f870faea635e\") "
Sep 11 13:47:22.668486 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.668454    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3cdde98-b905-4b0c-bbd0-f870faea635e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3cdde98-b905-4b0c-bbd0-f870faea635e" (UID: "a3cdde98-b905-4b0c-bbd0-f870faea635e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:47:22.670388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.670341    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3cdde98-b905-4b0c-bbd0-f870faea635e" (UID: "a3cdde98-b905-4b0c-bbd0-f870faea635e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:47:22.670388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.670360    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a3cdde98-b905-4b0c-bbd0-f870faea635e" (UID: "a3cdde98-b905-4b0c-bbd0-f870faea635e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:47:22.670553 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.670389    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3cdde98-b905-4b0c-bbd0-f870faea635e-kube-api-access-7tsnx" (OuterVolumeSpecName: "kube-api-access-7tsnx") pod "a3cdde98-b905-4b0c-bbd0-f870faea635e" (UID: "a3cdde98-b905-4b0c-bbd0-f870faea635e"). InnerVolumeSpecName "kube-api-access-7tsnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:22.769086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.769050    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:22.769086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.769079    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cdde98-b905-4b0c-bbd0-f870faea635e-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:22.769086 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.769088    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cdde98-b905-4b0c-bbd0-f870faea635e-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:22.769334 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:22.769100    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tsnx\" (UniqueName: \"kubernetes.io/projected/a3cdde98-b905-4b0c-bbd0-f870faea635e-kube-api-access-7tsnx\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:23.594471 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:23.594439    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"
Sep 11 13:47:23.623125 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:23.623084    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"]
Sep 11 13:47:23.628997 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:23.628963    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ab77a5-545c5f8b4f-wwlrl"]
Sep 11 13:47:24.129891 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:24.129843    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:47:24.249231 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:24.249197    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3cdde98-b905-4b0c-bbd0-f870faea635e" path="/var/lib/kubelet/pods/a3cdde98-b905-4b0c-bbd0-f870faea635e/volumes"
Sep 11 13:47:41.435023 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:41.434974    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:47:42.337044 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.336994    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"]
Sep 11 13:47:42.337295 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.337254    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" podUID="6c294b55-c12f-43f5-9950-3ac1937f0208" containerName="maas-api" containerID="cri-o://50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d" gracePeriod=30
Sep 11 13:47:42.599982 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.599883    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:47:42.704716 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.704684    2547 generic.go:356] "Generic (PLEG): container finished" podID="6c294b55-c12f-43f5-9950-3ac1937f0208" containerID="50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d" exitCode=0
Sep 11 13:47:42.704955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.704735    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"
Sep 11 13:47:42.704955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.704773    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" event={"ID":"6c294b55-c12f-43f5-9950-3ac1937f0208","Type":"ContainerDied","Data":"50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d"}
Sep 11 13:47:42.704955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.704832    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh" event={"ID":"6c294b55-c12f-43f5-9950-3ac1937f0208","Type":"ContainerDied","Data":"4e7170caca81c39cf4cc29915b72f62f8634856638cd79a614c231218e704c47"}
Sep 11 13:47:42.704955 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.704861    2547 scope.go:117] "RemoveContainer" containerID="50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d"
Sep 11 13:47:42.714484 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.714453    2547 scope.go:117] "RemoveContainer" containerID="50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d"
Sep 11 13:47:42.714845 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:47:42.714803    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d\": container with ID starting with 50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d not found: ID does not exist" containerID="50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d"
Sep 11 13:47:42.715040 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.714853    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d"} err="failed to get container status \"50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d\": rpc error: code = NotFound desc = could not find container \"50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d\": container with ID starting with 50d3d0cba0d7b3c5551689a5b48d5aa660cbbe58927d24f5010ca7f3d50eba1d not found: ID does not exist"
Sep 11 13:47:42.764706 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.764674    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c294b55-c12f-43f5-9950-3ac1937f0208-openshift-service-ca\") pod \"6c294b55-c12f-43f5-9950-3ac1937f0208\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") "
Sep 11 13:47:42.765235 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.764735    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls\") pod \"6c294b55-c12f-43f5-9950-3ac1937f0208\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") "
Sep 11 13:47:42.765235 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.764770    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-metrics-certs\") pod \"6c294b55-c12f-43f5-9950-3ac1937f0208\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") "
Sep 11 13:47:42.765235 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.764869    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzgzh\" (UniqueName: \"kubernetes.io/projected/6c294b55-c12f-43f5-9950-3ac1937f0208-kube-api-access-pzgzh\") pod \"6c294b55-c12f-43f5-9950-3ac1937f0208\" (UID: \"6c294b55-c12f-43f5-9950-3ac1937f0208\") "
Sep 11 13:47:42.765988 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.765952    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c294b55-c12f-43f5-9950-3ac1937f0208-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c294b55-c12f-43f5-9950-3ac1937f0208" (UID: "6c294b55-c12f-43f5-9950-3ac1937f0208"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:47:42.768015 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.767981    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c294b55-c12f-43f5-9950-3ac1937f0208-kube-api-access-pzgzh" (OuterVolumeSpecName: "kube-api-access-pzgzh") pod "6c294b55-c12f-43f5-9950-3ac1937f0208" (UID: "6c294b55-c12f-43f5-9950-3ac1937f0208"). InnerVolumeSpecName "kube-api-access-pzgzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:47:42.768127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.768075    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6c294b55-c12f-43f5-9950-3ac1937f0208" (UID: "6c294b55-c12f-43f5-9950-3ac1937f0208"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:47:42.768208 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.768191    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c294b55-c12f-43f5-9950-3ac1937f0208" (UID: "6c294b55-c12f-43f5-9950-3ac1937f0208"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:47:42.866729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.866637    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c294b55-c12f-43f5-9950-3ac1937f0208-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:42.866729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.866671    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:42.866729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.866684    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c294b55-c12f-43f5-9950-3ac1937f0208-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:42.866729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:42.866696    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzgzh\" (UniqueName: \"kubernetes.io/projected/6c294b55-c12f-43f5-9950-3ac1937f0208-kube-api-access-pzgzh\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:47:43.052661 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:43.052625    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"]
Sep 11 13:47:43.071441 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:43.071401    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-7bfa93-6c49944468-jq4kh"]
Sep 11 13:47:44.250389 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:44.250348    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c294b55-c12f-43f5-9950-3ac1937f0208" path="/var/lib/kubelet/pods/6c294b55-c12f-43f5-9950-3ac1937f0208/volumes"
Sep 11 13:47:54.697661 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:54.697622    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:47:58.160321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160285    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"]
Sep 11 13:47:58.160724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160678    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3cdde98-b905-4b0c-bbd0-f870faea635e" containerName="maas-api"
Sep 11 13:47:58.160724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160692    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3cdde98-b905-4b0c-bbd0-f870faea635e" containerName="maas-api"
Sep 11 13:47:58.160724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160705    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c294b55-c12f-43f5-9950-3ac1937f0208" containerName="maas-api"
Sep 11 13:47:58.160724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160711    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c294b55-c12f-43f5-9950-3ac1937f0208" containerName="maas-api"
Sep 11 13:47:58.160945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160732    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af5d4fa7-a685-4bb5-ad3e-558906a04907" containerName="maas-api"
Sep 11 13:47:58.160945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160738    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="af5d4fa7-a685-4bb5-ad3e-558906a04907" containerName="maas-api"
Sep 11 13:47:58.160945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160799    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="af5d4fa7-a685-4bb5-ad3e-558906a04907" containerName="maas-api"
Sep 11 13:47:58.160945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160814    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3cdde98-b905-4b0c-bbd0-f870faea635e" containerName="maas-api"
Sep 11 13:47:58.160945 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.160824    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c294b55-c12f-43f5-9950-3ac1937f0208" containerName="maas-api"
Sep 11 13:47:58.164224 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.164191    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.167595 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.167567    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-4920fa-serving-cert\""
Sep 11 13:47:58.179675 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.179637    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"]
Sep 11 13:47:58.209841 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.209798    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c751a7-e7cd-432a-918c-8d53265935e2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.210094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.209874    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-metrics-certs\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.210094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.209897    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgdt\" (UniqueName: \"kubernetes.io/projected/34c751a7-e7cd-432a-918c-8d53265935e2-kube-api-access-qdgdt\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.210094 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.209982    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.310874 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.310827    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-metrics-certs\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.310874 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.310878    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgdt\" (UniqueName: \"kubernetes.io/projected/34c751a7-e7cd-432a-918c-8d53265935e2-kube-api-access-qdgdt\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.311166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.311067    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.311166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.311121    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c751a7-e7cd-432a-918c-8d53265935e2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.311285 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:47:58.311218    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-serving-cert: secret "maas-api-e2e-ipp-a-4920fa-serving-cert" not found
Sep 11 13:47:58.311346 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:47:58.311296    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls podName:34c751a7-e7cd-432a-918c-8d53265935e2 nodeName:}" failed. No retries permitted until 2026-09-11 13:47:58.811273388 +0000 UTC m=+1695.023817185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls") pod "maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" (UID: "34c751a7-e7cd-432a-918c-8d53265935e2") : secret "maas-api-e2e-ipp-a-4920fa-serving-cert" not found
Sep 11 13:47:58.311781 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.311763    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c751a7-e7cd-432a-918c-8d53265935e2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.313495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.313475    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-metrics-certs\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.326078 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.326045    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgdt\" (UniqueName: \"kubernetes.io/projected/34c751a7-e7cd-432a-918c-8d53265935e2-kube-api-access-qdgdt\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.816456 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.816414    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:58.819000 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:58.818968    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:59.075651 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:59.075553    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:59.380757 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:59.380730    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"]
Sep 11 13:47:59.382960 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:47:59.382903    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c751a7_e7cd_432a_918c_8d53265935e2.slice/crio-adeccf52e3bdefc343df5a206c009f7d297e98a7c1fcc4e6c2464b2d29d97671 WatchSource:0}: Error finding container adeccf52e3bdefc343df5a206c009f7d297e98a7c1fcc4e6c2464b2d29d97671: Status 404 returned error can't find the container with id adeccf52e3bdefc343df5a206c009f7d297e98a7c1fcc4e6c2464b2d29d97671
Sep 11 13:47:59.811716 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:59.811672    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" event={"ID":"34c751a7-e7cd-432a-918c-8d53265935e2","Type":"ContainerStarted","Data":"adeccf52e3bdefc343df5a206c009f7d297e98a7c1fcc4e6c2464b2d29d97671"}
Sep 11 13:47:59.811866 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:59.811773    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:47:59.852590 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:47:59.852531    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" podStartSLOduration=1.489700226 podStartE2EDuration="1.852514506s" totalImagesPullingTime="362.81428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:47:59.85037265 +0000 UTC m=+1696.062916450" watchObservedRunningTime="2026-09-11 13:47:59.852514506 +0000 UTC m=+1696.065058305"
Sep 11 13:48:00.820126 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:00.820084    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" event={"ID":"34c751a7-e7cd-432a-918c-8d53265935e2","Type":"ContainerStarted","Data":"54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad"}
Sep 11 13:48:01.552440 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.552391    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"]
Sep 11 13:48:01.552644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.552609    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" podUID="25c07d29-c86e-4365-a4b9-0047517a4df9" containerName="maas-api" containerID="cri-o://6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c" gracePeriod=30
Sep 11 13:48:01.811545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.811482    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:48:01.826593 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.826560    2547 generic.go:356] "Generic (PLEG): container finished" podID="25c07d29-c86e-4365-a4b9-0047517a4df9" containerID="6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c" exitCode=0
Sep 11 13:48:01.827062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.826609    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"
Sep 11 13:48:01.827062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.826648    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" event={"ID":"25c07d29-c86e-4365-a4b9-0047517a4df9","Type":"ContainerDied","Data":"6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c"}
Sep 11 13:48:01.827062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.826703    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft" event={"ID":"25c07d29-c86e-4365-a4b9-0047517a4df9","Type":"ContainerDied","Data":"a8f269051674d132446c3e9f48441d273a8143469ff6a850db1d31ee7e811673"}
Sep 11 13:48:01.827062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.826730    2547 scope.go:117] "RemoveContainer" containerID="6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c"
Sep 11 13:48:01.836449 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.836429    2547 scope.go:117] "RemoveContainer" containerID="6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c"
Sep 11 13:48:01.836785 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:48:01.836764    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c\": container with ID starting with 6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c not found: ID does not exist" containerID="6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c"
Sep 11 13:48:01.836877 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.836797    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c"} err="failed to get container status \"6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c\": rpc error: code = NotFound desc = could not find container \"6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c\": container with ID starting with 6db4a12d9ff5d629e671bdbeecef0926da1e006be52b2e41c24ab75eb949e03c not found: ID does not exist"
Sep 11 13:48:01.946731 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.946678    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls\") pod \"25c07d29-c86e-4365-a4b9-0047517a4df9\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") "
Sep 11 13:48:01.946967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.946784    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-metrics-certs\") pod \"25c07d29-c86e-4365-a4b9-0047517a4df9\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") "
Sep 11 13:48:01.946967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.946861    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25c07d29-c86e-4365-a4b9-0047517a4df9-openshift-service-ca\") pod \"25c07d29-c86e-4365-a4b9-0047517a4df9\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") "
Sep 11 13:48:01.946967 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.946899    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxslk\" (UniqueName: \"kubernetes.io/projected/25c07d29-c86e-4365-a4b9-0047517a4df9-kube-api-access-pxslk\") pod \"25c07d29-c86e-4365-a4b9-0047517a4df9\" (UID: \"25c07d29-c86e-4365-a4b9-0047517a4df9\") "
Sep 11 13:48:01.947291 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.947249    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25c07d29-c86e-4365-a4b9-0047517a4df9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "25c07d29-c86e-4365-a4b9-0047517a4df9" (UID: "25c07d29-c86e-4365-a4b9-0047517a4df9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:48:01.949101 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.949070    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25c07d29-c86e-4365-a4b9-0047517a4df9-kube-api-access-pxslk" (OuterVolumeSpecName: "kube-api-access-pxslk") pod "25c07d29-c86e-4365-a4b9-0047517a4df9" (UID: "25c07d29-c86e-4365-a4b9-0047517a4df9"). InnerVolumeSpecName "kube-api-access-pxslk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:48:01.949380 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.949357    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "25c07d29-c86e-4365-a4b9-0047517a4df9" (UID: "25c07d29-c86e-4365-a4b9-0047517a4df9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:48:01.949444 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:01.949376    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "25c07d29-c86e-4365-a4b9-0047517a4df9" (UID: "25c07d29-c86e-4365-a4b9-0047517a4df9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:48:02.048442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.048399    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxslk\" (UniqueName: \"kubernetes.io/projected/25c07d29-c86e-4365-a4b9-0047517a4df9-kube-api-access-pxslk\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:48:02.048442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.048434    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:48:02.048442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.048443    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25c07d29-c86e-4365-a4b9-0047517a4df9-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:48:02.048442 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.048451    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25c07d29-c86e-4365-a4b9-0047517a4df9-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:48:02.161644 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.161605    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"]
Sep 11 13:48:02.164925 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.164886    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-32b673-57b74cf78-hzjft"]
Sep 11 13:48:02.250069 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:02.250033    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25c07d29-c86e-4365-a4b9-0047517a4df9" path="/var/lib/kubelet/pods/25c07d29-c86e-4365-a4b9-0047517a4df9/volumes"
Sep 11 13:48:06.832343 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:06.832261    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:48:09.556213 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:09.556169    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:48:39.962003 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:48:39.961963    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:49:08.381275 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.381232    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"]
Sep 11 13:49:08.381692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.381637    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25c07d29-c86e-4365-a4b9-0047517a4df9" containerName="maas-api"
Sep 11 13:49:08.381692 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.381648    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c07d29-c86e-4365-a4b9-0047517a4df9" containerName="maas-api"
Sep 11 13:49:08.381774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.381711    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="25c07d29-c86e-4365-a4b9-0047517a4df9" containerName="maas-api"
Sep 11 13:49:08.384824 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.384803    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.418983 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.418952    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-4920fa\"/\"kube-root-ca.crt\""
Sep 11 13:49:08.419159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.419125    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-4920fa\"/\"default-dockercfg-8dqfs\""
Sep 11 13:49:08.419159 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.419142    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-4920fa\"/\"ipp-route-4920fa-kserve-self-signed-certs\""
Sep 11 13:49:08.419244 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.419178    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-4920fa\"/\"openshift-service-ca.crt\""
Sep 11 13:49:08.427189 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.427158    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"]
Sep 11 13:49:08.461812 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.461776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-model-cache\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.461812 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.461819    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-dshm\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.462088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.461889    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76aa478-7327-42ca-94f4-a5896b119aba-tls-certs\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.462088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.461991    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srfd\" (UniqueName: \"kubernetes.io/projected/d76aa478-7327-42ca-94f4-a5896b119aba-kube-api-access-2srfd\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.462088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.462033    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-tmp-dir\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.462088 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.462055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-home\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.562789 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.562743    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srfd\" (UniqueName: \"kubernetes.io/projected/d76aa478-7327-42ca-94f4-a5896b119aba-kube-api-access-2srfd\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.562935    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-tmp-dir\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563017 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.562986    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-home\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563164 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.563143    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-model-cache\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.563209    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-dshm\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563288 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.563250    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76aa478-7327-42ca-94f4-a5896b119aba-tls-certs\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563400 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.563379    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-tmp-dir\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563458 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.563402    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-home\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.563496 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.563465    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-model-cache\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.565553 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.565522    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-dshm\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.565803 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.565784    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76aa478-7327-42ca-94f4-a5896b119aba-tls-certs\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.579146 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.579114    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srfd\" (UniqueName: \"kubernetes.io/projected/d76aa478-7327-42ca-94f4-a5896b119aba-kube-api-access-2srfd\") pod \"ipp-route-4920fa-kserve-589c588db7-qmw7d\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") " pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.694426 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.694332    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:08.999626 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:08.999598    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"]
Sep 11 13:49:09.001690 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:49:09.001664    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd76aa478_7327_42ca_94f4_a5896b119aba.slice/crio-cb9bb086da3bd55e79f945ad4d94af3b59d203cdc5b5c5936d56bbac32844b2a WatchSource:0}: Error finding container cb9bb086da3bd55e79f945ad4d94af3b59d203cdc5b5c5936d56bbac32844b2a: Status 404 returned error can't find the container with id cb9bb086da3bd55e79f945ad4d94af3b59d203cdc5b5c5936d56bbac32844b2a
Sep 11 13:49:09.215026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:09.214986    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d" event={"ID":"d76aa478-7327-42ca-94f4-a5896b119aba","Type":"ContainerStarted","Data":"bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928"}
Sep 11 13:49:09.215201 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:09.215037    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d" event={"ID":"d76aa478-7327-42ca-94f4-a5896b119aba","Type":"ContainerStarted","Data":"cb9bb086da3bd55e79f945ad4d94af3b59d203cdc5b5c5936d56bbac32844b2a"}
Sep 11 13:49:09.247785 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:09.247732    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d" podStartSLOduration=1.247714888 podStartE2EDuration="1.247714888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:49:09.247023496 +0000 UTC m=+1765.459567297" watchObservedRunningTime="2026-09-11 13:49:09.247714888 +0000 UTC m=+1765.460258705"
Sep 11 13:49:12.353717 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:12.353671    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:49:18.695304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:18.695262    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:18.695715 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:18.695322    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:18.708219 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:18.708190    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:19.286010 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:19.285979    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:49:25.316362 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:25.316328    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:49:40.439125 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.439032    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"]
Sep 11 13:49:40.443053 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.443022    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.446313 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.446287    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-2e3865-serving-cert\""
Sep 11 13:49:40.465414 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.465383    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"]
Sep 11 13:49:40.562123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.562080    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.562123 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.562124    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.562369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.562188    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbvt\" (UniqueName: \"kubernetes.io/projected/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-kube-api-access-ffbvt\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.562369 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.562236    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.663756 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.663712    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.663756 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.663754    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.664096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.663786    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbvt\" (UniqueName: \"kubernetes.io/projected/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-kube-api-access-ffbvt\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.664096 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.663903    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.664096 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:49:40.664009    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-serving-cert: secret "maas-api-e2e-ipp-cleanup-2e3865-serving-cert" not found
Sep 11 13:49:40.664096 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:49:40.664085    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls podName:d88a37a7-47f4-4fe4-a74e-acb0b8d51f87 nodeName:}" failed. No retries permitted until 2026-09-11 13:49:41.164067291 +0000 UTC m=+1797.376611070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" (UID: "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87") : secret "maas-api-e2e-ipp-cleanup-2e3865-serving-cert" not found
Sep 11 13:49:40.664599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.664576    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.666373 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.666350    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:40.674003 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:40.673973    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbvt\" (UniqueName: \"kubernetes.io/projected/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-kube-api-access-ffbvt\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:41.168185 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:41.168147    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:41.171039 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:41.171006    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:41.356399 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:41.356362    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:41.639208 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:41.639182    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"]
Sep 11 13:49:41.640254 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:49:41.640224    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88a37a7_47f4_4fe4_a74e_acb0b8d51f87.slice/crio-66b69ef9d0e2c1f471b02fb8fe4ec63047844e64a42a81440179cbe53b28cf49 WatchSource:0}: Error finding container 66b69ef9d0e2c1f471b02fb8fe4ec63047844e64a42a81440179cbe53b28cf49: Status 404 returned error can't find the container with id 66b69ef9d0e2c1f471b02fb8fe4ec63047844e64a42a81440179cbe53b28cf49
Sep 11 13:49:42.415565 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:42.415523    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" event={"ID":"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87","Type":"ContainerStarted","Data":"fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b"}
Sep 11 13:49:42.415829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:42.415593    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" event={"ID":"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87","Type":"ContainerStarted","Data":"66b69ef9d0e2c1f471b02fb8fe4ec63047844e64a42a81440179cbe53b28cf49"}
Sep 11 13:49:42.415829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:42.415713    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:49:42.442046 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:42.441990    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" podStartSLOduration=2.061015447 podStartE2EDuration="2.441971601s" totalImagesPullingTime="380.956154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:49:42.441766858 +0000 UTC m=+1798.654310657" watchObservedRunningTime="2026-09-11 13:49:42.441971601 +0000 UTC m=+1798.654515401"
Sep 11 13:49:44.333075 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:44.333052    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:49:44.341579 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:44.341552    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:49:45.711677 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:45.711462    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:49:48.427247 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:49:48.427216    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:50:18.518729 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.518686    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"]
Sep 11 13:50:18.519278 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.518894    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" podUID="d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" containerName="maas-api" containerID="cri-o://fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b" gracePeriod=30
Sep 11 13:50:18.796586 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.796556    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:50:18.931420 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.931373    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-openshift-service-ca\") pod \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") "
Sep 11 13:50:18.931632 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.931488    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffbvt\" (UniqueName: \"kubernetes.io/projected/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-kube-api-access-ffbvt\") pod \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") "
Sep 11 13:50:18.931632 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.931517    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-metrics-certs\") pod \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") "
Sep 11 13:50:18.931632 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.931577    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls\") pod \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\" (UID: \"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87\") "
Sep 11 13:50:18.931856 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.931821    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" (UID: "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:50:18.933811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.933772    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-kube-api-access-ffbvt" (OuterVolumeSpecName: "kube-api-access-ffbvt") pod "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" (UID: "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87"). InnerVolumeSpecName "kube-api-access-ffbvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:50:18.933811 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.933794    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" (UID: "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:50:18.934009 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:18.933848    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" (UID: "d88a37a7-47f4-4fe4-a74e-acb0b8d51f87"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:50:19.033169 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.033082    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:19.033169 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.033112    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffbvt\" (UniqueName: \"kubernetes.io/projected/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-kube-api-access-ffbvt\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:19.033169 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.033122    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:19.033169 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.033131    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:19.639253 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.639218    2547 generic.go:356] "Generic (PLEG): container finished" podID="d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" containerID="fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b" exitCode=0
Sep 11 13:50:19.639659 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.639282    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"
Sep 11 13:50:19.639659 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.639297    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" event={"ID":"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87","Type":"ContainerDied","Data":"fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b"}
Sep 11 13:50:19.639659 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.639356    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x" event={"ID":"d88a37a7-47f4-4fe4-a74e-acb0b8d51f87","Type":"ContainerDied","Data":"66b69ef9d0e2c1f471b02fb8fe4ec63047844e64a42a81440179cbe53b28cf49"}
Sep 11 13:50:19.639659 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.639380    2547 scope.go:117] "RemoveContainer" containerID="fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b"
Sep 11 13:50:19.649509 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.649481    2547 scope.go:117] "RemoveContainer" containerID="fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b"
Sep 11 13:50:19.649890 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:50:19.649866    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b\": container with ID starting with fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b not found: ID does not exist" containerID="fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b"
Sep 11 13:50:19.650010 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.649900    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b"} err="failed to get container status \"fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b\": rpc error: code = NotFound desc = could not find container \"fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b\": container with ID starting with fbfdecf7b7db479050a7e3f7da30c53ccabf3f21c5aa852889aba0e89bd7746b not found: ID does not exist"
Sep 11 13:50:19.666867 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.666825    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"]
Sep 11 13:50:19.670246 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:19.670215    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2e3865-bbfcbff88-2xb2x"]
Sep 11 13:50:20.249724 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:20.249688    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" path="/var/lib/kubelet/pods/d88a37a7-47f4-4fe4-a74e-acb0b8d51f87/volumes"
Sep 11 13:50:22.836234 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:22.836191    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:50:44.910371 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:44.910325    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:50:47.222507 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.222465    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"]
Sep 11 13:50:47.222956 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.222747    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" podUID="34c751a7-e7cd-432a-918c-8d53265935e2" containerName="maas-api" containerID="cri-o://54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad" gracePeriod=30
Sep 11 13:50:47.473155 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.473084    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:50:47.504495 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.504462    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls\") pod \"34c751a7-e7cd-432a-918c-8d53265935e2\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") "
Sep 11 13:50:47.504699 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.504517    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-metrics-certs\") pod \"34c751a7-e7cd-432a-918c-8d53265935e2\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") "
Sep 11 13:50:47.504699 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.504556    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c751a7-e7cd-432a-918c-8d53265935e2-openshift-service-ca\") pod \"34c751a7-e7cd-432a-918c-8d53265935e2\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") "
Sep 11 13:50:47.504699 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.504596    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdgdt\" (UniqueName: \"kubernetes.io/projected/34c751a7-e7cd-432a-918c-8d53265935e2-kube-api-access-qdgdt\") pod \"34c751a7-e7cd-432a-918c-8d53265935e2\" (UID: \"34c751a7-e7cd-432a-918c-8d53265935e2\") "
Sep 11 13:50:47.505030 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.504992    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c751a7-e7cd-432a-918c-8d53265935e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34c751a7-e7cd-432a-918c-8d53265935e2" (UID: "34c751a7-e7cd-432a-918c-8d53265935e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:50:47.506865 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.506826    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "34c751a7-e7cd-432a-918c-8d53265935e2" (UID: "34c751a7-e7cd-432a-918c-8d53265935e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:50:47.507034 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.506891    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c751a7-e7cd-432a-918c-8d53265935e2-kube-api-access-qdgdt" (OuterVolumeSpecName: "kube-api-access-qdgdt") pod "34c751a7-e7cd-432a-918c-8d53265935e2" (UID: "34c751a7-e7cd-432a-918c-8d53265935e2"). InnerVolumeSpecName "kube-api-access-qdgdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:50:47.507258 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.507232    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34c751a7-e7cd-432a-918c-8d53265935e2" (UID: "34c751a7-e7cd-432a-918c-8d53265935e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:50:47.606193 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.606147    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:47.606193 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.606185    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34c751a7-e7cd-432a-918c-8d53265935e2-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:47.606193 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.606195    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c751a7-e7cd-432a-918c-8d53265935e2-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:47.606193 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.606205    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdgdt\" (UniqueName: \"kubernetes.io/projected/34c751a7-e7cd-432a-918c-8d53265935e2-kube-api-access-qdgdt\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:50:47.804625 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.804530    2547 generic.go:356] "Generic (PLEG): container finished" podID="34c751a7-e7cd-432a-918c-8d53265935e2" containerID="54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad" exitCode=0
Sep 11 13:50:47.804625 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.804580    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"
Sep 11 13:50:47.804625 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.804614    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" event={"ID":"34c751a7-e7cd-432a-918c-8d53265935e2","Type":"ContainerDied","Data":"54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad"}
Sep 11 13:50:47.804838 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.804673    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc" event={"ID":"34c751a7-e7cd-432a-918c-8d53265935e2","Type":"ContainerDied","Data":"adeccf52e3bdefc343df5a206c009f7d297e98a7c1fcc4e6c2464b2d29d97671"}
Sep 11 13:50:47.804838 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.804697    2547 scope.go:117] "RemoveContainer" containerID="54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad"
Sep 11 13:50:47.814890 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.814869    2547 scope.go:117] "RemoveContainer" containerID="54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad"
Sep 11 13:50:47.815245 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:50:47.815219    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad\": container with ID starting with 54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad not found: ID does not exist" containerID="54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad"
Sep 11 13:50:47.815322 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.815255    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad"} err="failed to get container status \"54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad\": rpc error: code = NotFound desc = could not find container \"54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad\": container with ID starting with 54824f5a20be800e5a2e99686e23de399c8b9d1e194140fc34b9cc80ca5189ad not found: ID does not exist"
Sep 11 13:50:47.827265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.827232    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"]
Sep 11 13:50:47.833841 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:47.833813    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4920fa-76746847bb-h4rqc"]
Sep 11 13:50:48.249079 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:48.249045    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c751a7-e7cd-432a-918c-8d53265935e2" path="/var/lib/kubelet/pods/34c751a7-e7cd-432a-918c-8d53265935e2/volumes"
Sep 11 13:50:52.966478 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:52.966431    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"]
Sep 11 13:50:57.236497 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:50:57.236448    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:51:07.986304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:07.986185    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d" podUID="d76aa478-7327-42ca-94f4-a5896b119aba" containerName="main" containerID="cri-o://bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928" gracePeriod=45
Sep 11 13:51:08.241869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.241800    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:51:08.301656 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.301611    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2srfd\" (UniqueName: \"kubernetes.io/projected/d76aa478-7327-42ca-94f4-a5896b119aba-kube-api-access-2srfd\") pod \"d76aa478-7327-42ca-94f4-a5896b119aba\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") "
Sep 11 13:51:08.301829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.301668    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-model-cache\") pod \"d76aa478-7327-42ca-94f4-a5896b119aba\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") "
Sep 11 13:51:08.301829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.301753    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-dshm\") pod \"d76aa478-7327-42ca-94f4-a5896b119aba\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") "
Sep 11 13:51:08.301829 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.301783    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76aa478-7327-42ca-94f4-a5896b119aba-tls-certs\") pod \"d76aa478-7327-42ca-94f4-a5896b119aba\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") "
Sep 11 13:51:08.302031 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.301853    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-home\") pod \"d76aa478-7327-42ca-94f4-a5896b119aba\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") "
Sep 11 13:51:08.302031 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.301889    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-tmp-dir\") pod \"d76aa478-7327-42ca-94f4-a5896b119aba\" (UID: \"d76aa478-7327-42ca-94f4-a5896b119aba\") "
Sep 11 13:51:08.302146 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.302050    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-model-cache" (OuterVolumeSpecName: "model-cache") pod "d76aa478-7327-42ca-94f4-a5896b119aba" (UID: "d76aa478-7327-42ca-94f4-a5896b119aba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:08.302304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.302278    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d76aa478-7327-42ca-94f4-a5896b119aba" (UID: "d76aa478-7327-42ca-94f4-a5896b119aba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:08.302304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.302293    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-model-cache\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:51:08.302466 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.302435    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-home" (OuterVolumeSpecName: "home") pod "d76aa478-7327-42ca-94f4-a5896b119aba" (UID: "d76aa478-7327-42ca-94f4-a5896b119aba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:08.304382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.304330    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d76aa478-7327-42ca-94f4-a5896b119aba-kube-api-access-2srfd" (OuterVolumeSpecName: "kube-api-access-2srfd") pod "d76aa478-7327-42ca-94f4-a5896b119aba" (UID: "d76aa478-7327-42ca-94f4-a5896b119aba"). InnerVolumeSpecName "kube-api-access-2srfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:51:08.304382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.304337    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d76aa478-7327-42ca-94f4-a5896b119aba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d76aa478-7327-42ca-94f4-a5896b119aba" (UID: "d76aa478-7327-42ca-94f4-a5896b119aba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:51:08.304382 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.304337    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-dshm" (OuterVolumeSpecName: "dshm") pod "d76aa478-7327-42ca-94f4-a5896b119aba" (UID: "d76aa478-7327-42ca-94f4-a5896b119aba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:51:08.403555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.403507    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-dshm\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:51:08.403740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.403569    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76aa478-7327-42ca-94f4-a5896b119aba-tls-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:51:08.403740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.403580    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-home\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:51:08.403740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.403588    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d76aa478-7327-42ca-94f4-a5896b119aba-tmp-dir\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:51:08.403740 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.403597    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2srfd\" (UniqueName: \"kubernetes.io/projected/d76aa478-7327-42ca-94f4-a5896b119aba-kube-api-access-2srfd\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:51:08.931228 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.931190    2547 generic.go:356] "Generic (PLEG): container finished" podID="d76aa478-7327-42ca-94f4-a5896b119aba" containerID="bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928" exitCode=0
Sep 11 13:51:08.931412 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.931251    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"
Sep 11 13:51:08.931412 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.931279    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d" event={"ID":"d76aa478-7327-42ca-94f4-a5896b119aba","Type":"ContainerDied","Data":"bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928"}
Sep 11 13:51:08.931412 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.931329    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d" event={"ID":"d76aa478-7327-42ca-94f4-a5896b119aba","Type":"ContainerDied","Data":"cb9bb086da3bd55e79f945ad4d94af3b59d203cdc5b5c5936d56bbac32844b2a"}
Sep 11 13:51:08.931412 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.931352    2547 scope.go:117] "RemoveContainer" containerID="bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928"
Sep 11 13:51:08.941660 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.941642    2547 scope.go:117] "RemoveContainer" containerID="bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928"
Sep 11 13:51:08.942041 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:51:08.942018    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928\": container with ID starting with bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928 not found: ID does not exist" containerID="bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928"
Sep 11 13:51:08.942102 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.942050    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928"} err="failed to get container status \"bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928\": rpc error: code = NotFound desc = could not find container \"bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928\": container with ID starting with bb32f49b941d83893b71803b912b7203ccc55732bc6b784adf58fcca2be34928 not found: ID does not exist"
Sep 11 13:51:08.955449 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.955418    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"]
Sep 11 13:51:08.961352 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:08.961318    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-4920fa/ipp-route-4920fa-kserve-589c588db7-qmw7d"]
Sep 11 13:51:10.249705 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:10.249663    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d76aa478-7327-42ca-94f4-a5896b119aba" path="/var/lib/kubelet/pods/d76aa478-7327-42ca-94f4-a5896b119aba/volumes"
Sep 11 13:51:51.038470 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:51:51.038435    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:52:06.141775 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.141738    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"]
Sep 11 13:52:06.142229 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.141967    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb" podUID="5b4918d6-e4ec-46f4-bda6-dd482afaa767" containerName="maas-api" containerID="cri-o://ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38" gracePeriod=30
Sep 11 13:52:06.394464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.394384    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:52:06.538996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.538954    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/5b4918d6-e4ec-46f4-bda6-dd482afaa767-kube-api-access-vjwvn\") pod \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") "
Sep 11 13:52:06.538996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.539001    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-maas-api-tls\") pod \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") "
Sep 11 13:52:06.539265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.539094    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4918d6-e4ec-46f4-bda6-dd482afaa767-openshift-service-ca\") pod \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") "
Sep 11 13:52:06.539265 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.539124    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-metrics-certs\") pod \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\" (UID: \"5b4918d6-e4ec-46f4-bda6-dd482afaa767\") "
Sep 11 13:52:06.539514 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.539475    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b4918d6-e4ec-46f4-bda6-dd482afaa767-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b4918d6-e4ec-46f4-bda6-dd482afaa767" (UID: "5b4918d6-e4ec-46f4-bda6-dd482afaa767"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:52:06.541518 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.541471    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5b4918d6-e4ec-46f4-bda6-dd482afaa767" (UID: "5b4918d6-e4ec-46f4-bda6-dd482afaa767"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:52:06.541639 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.541522    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b4918d6-e4ec-46f4-bda6-dd482afaa767" (UID: "5b4918d6-e4ec-46f4-bda6-dd482afaa767"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:52:06.541639 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.541581    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b4918d6-e4ec-46f4-bda6-dd482afaa767-kube-api-access-vjwvn" (OuterVolumeSpecName: "kube-api-access-vjwvn") pod "5b4918d6-e4ec-46f4-bda6-dd482afaa767" (UID: "5b4918d6-e4ec-46f4-bda6-dd482afaa767"). InnerVolumeSpecName "kube-api-access-vjwvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:06.640794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.640757    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:06.640794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.640790    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjwvn\" (UniqueName: \"kubernetes.io/projected/5b4918d6-e4ec-46f4-bda6-dd482afaa767-kube-api-access-vjwvn\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:06.640794 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.640800    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b4918d6-e4ec-46f4-bda6-dd482afaa767-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:06.641077 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:06.640810    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b4918d6-e4ec-46f4-bda6-dd482afaa767-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:07.261572 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.261537    2547 generic.go:356] "Generic (PLEG): container finished" podID="5b4918d6-e4ec-46f4-bda6-dd482afaa767" containerID="ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38" exitCode=0
Sep 11 13:52:07.262026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.261583    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"
Sep 11 13:52:07.262026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.261629    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb" event={"ID":"5b4918d6-e4ec-46f4-bda6-dd482afaa767","Type":"ContainerDied","Data":"ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38"}
Sep 11 13:52:07.262026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.261681    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb" event={"ID":"5b4918d6-e4ec-46f4-bda6-dd482afaa767","Type":"ContainerDied","Data":"eb8ee2df7d1872846cd1694f9c8d1733665002e2cad0cd493d0e791148ec6ac3"}
Sep 11 13:52:07.262026 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.261705    2547 scope.go:117] "RemoveContainer" containerID="ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38"
Sep 11 13:52:07.271894 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.271868    2547 scope.go:117] "RemoveContainer" containerID="ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38"
Sep 11 13:52:07.272256 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:52:07.272237    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38\": container with ID starting with ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38 not found: ID does not exist" containerID="ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38"
Sep 11 13:52:07.272316 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.272264    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38"} err="failed to get container status \"ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38\": rpc error: code = NotFound desc = could not find container \"ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38\": container with ID starting with ee901a796c85c5d896aac7926b6d22653d74de96151ebf5429b7782b77532d38 not found: ID does not exist"
Sep 11 13:52:07.288409 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.288358    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"]
Sep 11 13:52:07.290847 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:07.290823    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3dd80c-6b94d97cbf-prgpb"]
Sep 11 13:52:08.249559 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:08.249524    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b4918d6-e4ec-46f4-bda6-dd482afaa767" path="/var/lib/kubelet/pods/5b4918d6-e4ec-46f4-bda6-dd482afaa767/volumes"
Sep 11 13:52:09.263696 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:09.263659    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:52:26.066429 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.066391    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"]
Sep 11 13:52:26.067031 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.066653    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" podUID="11e3e456-8190-42c0-bbde-802377f3e0ce" containerName="maas-api" containerID="cri-o://3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff" gracePeriod=30
Sep 11 13:52:26.323145 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.323069    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:52:26.367821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.367788    2547 generic.go:356] "Generic (PLEG): container finished" podID="11e3e456-8190-42c0-bbde-802377f3e0ce" containerID="3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff" exitCode=0
Sep 11 13:52:26.368043 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.367830    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"
Sep 11 13:52:26.368043 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.367873    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" event={"ID":"11e3e456-8190-42c0-bbde-802377f3e0ce","Type":"ContainerDied","Data":"3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff"}
Sep 11 13:52:26.368043 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.367944    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v" event={"ID":"11e3e456-8190-42c0-bbde-802377f3e0ce","Type":"ContainerDied","Data":"67c5b662fc51fbb07b220e1edcd64efb07dbf21a65e75c10b6ee2cad3d89922d"}
Sep 11 13:52:26.368043 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.367974    2547 scope.go:117] "RemoveContainer" containerID="3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff"
Sep 11 13:52:26.382365 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.382337    2547 scope.go:117] "RemoveContainer" containerID="3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff"
Sep 11 13:52:26.382765 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:52:26.382740    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff\": container with ID starting with 3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff not found: ID does not exist" containerID="3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff"
Sep 11 13:52:26.382869 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.382773    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff"} err="failed to get container status \"3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff\": rpc error: code = NotFound desc = could not find container \"3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff\": container with ID starting with 3279ad40a80545162da76fdcaae47e20d4486ddf7f1ef05aa9b8769d89a88fff not found: ID does not exist"
Sep 11 13:52:26.422603 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.422572    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-metrics-certs\") pod \"11e3e456-8190-42c0-bbde-802377f3e0ce\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") "
Sep 11 13:52:26.422814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.422643    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6njz\" (UniqueName: \"kubernetes.io/projected/11e3e456-8190-42c0-bbde-802377f3e0ce-kube-api-access-d6njz\") pod \"11e3e456-8190-42c0-bbde-802377f3e0ce\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") "
Sep 11 13:52:26.422814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.422731    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls\") pod \"11e3e456-8190-42c0-bbde-802377f3e0ce\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") "
Sep 11 13:52:26.422814 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.422769    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e3e456-8190-42c0-bbde-802377f3e0ce-openshift-service-ca\") pod \"11e3e456-8190-42c0-bbde-802377f3e0ce\" (UID: \"11e3e456-8190-42c0-bbde-802377f3e0ce\") "
Sep 11 13:52:26.423173 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.423150    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11e3e456-8190-42c0-bbde-802377f3e0ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11e3e456-8190-42c0-bbde-802377f3e0ce" (UID: "11e3e456-8190-42c0-bbde-802377f3e0ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:52:26.424905 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.424872    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11e3e456-8190-42c0-bbde-802377f3e0ce" (UID: "11e3e456-8190-42c0-bbde-802377f3e0ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:52:26.425066 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.424968    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e3e456-8190-42c0-bbde-802377f3e0ce-kube-api-access-d6njz" (OuterVolumeSpecName: "kube-api-access-d6njz") pod "11e3e456-8190-42c0-bbde-802377f3e0ce" (UID: "11e3e456-8190-42c0-bbde-802377f3e0ce"). InnerVolumeSpecName "kube-api-access-d6njz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:26.425109 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.425061    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "11e3e456-8190-42c0-bbde-802377f3e0ce" (UID: "11e3e456-8190-42c0-bbde-802377f3e0ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:52:26.523846 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.523800    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11e3e456-8190-42c0-bbde-802377f3e0ce-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:26.523846 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.523841    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:26.523846 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.523849    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6njz\" (UniqueName: \"kubernetes.io/projected/11e3e456-8190-42c0-bbde-802377f3e0ce-kube-api-access-d6njz\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:26.523846 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.523858    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11e3e456-8190-42c0-bbde-802377f3e0ce-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:26.700222 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.700184    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"]
Sep 11 13:52:26.712843 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:26.712809    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6ca2b-764cc95958-k7t4v"]
Sep 11 13:52:28.249084 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:28.249045    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11e3e456-8190-42c0-bbde-802377f3e0ce" path="/var/lib/kubelet/pods/11e3e456-8190-42c0-bbde-802377f3e0ce/volumes"
Sep 11 13:52:28.896229 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:28.896187    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:52:34.165555 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:34.165512    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"]
Sep 11 13:52:34.166071 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:34.165845    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy" containerID="cri-o://15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b" gracePeriod=30
Sep 11 13:52:38.811956 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:38.811852    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:52:39.424720 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.424696    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:52:39.444208 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.444111    2547 generic.go:356] "Generic (PLEG): container finished" podID="603327cb-7cee-42c5-920d-c6bf4353c912" containerID="15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b" exitCode=0
Sep 11 13:52:39.444208 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.444176    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" event={"ID":"603327cb-7cee-42c5-920d-c6bf4353c912","Type":"ContainerDied","Data":"15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b"}
Sep 11 13:52:39.444388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.444246    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp" event={"ID":"603327cb-7cee-42c5-920d-c6bf4353c912","Type":"ContainerDied","Data":"faecf8d76798ded466a3d838f96755d9809b51aa37fcefb9e4f18958e121dd76"}
Sep 11 13:52:39.444388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.444183    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"
Sep 11 13:52:39.444388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.444276    2547 scope.go:117] "RemoveContainer" containerID="15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b"
Sep 11 13:52:39.455622 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.455599    2547 scope.go:117] "RemoveContainer" containerID="87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"
Sep 11 13:52:39.466619 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.466595    2547 scope.go:117] "RemoveContainer" containerID="15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b"
Sep 11 13:52:39.466985 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:52:39.466966    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b\": container with ID starting with 15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b not found: ID does not exist" containerID="15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b"
Sep 11 13:52:39.467051 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.466993    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b"} err="failed to get container status \"15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b\": rpc error: code = NotFound desc = could not find container \"15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b\": container with ID starting with 15c3dedb5051c3286f06b0e2d795237914e4469a58fe2c84f0568b1737e9f67b not found: ID does not exist"
Sep 11 13:52:39.467051 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.467012    2547 scope.go:117] "RemoveContainer" containerID="87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"
Sep 11 13:52:39.467334 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:52:39.467313    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a\": container with ID starting with 87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a not found: ID does not exist" containerID="87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"
Sep 11 13:52:39.467390 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.467345    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a"} err="failed to get container status \"87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a\": rpc error: code = NotFound desc = could not find container \"87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a\": container with ID starting with 87d0df5277d580ed36c4273a7ccce89b8ef1193c0388cd78dfc50dfcb3d5002a not found: ID does not exist"
Sep 11 13:52:39.546970 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.546902    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-envoy\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.546970 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.546973    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-data\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547018    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-istio-token\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547048    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603327cb-7cee-42c5-920d-c6bf4353c912-istiod-ca-cert\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547084    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603327cb-7cee-42c5-920d-c6bf4353c912-istio-podinfo\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547115    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-credential-socket\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547163    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-certs\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547225 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547203    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gblj\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-kube-api-access-2gblj\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547522 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547281    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-socket\") pod \"603327cb-7cee-42c5-920d-c6bf4353c912\" (UID: \"603327cb-7cee-42c5-920d-c6bf4353c912\") "
Sep 11 13:52:39.547522 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547303    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-data" (OuterVolumeSpecName: "istio-data") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:39.547522 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547496    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:39.547672 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547531    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:39.547672 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547548    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-data\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.547771 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547684    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:39.547848 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.547807    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603327cb-7cee-42c5-920d-c6bf4353c912-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:52:39.549248 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.549225    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:52:39.549373 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.549335    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-kube-api-access-2gblj" (OuterVolumeSpecName: "kube-api-access-2gblj") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "kube-api-access-2gblj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:39.549626 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.549607    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/603327cb-7cee-42c5-920d-c6bf4353c912-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:52:39.549690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.549621    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-istio-token" (OuterVolumeSpecName: "istio-token") pod "603327cb-7cee-42c5-920d-c6bf4353c912" (UID: "603327cb-7cee-42c5-920d-c6bf4353c912"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:52:39.648461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648416    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-istio-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648450    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/603327cb-7cee-42c5-920d-c6bf4353c912-istiod-ca-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648459    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/603327cb-7cee-42c5-920d-c6bf4353c912-istio-podinfo\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648468    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-credential-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648461 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648476    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648777 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648485    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gblj\" (UniqueName: \"kubernetes.io/projected/603327cb-7cee-42c5-920d-c6bf4353c912-kube-api-access-2gblj\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648777 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648493    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-workload-socket\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.648777 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.648501    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/603327cb-7cee-42c5-920d-c6bf4353c912-istio-envoy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:52:39.768264 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.768229    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"]
Sep 11 13:52:39.774774 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:39.774740    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d6ca2b-openshift-default-85d94cbdc4-68vnp"]
Sep 11 13:52:40.248783 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:40.248751    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" path="/var/lib/kubelet/pods/603327cb-7cee-42c5-920d-c6bf4353c912/volumes"
Sep 11 13:52:44.571130 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:52:44.571091    2547 scope.go:117] "RemoveContainer" containerID="c50c05991b177d839e74a1f824760c50180ea53ed6b32ae916d079615812eaac"
Sep 11 13:53:59.632427 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:53:59.632389    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:54:23.807531 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:54:23.807442    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:54:31.712861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:54:31.712823    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:54:40.045773 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:54:40.045732    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:54:44.373548 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:54:44.373517    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:54:44.380743 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:54:44.380718    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:54:58.407921 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:54:58.407868    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:55:06.637785 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:55:06.637749    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:56:32.642882 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:56:32.642836    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:56:41.717202 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:56:41.717143    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:56:49.011732 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:56:49.011687    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:57:07.760881 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:07.760785    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:57:32.913528 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:32.913490    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:57:45.535018 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:45.534977    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:57:52.918996 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:52.918954    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:57:53.125119 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125082    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"]
Sep 11 13:57:53.125456 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125442    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125458    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125467    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125472    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125479    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c751a7-e7cd-432a-918c-8d53265935e2" containerName="maas-api"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125484    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c751a7-e7cd-432a-918c-8d53265935e2" containerName="maas-api"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125493    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e3e456-8190-42c0-bbde-802377f3e0ce" containerName="maas-api"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125498    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e3e456-8190-42c0-bbde-802377f3e0ce" containerName="maas-api"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125504    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d76aa478-7327-42ca-94f4-a5896b119aba" containerName="main"
Sep 11 13:57:53.125511 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125510    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d76aa478-7327-42ca-94f4-a5896b119aba" containerName="main"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125517    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125522    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125532    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4918d6-e4ec-46f4-bda6-dd482afaa767" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125537    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4918d6-e4ec-46f4-bda6-dd482afaa767" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125596    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d76aa478-7327-42ca-94f4-a5896b119aba" containerName="main"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125604    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125609    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88a37a7-47f4-4fe4-a74e-acb0b8d51f87" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125615    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4918d6-e4ec-46f4-bda6-dd482afaa767" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125620    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="11e3e456-8190-42c0-bbde-802377f3e0ce" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125626    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c751a7-e7cd-432a-918c-8d53265935e2" containerName="maas-api"
Sep 11 13:57:53.125821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.125632    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="603327cb-7cee-42c5-920d-c6bf4353c912" containerName="istio-proxy"
Sep 11 13:57:53.128586 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.128569    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.131666 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.131645    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x5rkw\""
Sep 11 13:57:53.132928 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.132887    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:57:53.133108 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.133086    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:57:53.133199 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.133148    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 13:57:53.133199 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.133163    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:57:53.142111 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.142086    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"]
Sep 11 13:57:53.229987 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.229870    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-metrics-certs\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.229987 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.229942    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f78c809-ea9d-40a1-933b-346d391d1713-openshift-service-ca\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.230179 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.229989    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-maas-api-tls\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.230179 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.230030    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddb56\" (UniqueName: \"kubernetes.io/projected/1f78c809-ea9d-40a1-933b-346d391d1713-kube-api-access-ddb56\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.331284 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.331242    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-metrics-certs\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.331284 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.331287    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f78c809-ea9d-40a1-933b-346d391d1713-openshift-service-ca\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.331540 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.331305    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-maas-api-tls\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.331540 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.331343    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddb56\" (UniqueName: \"kubernetes.io/projected/1f78c809-ea9d-40a1-933b-346d391d1713-kube-api-access-ddb56\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.332097 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.332071    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f78c809-ea9d-40a1-933b-346d391d1713-openshift-service-ca\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.333861 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.333842    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-metrics-certs\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.333968 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.333870    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-maas-api-tls\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.340535 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.340508    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddb56\" (UniqueName: \"kubernetes.io/projected/1f78c809-ea9d-40a1-933b-346d391d1713-kube-api-access-ddb56\") pod \"maas-api-67749f9dd-zggnp\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") " pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.439588 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.439546    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:53.715207 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.715181    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"]
Sep 11 13:57:53.717180 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:57:53.717143    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f78c809_ea9d_40a1_933b_346d391d1713.slice/crio-1ac8e6332d1be68f95e179d1289190d97241dc0bb40871eef543419d2f10edf2 WatchSource:0}: Error finding container 1ac8e6332d1be68f95e179d1289190d97241dc0bb40871eef543419d2f10edf2: Status 404 returned error can't find the container with id 1ac8e6332d1be68f95e179d1289190d97241dc0bb40871eef543419d2f10edf2
Sep 11 13:57:53.718984 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:53.718964    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:57:54.169980 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:54.169937    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp" event={"ID":"1f78c809-ea9d-40a1-933b-346d391d1713","Type":"ContainerStarted","Data":"1ac8e6332d1be68f95e179d1289190d97241dc0bb40871eef543419d2f10edf2"}
Sep 11 13:57:55.177317 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:55.177275    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp" event={"ID":"1f78c809-ea9d-40a1-933b-346d391d1713","Type":"ContainerStarted","Data":"d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce"}
Sep 11 13:57:55.177739 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:55.177344    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:57:55.197212 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:57:55.197149    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp" podStartSLOduration=1.70614709 podStartE2EDuration="2.19713186s" totalImagesPullingTime="490.98477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:57:55.196208841 +0000 UTC m=+2291.408752644" watchObservedRunningTime="2026-09-11 13:57:55.19713186 +0000 UTC m=+2291.409675659"
Sep 11 13:58:00.822321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.822277    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"]
Sep 11 13:58:00.822850 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.822517    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp" podUID="1f78c809-ea9d-40a1-933b-346d391d1713" containerName="maas-api" containerID="cri-o://d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce" gracePeriod=30
Sep 11 13:58:00.829052 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.829025    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:58:00.856645 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.856609    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"]
Sep 11 13:58:00.860166 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.860140    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:00.875119 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.875086    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"]
Sep 11 13:58:00.912571 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:00.912540    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:58:01.005431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.005143    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-metrics-certs\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.005431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.005193    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbfdg\" (UniqueName: \"kubernetes.io/projected/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-kube-api-access-cbfdg\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.005431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.005243    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-maas-api-tls\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.005431 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.005283    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-openshift-service-ca\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.073683 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.073617    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:58:01.106652 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.106621    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-metrics-certs\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.106652 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.106655    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbfdg\" (UniqueName: \"kubernetes.io/projected/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-kube-api-access-cbfdg\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.106942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.106679    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-maas-api-tls\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.106942 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.106710    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-openshift-service-ca\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.107477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.107452    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-openshift-service-ca\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.109191 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.109172    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-maas-api-tls\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.109292 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.109220    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-metrics-certs\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.114872 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.114845    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbfdg\" (UniqueName: \"kubernetes.io/projected/219c3724-0201-4f1f-9c61-2fd07c7a9ac8-kube-api-access-cbfdg\") pod \"maas-api-5ccdf6b696-xx5rd\" (UID: \"219c3724-0201-4f1f-9c61-2fd07c7a9ac8\") " pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.205676 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.205640    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:01.207074 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.207047    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddb56\" (UniqueName: \"kubernetes.io/projected/1f78c809-ea9d-40a1-933b-346d391d1713-kube-api-access-ddb56\") pod \"1f78c809-ea9d-40a1-933b-346d391d1713\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") "
Sep 11 13:58:01.207196 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.207123    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-metrics-certs\") pod \"1f78c809-ea9d-40a1-933b-346d391d1713\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") "
Sep 11 13:58:01.207196 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.207171    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f78c809-ea9d-40a1-933b-346d391d1713-openshift-service-ca\") pod \"1f78c809-ea9d-40a1-933b-346d391d1713\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") "
Sep 11 13:58:01.207321 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.207208    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-maas-api-tls\") pod \"1f78c809-ea9d-40a1-933b-346d391d1713\" (UID: \"1f78c809-ea9d-40a1-933b-346d391d1713\") "
Sep 11 13:58:01.207545 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.207508    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f78c809-ea9d-40a1-933b-346d391d1713-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f78c809-ea9d-40a1-933b-346d391d1713" (UID: "1f78c809-ea9d-40a1-933b-346d391d1713"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:58:01.209501 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.209478    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f78c809-ea9d-40a1-933b-346d391d1713" (UID: "1f78c809-ea9d-40a1-933b-346d391d1713"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:58:01.209714 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.209697    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f78c809-ea9d-40a1-933b-346d391d1713" (UID: "1f78c809-ea9d-40a1-933b-346d391d1713"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:58:01.209793 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.209716    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f78c809-ea9d-40a1-933b-346d391d1713-kube-api-access-ddb56" (OuterVolumeSpecName: "kube-api-access-ddb56") pod "1f78c809-ea9d-40a1-933b-346d391d1713" (UID: "1f78c809-ea9d-40a1-933b-346d391d1713"). InnerVolumeSpecName "kube-api-access-ddb56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:58:01.212656 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.212627    2547 generic.go:356] "Generic (PLEG): container finished" podID="1f78c809-ea9d-40a1-933b-346d391d1713" containerID="d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce" exitCode=0
Sep 11 13:58:01.212768 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.212671    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp" event={"ID":"1f78c809-ea9d-40a1-933b-346d391d1713","Type":"ContainerDied","Data":"d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce"}
Sep 11 13:58:01.212768 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.212679    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"
Sep 11 13:58:01.212768 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.212722    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67749f9dd-zggnp" event={"ID":"1f78c809-ea9d-40a1-933b-346d391d1713","Type":"ContainerDied","Data":"1ac8e6332d1be68f95e179d1289190d97241dc0bb40871eef543419d2f10edf2"}
Sep 11 13:58:01.212768 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.212751    2547 scope.go:117] "RemoveContainer" containerID="d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce"
Sep 11 13:58:01.223496 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.223469    2547 scope.go:117] "RemoveContainer" containerID="d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce"
Sep 11 13:58:01.223830 ip-10-0-140-8 kubenswrapper[2547]: E0911 13:58:01.223806    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce\": container with ID starting with d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce not found: ID does not exist" containerID="d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce"
Sep 11 13:58:01.223952 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.223837    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce"} err="failed to get container status \"d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce\": rpc error: code = NotFound desc = could not find container \"d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce\": container with ID starting with d8942fd6480ac7f06494494234ff3925f0ec0c51bac5032ff6fce5bd67fdf6ce not found: ID does not exist"
Sep 11 13:58:01.236255 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.236222    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"]
Sep 11 13:58:01.241562 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.241533    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-67749f9dd-zggnp"]
Sep 11 13:58:01.308584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.308545    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddb56\" (UniqueName: \"kubernetes.io/projected/1f78c809-ea9d-40a1-933b-346d391d1713-kube-api-access-ddb56\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:58:01.308584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.308577    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-metrics-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:58:01.308584 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.308589    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f78c809-ea9d-40a1-933b-346d391d1713-openshift-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:58:01.308833 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.308597    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f78c809-ea9d-40a1-933b-346d391d1713-maas-api-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\""
Sep 11 13:58:01.487826 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:01.487799    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"]
Sep 11 13:58:01.489484 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:58:01.489453    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219c3724_0201_4f1f_9c61_2fd07c7a9ac8.slice/crio-822366047a18499b236da71ece1fb76487d6e3364b9301846f56926b9952bb8d WatchSource:0}: Error finding container 822366047a18499b236da71ece1fb76487d6e3364b9301846f56926b9952bb8d: Status 404 returned error can't find the container with id 822366047a18499b236da71ece1fb76487d6e3364b9301846f56926b9952bb8d
Sep 11 13:58:02.220764 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:02.220727    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd" event={"ID":"219c3724-0201-4f1f-9c61-2fd07c7a9ac8","Type":"ContainerStarted","Data":"c47b074d810ebdbc61225e69fd33a6727c87fef37cb4e3a89043892aa9710c2b"}
Sep 11 13:58:02.221301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:02.220829    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:02.221301 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:02.220856    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd" event={"ID":"219c3724-0201-4f1f-9c61-2fd07c7a9ac8","Type":"ContainerStarted","Data":"822366047a18499b236da71ece1fb76487d6e3364b9301846f56926b9952bb8d"}
Sep 11 13:58:02.239880 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:02.239819    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd" podStartSLOduration=1.9206219180000002 podStartE2EDuration="2.239798303s" totalImagesPullingTime="319.176385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:58:02.239612928 +0000 UTC m=+2298.452156728" watchObservedRunningTime="2026-09-11 13:58:02.239798303 +0000 UTC m=+2298.452342102"
Sep 11 13:58:02.249306 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:02.249274    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f78c809-ea9d-40a1-933b-346d391d1713" path="/var/lib/kubelet/pods/1f78c809-ea9d-40a1-933b-346d391d1713/volumes"
Sep 11 13:58:07.606453 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:07.606405    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:58:08.233676 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:08.233646    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5ccdf6b696-xx5rd"
Sep 11 13:58:13.905538 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:13.905493    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:58:20.623234 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:20.623189    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nfw5h"]
Sep 11 13:58:23.448723 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:23.448692    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b5f4b7586-hggt7_6da816e6-f801-46ca-8507-83ceaea29dc1/authorino/0.log"
Sep 11 13:58:30.402048 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:30.402016    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-mftg4_dae5d9c9-d494-49cf-af4b-7dce8092285c/copy-manifests/0.log"
Sep 11 13:58:30.411835 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:30.411807    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-mftg4_dae5d9c9-d494-49cf-af4b-7dce8092285c/manager/0.log"
Sep 11 13:58:30.956290 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:30.956262    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5ccdf6b696-xx5rd_219c3724-0201-4f1f-9c61-2fd07c7a9ac8/maas-api/0.log"
Sep 11 13:58:32.156690 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:32.156656    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b5f4b7586-hggt7_6da816e6-f801-46ca-8507-83ceaea29dc1/authorino/0.log"
Sep 11 13:58:32.575371 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:32.575291    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dpk7l_ac6d02f8-93fc-4a8e-a369-31b609d6fb47/kuadrant-console-plugin/0.log"
Sep 11 13:58:32.826255 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:32.826178    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-nfw5h_1f3de2b8-71b0-4b80-b966-5283a123a4e3/limitador/0.log"
Sep 11 13:58:33.632313 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:33.632282    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8589c48f5d-6lp9t_fbe91f64-0a14-4fff-b4fc-e979ab05807f/kube-auth-proxy/0.log"
Sep 11 13:58:35.411646 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:35.411614    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-f9msx_47b66f92-8c74-4640-9187-561d19392e55/main/0.log"
Sep 11 13:58:42.332006 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.331969    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9fc22/must-gather-6bqr6"]
Sep 11 13:58:42.332394 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.332319    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f78c809-ea9d-40a1-933b-346d391d1713" containerName="maas-api"
Sep 11 13:58:42.332394 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.332330    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f78c809-ea9d-40a1-933b-346d391d1713" containerName="maas-api"
Sep 11 13:58:42.332475 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.332401    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f78c809-ea9d-40a1-933b-346d391d1713" containerName="maas-api"
Sep 11 13:58:42.335413 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.335397    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.339024 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.339000    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9fc22\"/\"default-dockercfg-jx2lb\""
Sep 11 13:58:42.339872 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.339857    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fc22\"/\"openshift-service-ca.crt\""
Sep 11 13:58:42.340388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.340374    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fc22\"/\"kube-root-ca.crt\""
Sep 11 13:58:42.363234 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.363201    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fc22/must-gather-6bqr6"]
Sep 11 13:58:42.469789 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.469747    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jmrl\" (UniqueName: \"kubernetes.io/projected/7300d733-183b-474a-813b-52c6ed51c9c8-kube-api-access-7jmrl\") pod \"must-gather-6bqr6\" (UID: \"7300d733-183b-474a-813b-52c6ed51c9c8\") " pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.469789 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.469792    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7300d733-183b-474a-813b-52c6ed51c9c8-must-gather-output\") pod \"must-gather-6bqr6\" (UID: \"7300d733-183b-474a-813b-52c6ed51c9c8\") " pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.571388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.571346    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jmrl\" (UniqueName: \"kubernetes.io/projected/7300d733-183b-474a-813b-52c6ed51c9c8-kube-api-access-7jmrl\") pod \"must-gather-6bqr6\" (UID: \"7300d733-183b-474a-813b-52c6ed51c9c8\") " pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.571388 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.571389    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7300d733-183b-474a-813b-52c6ed51c9c8-must-gather-output\") pod \"must-gather-6bqr6\" (UID: \"7300d733-183b-474a-813b-52c6ed51c9c8\") " pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.571821 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.571800    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7300d733-183b-474a-813b-52c6ed51c9c8-must-gather-output\") pod \"must-gather-6bqr6\" (UID: \"7300d733-183b-474a-813b-52c6ed51c9c8\") " pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.590953 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.590862    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jmrl\" (UniqueName: \"kubernetes.io/projected/7300d733-183b-474a-813b-52c6ed51c9c8-kube-api-access-7jmrl\") pod \"must-gather-6bqr6\" (UID: \"7300d733-183b-474a-813b-52c6ed51c9c8\") " pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.645057 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.645019    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fc22/must-gather-6bqr6"
Sep 11 13:58:42.934599 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:42.934572    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fc22/must-gather-6bqr6"]
Sep 11 13:58:42.936133 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:58:42.936102    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7300d733_183b_474a_813b_52c6ed51c9c8.slice/crio-a29d39982e9138367fa4ab3c83291408f242b2c26199ef0b20ddb9fcf0638e97 WatchSource:0}: Error finding container a29d39982e9138367fa4ab3c83291408f242b2c26199ef0b20ddb9fcf0638e97: Status 404 returned error can't find the container with id a29d39982e9138367fa4ab3c83291408f242b2c26199ef0b20ddb9fcf0638e97
Sep 11 13:58:43.447615 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:43.447570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/must-gather-6bqr6" event={"ID":"7300d733-183b-474a-813b-52c6ed51c9c8","Type":"ContainerStarted","Data":"a29d39982e9138367fa4ab3c83291408f242b2c26199ef0b20ddb9fcf0638e97"}
Sep 11 13:58:44.456128 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:44.456073    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/must-gather-6bqr6" event={"ID":"7300d733-183b-474a-813b-52c6ed51c9c8","Type":"ContainerStarted","Data":"faf8a0e81f3c68462770749976b3899debaa2263407b2b8412a67fa2dd2c9edb"}
Sep 11 13:58:44.456548 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:44.456147    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/must-gather-6bqr6" event={"ID":"7300d733-183b-474a-813b-52c6ed51c9c8","Type":"ContainerStarted","Data":"18bddd86477cf64d37d7d1a0634e8a4bcd16172f5b8aaa34e5fbbef967f6ebea"}
Sep 11 13:58:44.478349 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:44.478283    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9fc22/must-gather-6bqr6" podStartSLOduration=1.746448945 podStartE2EDuration="2.478260479s" totalImagesPullingTime="731.811534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:58:44.478025756 +0000 UTC m=+2340.690569556" watchObservedRunningTime="2026-09-11 13:58:44.478260479 +0000 UTC m=+2340.690804280"
Sep 11 13:58:45.629464 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:45.629431    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cxcf7_d3fc972e-a8f3-435e-82ae-f1d703a6c534/global-pull-secret-syncer/0.log"
Sep 11 13:58:45.822579 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:45.822547    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mljf5_da3487fb-8404-41d2-bb6d-df7679b34a69/konnectivity-agent/0.log"
Sep 11 13:58:45.885451 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:45.885366    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-8.ec2.internal_40ebe202d4a2d8cca9cb5126efaa8412/haproxy/0.log"
Sep 11 13:58:50.856049 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:50.854925    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b5f4b7586-hggt7_6da816e6-f801-46ca-8507-83ceaea29dc1/authorino/0.log"
Sep 11 13:58:50.961137 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:50.961100    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dpk7l_ac6d02f8-93fc-4a8e-a369-31b609d6fb47/kuadrant-console-plugin/0.log"
Sep 11 13:58:51.068060 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:51.068033    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-nfw5h_1f3de2b8-71b0-4b80-b966-5283a123a4e3/limitador/0.log"
Sep 11 13:58:52.833780 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:52.833735    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-mqlhz_6a21b9e9-524e-4767-9a39-99a8a657ab6b/cluster-monitoring-operator/0.log"
Sep 11 13:58:52.865091 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:52.865059    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jjfhh_44d0f8b4-5c38-46dd-9663-d78b106b9754/kube-state-metrics/0.log"
Sep 11 13:58:52.883505 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:52.883458    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jjfhh_44d0f8b4-5c38-46dd-9663-d78b106b9754/kube-rbac-proxy-main/0.log"
Sep 11 13:58:52.914223 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:52.914189    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-jjfhh_44d0f8b4-5c38-46dd-9663-d78b106b9754/kube-rbac-proxy-self/0.log"
Sep 11 13:58:53.002304 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.002271    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-8lqlf_d73f034f-bd45-4b8b-8814-8d88c2a9b943/monitoring-plugin/0.log"
Sep 11 13:58:53.236872 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.236839    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4rkx_8262aaaf-99c7-4470-bef0-4d59274cb45a/node-exporter/0.log"
Sep 11 13:58:53.266502 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.266472    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4rkx_8262aaaf-99c7-4470-bef0-4d59274cb45a/kube-rbac-proxy/0.log"
Sep 11 13:58:53.300098 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.300052    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4rkx_8262aaaf-99c7-4470-bef0-4d59274cb45a/init-textfile/0.log"
Sep 11 13:58:53.337718 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.337650    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wb5c6_5b6901dc-911f-4a02-977d-c93e223fba18/kube-rbac-proxy-main/0.log"
Sep 11 13:58:53.369782 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.369561    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wb5c6_5b6901dc-911f-4a02-977d-c93e223fba18/kube-rbac-proxy-self/0.log"
Sep 11 13:58:53.403220 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.403135    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-wb5c6_5b6901dc-911f-4a02-977d-c93e223fba18/openshift-state-metrics/0.log"
Sep 11 13:58:53.714598 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.714506    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-4wkjz_97984e7c-dde8-42d1-883a-4d89fde373b3/prometheus-operator-admission-webhook/0.log"
Sep 11 13:58:53.749592 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.749558    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb9b6b4d8-z2cjt_6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce/telemeter-client/0.log"
Sep 11 13:58:53.780844 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.780809    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb9b6b4d8-z2cjt_6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce/reload/0.log"
Sep 11 13:58:53.811090 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:53.811053    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb9b6b4d8-z2cjt_6fd9ee2a-c672-4b4e-8ddd-9ab4d221cbce/kube-rbac-proxy/0.log"
Sep 11 13:58:55.988933 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:55.988871    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"]
Sep 11 13:58:55.995337 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:55.995301    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.013496 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.013461    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"]
Sep 11 13:58:56.051701 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.051659    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/1.log"
Sep 11 13:58:56.057186 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.057150    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-t9t97_8150f5a9-fdfa-49ba-931d-1916f3fcceac/console-operator/2.log"
Sep 11 13:58:56.116900 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.116856    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-proc\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.117127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.116945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-sys\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.117127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.117010    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-podres\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.117127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.117039    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtss6\" (UniqueName: \"kubernetes.io/projected/c2962133-cb88-48e4-9078-900fa19c2d7f-kube-api-access-qtss6\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.117127 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.117072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-lib-modules\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218646 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218599    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-lib-modules\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218678    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-proc\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218708    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-sys\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218787    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-podres\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218799    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-proc\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218814    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtss6\" (UniqueName: \"kubernetes.io/projected/c2962133-cb88-48e4-9078-900fa19c2d7f-kube-api-access-qtss6\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.218868 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218800    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-lib-modules\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.219212 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218885    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-podres\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.219212 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.218868    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2962133-cb88-48e4-9078-900fa19c2d7f-sys\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.228807 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.228771    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtss6\" (UniqueName: \"kubernetes.io/projected/c2962133-cb88-48e4-9078-900fa19c2d7f-kube-api-access-qtss6\") pod \"perf-node-gather-daemonset-6nwk9\" (UID: \"c2962133-cb88-48e4-9078-900fa19c2d7f\") " pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.310539 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.310440    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:56.617401 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.617362    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"]
Sep 11 13:58:56.620012 ip-10-0-140-8 kubenswrapper[2547]: W0911 13:58:56.619978    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc2962133_cb88_48e4_9078_900fa19c2d7f.slice/crio-595e286c381fae9ba704768392babcf9335782130c255329976a47b353d721bb WatchSource:0}: Error finding container 595e286c381fae9ba704768392babcf9335782130c255329976a47b353d721bb: Status 404 returned error can't find the container with id 595e286c381fae9ba704768392babcf9335782130c255329976a47b353d721bb
Sep 11 13:58:56.657208 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.657161    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d54d858c9-xkhrn_ffbfa30e-cd56-4bcc-8a0f-cb30dd10071c/console/0.log"
Sep 11 13:58:56.723635 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:56.723597    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-lz5vp_41868a76-73de-4cb6-955a-218c8377876e/download-server/0.log"
Sep 11 13:58:57.419760 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:57.419729    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-6n9rj_b31efd14-0e4f-411a-9009-4caeaa96a381/volume-data-source-validator/0.log"
Sep 11 13:58:57.607157 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:57.607123    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9" event={"ID":"c2962133-cb88-48e4-9078-900fa19c2d7f","Type":"ContainerStarted","Data":"fe0bfdd54d73c4747ccbb33b807fc9bc9980d5e99626e41c1963b31de790884c"}
Sep 11 13:58:57.607477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:57.607174    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9" event={"ID":"c2962133-cb88-48e4-9078-900fa19c2d7f","Type":"ContainerStarted","Data":"595e286c381fae9ba704768392babcf9335782130c255329976a47b353d721bb"}
Sep 11 13:58:57.607477 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:57.607276    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:58:57.626514 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:57.626453    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9" podStartSLOduration=2.626433021 podStartE2EDuration="2.626433021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:58:57.623852064 +0000 UTC m=+2353.836395865" watchObservedRunningTime="2026-09-11 13:58:57.626433021 +0000 UTC m=+2353.838976822"
Sep 11 13:58:58.690772 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:58.690739    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pffhb_c9f10b3c-8ff1-4961-bcce-3a61421a0c62/dns/0.log"
Sep 11 13:58:58.716009 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:58.715969    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pffhb_c9f10b3c-8ff1-4961-bcce-3a61421a0c62/kube-rbac-proxy/0.log"
Sep 11 13:58:58.755608 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:58.755580    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2vxd_d54940d9-3814-41a3-b61c-9bc85f85106e/dns-node-resolver/0.log"
Sep 11 13:58:59.544385 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:58:59.544357    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vn8ph_49ce5973-5472-4798-aaac-5fcf1913ff49/node-ca/0.log"
Sep 11 13:59:00.983410 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:00.983379    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8589c48f5d-6lp9t_fbe91f64-0a14-4fff-b4fc-e979ab05807f/kube-auth-proxy/0.log"
Sep 11 13:59:02.202138 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:02.202089    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnpjd_6c845ef0-180c-4ff1-b233-28c59f946cf4/serve-healthcheck-canary/0.log"
Sep 11 13:59:03.043085 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:03.043053    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zx8wz_39638151-daec-4a22-aae7-4c237951def4/kube-rbac-proxy/0.log"
Sep 11 13:59:03.070062 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:03.070030    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zx8wz_39638151-daec-4a22-aae7-4c237951def4/exporter/0.log"
Sep 11 13:59:03.098638 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:03.098605    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zx8wz_39638151-daec-4a22-aae7-4c237951def4/extractor/0.log"
Sep 11 13:59:03.624951 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:03.624905    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9fc22/perf-node-gather-daemonset-6nwk9"
Sep 11 13:59:07.178930 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:07.178892    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-mftg4_dae5d9c9-d494-49cf-af4b-7dce8092285c/manager/0.log"
Sep 11 13:59:07.219666 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:07.219634    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64959b9bbc-mftg4_dae5d9c9-d494-49cf-af4b-7dce8092285c/copy-manifests/0.log"
Sep 11 13:59:07.606106 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:07.606021    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8589c48f5d-6lp9t_fbe91f64-0a14-4fff-b4fc-e979ab05807f/kube-auth-proxy/0.log"
Sep 11 13:59:08.692619 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:08.692539    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75ffb8c58-5zzlm_e808ef0f-9981-44ca-99f8-edb4391f458d/manager/0.log"
Sep 11 13:59:08.862994 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:08.862964    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h9jw5_3666b526-0605-4228-89a2-a4ff2892033b/openshift-lws-operator/0.log"
Sep 11 13:59:09.856735 ip-10-0-140-8 kubenswrapper[2547]: I0911 13:59:09.856707    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8589c48f5d-6lp9t_fbe91f64-0a14-4fff-b4fc-e979ab05807f/kube-auth-proxy/0.log"