Sep 18 19:39:22.791231 ip-10-0-143-228 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 19:39:26.180591 ip-10-0-143-228 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:39:26.180591 ip-10-0-143-228 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 19:39:26.180591 ip-10-0-143-228 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:39:26.180591 ip-10-0-143-228 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 19:39:26.180591 ip-10-0-143-228 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:39:26.181308 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.180682    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 19:39:26.183708 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183689    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:26.183708 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183707    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183710    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183714    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183717    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183720    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183726    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183730    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183734    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183737    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183740    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183743    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183746    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183749    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183752    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183754    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183757    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183760    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183763    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183768    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:26.183778 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183771    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183773    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183776    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183779    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183781    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183784    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183789    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183792    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183795    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183798    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183800    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183803    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183805    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183808    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183811    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183814    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183816    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183819    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183821    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:26.184270 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183825    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183827    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183830    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183833    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183835    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183838    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183842    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183844    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183846    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183849    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183851    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183854    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183856    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183860    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183865    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183868    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183871    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183889    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183892    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183894    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:26.184749 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183897    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183899    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183902    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183913    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183915    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183918    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183921    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183924    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183927    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183929    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183932    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183934    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183938    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183940    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183943    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183945    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183948    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183950    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183953    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183955    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:26.185252 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183958    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183960    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183963    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183965    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183968    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183970    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183973    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183977    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183980    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183983    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183985    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183988    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183990    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183993    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183996    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.183998    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184001    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184003    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184006    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184008    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:26.185736 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184689    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184696    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184699    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184701    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184704    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184707    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184710    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184713    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184716    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184719    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184721    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184724    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184726    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184729    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184733    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184737    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184741    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184744    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184747    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:26.186274 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184750    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184753    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184756    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184759    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184762    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184765    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184768    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184770    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184773    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184775    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184777    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184780    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184782    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184785    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184787    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184790    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184794    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184797    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184799    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184803    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:26.186780 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184806    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184809    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184811    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184814    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184817    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184820    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184823    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184826    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184829    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184831    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184834    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184837    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184840    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184843    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184845    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184848    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184851    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184853    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184855    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184858    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:26.187303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184861    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184863    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184865    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184868    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184870    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184888    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184891    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184893    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184896    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184900    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184903    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184905    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184909    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184911    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184914    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184916    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184919    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184922    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184925    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:26.187803 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184929    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184931    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184934    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184937    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184940    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184943    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184945    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184948    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184950    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184953    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184955    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184958    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184961    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184963    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184966    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184968    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184971    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184974    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184976    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184979    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:26.188287 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.184982    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185355    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185359    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185362    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185365    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185368    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185371    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185374    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185376    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185382    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185384    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185387    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185389    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185392    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185395    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185397    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185400    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185404    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185406    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185409    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:26.188770 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185412    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185415    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185417    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185420    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185422    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185425    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185428    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185430    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185433    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185435    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185438    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185440    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185443    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185445    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185449    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185453    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185456    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185459    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185462    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185465    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:26.189273 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185468    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185473    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185476    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185478    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185481    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185484    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185486    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185489    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185491    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185496    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185498    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185501    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185503    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185506    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185509    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185511    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185514    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185516    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185519    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:26.189756 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185522    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185526    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185529    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185532    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185535    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185538    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185541    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185544    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185546    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185549    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185551    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185554    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185557    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185559    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185563    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185566    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185568    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185570    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185573    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:26.190225 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185576    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185579    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185581    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185585    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185587    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185590    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185593    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185595    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185598    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185600    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185603    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185607    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185609    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185612    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185614    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185617    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185619    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185622    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185625    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185627    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:26.190687 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185630    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.185632    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185714    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185750    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185761    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185765    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185770    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185775    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185779    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185783    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185786    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185789    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185792    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185796    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185799    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185803    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185806    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185810    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185813    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185815    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185820    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185822    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185826    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185829    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 19:39:26.191181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185832    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185836    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185839    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185842    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185845    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185848    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185851    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185854    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185857    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185860    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185864    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185867    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185870    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185891    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185897    2582 flags.go:64] FLAG: --enable-server="true"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185904    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185911    2582 flags.go:64] FLAG: --event-burst="100"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185915    2582 flags.go:64] FLAG: --event-qps="50"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185918    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185921    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185943    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185948    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185952    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185957    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185960    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 18 19:39:26.191761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185964    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185967    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185970    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185972    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185975    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185978    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185981    2582 flags.go:64] FLAG: --feature-gates=""
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185985    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185988    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185992    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185995    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.185998    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186001    2582 flags.go:64] FLAG: --help="false"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186004    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186007    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186010    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186013    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186016    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186020    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186022    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186025    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186028    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186032    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186036    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 19:39:26.192407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186039    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186042    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186045    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186048    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186051    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186053    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186057    2582 flags.go:64] FLAG: --lock-file=""
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186060    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186063    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186066    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186071    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186074    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186077    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186080    2582 flags.go:64] FLAG: --logging-format="text"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186082    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186086    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186089    2582 flags.go:64] FLAG: --manifest-url=""
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186092    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186096    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186099    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186103    2582 flags.go:64] FLAG: --max-pods="110"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186106    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186109    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186112    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186115    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186118    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 19:39:26.193048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186121    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186123    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186131    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186134    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186138    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186141    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186145    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186151    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186154    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186157    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186160    2582 flags.go:64] FLAG: --port="10250"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186163    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186169    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08b55e6fe5d3a0b3f"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186172    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186175    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186178    2582 flags.go:64] FLAG: --register-node="true"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186181    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186184    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186187    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186190    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186193    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186197    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186200    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186203    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186205    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 19:39:26.193740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186208    2582 flags.go:64] FLAG: --runonce="false"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186211    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186214    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186217    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186220    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186223    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186226    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186229    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186232    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186235    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186237    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186240    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186245    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186248    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186252    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186254    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186260    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186262    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186265    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186271    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186273    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186277    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186280    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186283    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186286    2582 flags.go:64] FLAG: --v="2"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186290    2582 flags.go:64] FLAG: --version="false"
Sep 18 19:39:26.194368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186294    2582 flags.go:64] FLAG: --vmodule=""
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186298    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.186301    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186416    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186419    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186423    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186427    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186430    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186432    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186435    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186438    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186440    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186443    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186445    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186448    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186450    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186453    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186456    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186460    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186462    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:26.195028 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186465    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186468    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186470    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186473    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186476    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186480    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186484    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186487    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186489    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186492    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186494    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186497    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186500    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186503    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186514    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186517    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186519    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186522    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186525    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:26.195526 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186527    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186530    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186533    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186535    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186537    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186540    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186542    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186545    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186547    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186550    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186552    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186556    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186559    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186561    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186564    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186567    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186570    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186572    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186575    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186578    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:26.196089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186581    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186584    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186587    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186589    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186592    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186595    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186597    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186601    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186604    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186607    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186610    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186613    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186616    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186618    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186621    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186624    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186626    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186629    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186631    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186633    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:26.196630 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186636    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186638    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186641    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186645    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186648    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186651    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186653    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186656    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186660    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186663    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186667    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186670    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186673    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186675    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186678    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186680    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186683    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186686    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186688    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186691    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:26.197139 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186693    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186696    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.186698    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.187210    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.194606    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.194627    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.194650    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.194657    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194725    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194731    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194734    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194737    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194740    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194743    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194747    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:26.197626 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194751    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194755    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194758    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194761    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194764    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194767    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194769    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194772    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194774    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194780    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194785    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194790    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194795    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194798    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194801    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194804    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194806    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194809    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194812    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:26.198017 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194814    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194817    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194819    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194823    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194826    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194829    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194831    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194834    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194836    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194839    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194841    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194844    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194846    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194849    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194851    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194854    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194857    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194862    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194866    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194870    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:26.198474 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194897    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194900    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194903    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194906    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194909    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194912    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194915    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194918    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194920    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194922    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194925    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194928    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194930    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194933    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194935    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194940    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194945    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194950    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194954    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194958    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:26.199035 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194961    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194964    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194966    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194969    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194971    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194975    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194979    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194982    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194984    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194987    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194990    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194992    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194995    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.194998    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195001    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195004    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195006    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195009    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195012    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195014    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:26.199607 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195017    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195021    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195025    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195029    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195034    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195037    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195040    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195043    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195046    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195050    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195052    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195055    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195058    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.195063    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195195    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195202    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:26.200451 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195205    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195208    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195211    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195214    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195218    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195220    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195223    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195225    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195228    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195231    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195234    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195236    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195239    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195242    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195244    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195247    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195250    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195252    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195255    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195258    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:26.200931 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195262    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195267    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195271    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195276    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195279    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195281    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195285    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195287    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195290    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195292    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195295    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195297    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195300    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195303    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195305    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195308    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195310    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195313    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195315    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195318    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:26.201553 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195321    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195323    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195326    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195328    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195332    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195337    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195342    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195346    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195352    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195357    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195360    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195370    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195373    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195376    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195378    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195381    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195384    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195386    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195389    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:26.202240 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195393    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195395    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195398    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195400    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195403    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195406    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195408    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195411    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195413    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195416    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195420    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195424    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195428    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195432    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195436    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195439    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195442    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195444    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195448    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195452    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:26.202727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195455    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195458    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195460    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195463    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195466    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195468    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195471    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195473    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195476    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195478    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195481    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195483    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195486    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195490    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195492    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195495    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195500    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:26.203259 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:26.195504    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.195512    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.195682    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.198596    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.199508    2582 server.go:1019] "Starting client certificate rotation"
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.199622    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.199668    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 19:39:26.203680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.202083    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 19:39:26.206574 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.206551    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 19:39:26.214283 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.214263    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 18 19:39:26.215833 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.215815    2582 log.go:25] "Validated CRI v1 image API"
Sep 18 19:39:26.216693 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.216675    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 19:39:26.218924 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.218892    2582 fs.go:135] Filesystem UUIDs: map[56f3d184-0046-4dcd-a914-0f4eea1b6ab4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c4c2a828-29e3-4bcb-8fb7-939637b905cf:/dev/nvme0n1p3]
Sep 18 19:39:26.219001 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.218921    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 19:39:26.223419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.223299    2582 manager.go:216] Machine: {Timestamp:2026-09-18 19:39:26.222792286 +0000 UTC m=+1.981600262 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099769 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e7eb870cfd8cf5b3061d4e6b94d34 SystemUUID:ec2e7eb8-70cf-d8cf-5b30-61d4e6b94d34 BootID:52739753-cc6e-4528-b571-e1059a47a4da Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e6:6c:3d:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e6:6c:3d:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:b6:51:ed:03:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 19:39:26.223419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.223414    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 19:39:26.223540 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.223499    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 19:39:26.225131 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.225097    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 19:39:26.225295 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.225133    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 19:39:26.226439 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.226428    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 19:39:26.226486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.226442    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 19:39:26.226486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.226451    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 19:39:26.226486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.226462    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 19:39:26.227631 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.227620    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 19:39:26.230014 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.229995    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 19:39:26.230985 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.230973    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 19:39:26.231105 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231096    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 19:39:26.231146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231127    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 19:39:26.231175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231148    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 19:39:26.231175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231158    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 19:39:26.231175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231168    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 18 19:39:26.231306 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231180    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 19:39:26.231693 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231680    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 19:39:26.231746 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.231701    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 19:39:26.234172 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.234153    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 19:39:26.236554 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.236537    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 19:39:26.236631 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.236569    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 19:39:26.237682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237664    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 19:39:26.237682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237684    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237697    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237702    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237712    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237720    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237738    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237744    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237750    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237756    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237768    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237773    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 19:39:26.237803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237801    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 19:39:26.238096 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.237811    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 19:39:26.241948 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.241932    2582 server.go:1268] "Started kubelet"
Sep 18 19:39:26.242058 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.242027    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 19:39:26.281937 ip-10-0-143-228 systemd[1]: Started Kubernetes Kubelet.
Sep 18 19:39:26.282684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.282358    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 19:39:26.282684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.282443    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 19:39:26.282684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.282451    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxmfw"
Sep 18 19:39:26.282684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.282474    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hxmfw"
Sep 18 19:39:26.283044 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.282929    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 19:39:26.283771 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.283752    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 19:39:26.284443 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.284352    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 19:39:26.285918 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.285894    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 19:39:26.285996 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.285942    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 19:39:26.285996 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.285948    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 19:39:26.290165 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.289251    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-228.ec2.internal.18d681920ee8c773  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-228.ec2.internal,UID:ip-10-0-143-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-228.ec2.internal,},FirstTimestamp:2026-09-18 19:39:26.241695603 +0000 UTC m=+2.000503636,LastTimestamp:2026-09-18 19:39:26.241695603 +0000 UTC m=+2.000503636,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-228.ec2.internal,}"
Sep 18 19:39:26.291909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.291895    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 19:39:26.292007 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.291981    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 19:39:26.292101 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.292050    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.292433 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.292410    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 19:39:26.292433 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.292434    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 19:39:26.292527 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.292437    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 19:39:26.295769 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.295737    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 19:39:26.295769 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.295765    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 19:39:26.296667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.296646    2582 factory.go:55] Registering systemd factory
Sep 18 19:39:26.296667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.296668    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 18 19:39:26.298747 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.298721    2582 factory.go:153] Registering CRI-O factory
Sep 18 19:39:26.298747 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.298741    2582 factory.go:223] Registration of the crio container factory successfully
Sep 18 19:39:26.298890 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.298802    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 19:39:26.298890 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.298823    2582 factory.go:103] Registering Raw factory
Sep 18 19:39:26.298890 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.298838    2582 manager.go:1196] Started watching for new ooms in manager
Sep 18 19:39:26.299296 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.299270    2582 manager.go:349] Starting recovery of all containers
Sep 18 19:39:26.299580 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.299555    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:26.303910 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.303864    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.309514 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.309497    2582 manager.go:354] Recovery completed
Sep 18 19:39:26.314008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.313993    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.316526 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.316503    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.316605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.316538    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.316605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.316548    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.317173 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317160    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 19:39:26.317173 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317170    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.317264 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317173    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 19:39:26.317264 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317202    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 19:39:26.317888 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317855    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.317978 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317902    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.317978 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.317916    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.318481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.318467    2582 policy_none.go:49] "None policy: Start"
Sep 18 19:39:26.318481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.318483    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 19:39:26.318565 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.318493    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 19:39:26.319599 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.319589    2582 policy_none.go:47] "Start"
Sep 18 19:39:26.352809 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.352629    2582 manager.go:337] "Starting Device Plugin manager"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.352836    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.352851    2582 server.go:87] "Starting device plugin registration server"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.353133    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.353155    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.353239    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.353332    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.353342    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.353958    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 19:39:26.363621 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.354010    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.432142 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.432050    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 19:39:26.433473 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.433454    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 19:39:26.433547 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.433517    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 19:39:26.433586 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.433552    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 19:39:26.433631 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.433601    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 19:39:26.438165 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.438138    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:26.453449 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.453428    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.454418 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.454401    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.454486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.454433    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.454486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.454443    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.454486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.454466    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.469941 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.469919    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.470004 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.469944    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-228.ec2.internal\": node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.535471 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.534636    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"]
Sep 18 19:39:26.535629 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.535510    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.536615 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.536600    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.536679 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.536631    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.536679 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.536641    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.538008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.537989    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.538126 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.538161 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538153    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.538936 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538921    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.539035 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538924    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.539035 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538981    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.539035 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538952    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.539035 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.538999    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.539035 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.539023    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.540218 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.540198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.540320 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.540224    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:26.543126 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.543110    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:26.543206 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.543140    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:26.543206 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.543154    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:26.565780 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.565760    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.570174 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.570155    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.581563 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.581540    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.597870 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.597841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.597983 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.597891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.597983 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.597919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e70fcf4e6b756809a2612ebd8cc6497-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"9e70fcf4e6b756809a2612ebd8cc6497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.682370 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.682296    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.698533 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.698503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.698533 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.698533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.698653 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.698548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e70fcf4e6b756809a2612ebd8cc6497-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"9e70fcf4e6b756809a2612ebd8cc6497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.698653 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.698591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e70fcf4e6b756809a2612ebd8cc6497-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"9e70fcf4e6b756809a2612ebd8cc6497\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.698653 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.698615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.698653 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.698615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b1aba493d65d32cf9925e6f47a0671c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"7b1aba493d65d32cf9925e6f47a0671c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.783376 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.783338    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.869894 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.869850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.874334 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:26.874086    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:26.884212 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.884187    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:26.984903 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:26.984788    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:27.085347 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:27.085300    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:27.186022 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:27.185987    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:27.199340 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.199320    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 19:39:27.199500 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.199479    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 19:39:27.199553 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.199518    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 19:39:27.287043 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:27.286963    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:27.288582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.288553    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 19:34:26 +0000 UTC" deadline="2028-05-05 02:13:20.060356269 +0000 UTC"
Sep 18 19:39:27.288713 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.288582    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14262h33m52.771778529s"
Sep 18 19:39:27.387084 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:27.387051    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:27.487913 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:27.487846    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found"
Sep 18 19:39:27.498326 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.498301    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:27.498757 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:27.498733    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1aba493d65d32cf9925e6f47a0671c.slice/crio-a1fb21080f8499b39a8e7cc74e3676dcb63e8fd33518d5b5461f77720ed8af6e WatchSource:0}: Error finding container a1fb21080f8499b39a8e7cc74e3676dcb63e8fd33518d5b5461f77720ed8af6e: Status 404 returned error can't find the container with id a1fb21080f8499b39a8e7cc74e3676dcb63e8fd33518d5b5461f77720ed8af6e
Sep 18 19:39:27.499022 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:27.499003    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e70fcf4e6b756809a2612ebd8cc6497.slice/crio-f15ddfb71ad8c65ff9db039cd7af7ad4eaa49190a01bd3e791144a868dbcd37a WatchSource:0}: Error finding container f15ddfb71ad8c65ff9db039cd7af7ad4eaa49190a01bd3e791144a868dbcd37a: Status 404 returned error can't find the container with id f15ddfb71ad8c65ff9db039cd7af7ad4eaa49190a01bd3e791144a868dbcd37a
Sep 18 19:39:27.504332 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.504319    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:39:27.592701 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.592628    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:27.603019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.602997    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 19:39:27.604756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.604741    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal"
Sep 18 19:39:27.614781 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.614763    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 19:39:27.663222 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:27.663195    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:28.077217 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.077133    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:28.232300 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.232268    2582 apiserver.go:52] "Watching apiserver"
Sep 18 19:39:28.239285 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.239252    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 19:39:28.240114 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.240087    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","openshift-multus/multus-additional-cni-plugins-87grs","kube-system/global-pull-secret-syncer-scwmc","openshift-multus/multus-lm2nh","openshift-multus/network-metrics-daemon-phct6","openshift-network-diagnostics/network-check-target-52csd","openshift-network-operator/iptables-alerter-zwqh9","openshift-ovn-kubernetes/ovnkube-node-q2d5t","kube-system/konnectivity-agent-gx8r9","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh","openshift-cluster-node-tuning-operator/tuned-9d9dp","openshift-dns/node-resolver-g9ftl","openshift-image-registry/node-ca-m484c"]
Sep 18 19:39:28.241722 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.241704    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.244318 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.244296    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.244318 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.244307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.244473 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.244307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 19:39:28.244473 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.244398    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5l25g\""
Sep 18 19:39:28.248269 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.248246    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.248924 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.248906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.249121 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.249093    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:28.249847 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.249824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.250739 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.250478    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.250840 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.250780    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlrjv\""
Sep 18 19:39:28.250840 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.250828    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.251175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.251158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.251252 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.251224    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.252587    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gmtbw\""
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.252629    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.252666    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.252846    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.252914    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.252963    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.253019 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.252972    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:28.253781 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.253761    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.255349 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.255330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.256769 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.256753    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.257446 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.257428    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 19:39:28.257576 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.257557    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nh8kh\""
Sep 18 19:39:28.257658 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.257646    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 19:39:28.257921 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.257904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 19:39:28.258004 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.257921    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.258060 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.258022    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cvmz8\""
Sep 18 19:39:28.258205 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.258171    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.258824 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.258707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.261331 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.261307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.262291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.258803    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 19:39:28.263918 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.263896    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 19:39:28.264299 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.264279    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.264772 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.264749    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.264860 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.264837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.265288 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.265265    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-92kf7\""
Sep 18 19:39:28.265418 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.265401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 19:39:28.265525 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.265511    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 19:39:28.265671 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.265653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m7nqj\""
Sep 18 19:39:28.266157 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.266138    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.267491 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.266911    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkpgr\""
Sep 18 19:39:28.267491 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.267224    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 19:39:28.268190 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.267797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.269302 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.269282    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 19:39:28.270056 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.270032    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hblpp\""
Sep 18 19:39:28.270413 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.270390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:39:28.270571 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.270555    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 19:39:28.271121 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.271103    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 19:39:28.294480 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.293418    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 19:39:28.294617 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.294506    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-ovnkube-config\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-system-cni-dir\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-cnibin\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr7d2\" (UniqueName: \"kubernetes.io/projected/1966f9fa-1fde-4951-8929-43462269ce5c-kube-api-access-tr7d2\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.305994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-var-lib-kubelet\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-systemd\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c-konnectivity-ca\") pod \"konnectivity-agent-gx8r9\" (UID: \"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c\") " pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-run-netns\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-node-log\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-host-slash\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8w7\" (UniqueName: \"kubernetes.io/projected/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-kube-api-access-xx8w7\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-system-cni-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5611f814-7222-4961-8759-3d039e5395eb-host\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.308389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d83e3e6f-6855-4c8f-8d95-1b6e025179be-hosts-file\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgtjh\" (UniqueName: \"kubernetes.io/projected/5d0b7ad3-b63a-4bca-b203-376da025850a-kube-api-access-wgtjh\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-systemd\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b511cb1-75c5-4cd0-9641-025f1475680e-dbus\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-multus-certs\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5611f814-7222-4961-8759-3d039e5395eb-serviceca\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqld\" (UniqueName: \"kubernetes.io/projected/5611f814-7222-4961-8759-3d039e5395eb-kube-api-access-wxqld\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306533    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-host\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-cnibin\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-kubelet\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-sys\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-conf-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f381b2f-6aea-4542-8666-6134f831d655-multus-daemon-config\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phksh\" (UniqueName: \"kubernetes.io/projected/a285377b-0634-4f43-8294-520305cbd4e4-kube-api-access-phksh\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.309265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-slash\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-socket-dir-parent\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-systemd-units\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-var-lib-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-cni-netd\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-device-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.306993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-tuned\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-k8s-cni-cncf-io\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcw27\" (UniqueName: \"kubernetes.io/projected/6f381b2f-6aea-4542-8666-6134f831d655-kube-api-access-rcw27\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-ovnkube-script-lib\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c62j\" (UniqueName: \"kubernetes.io/projected/d83e3e6f-6855-4c8f-8d95-1b6e025179be-kube-api-access-9c62j\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.310107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-sys-fs\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-lib-modules\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-cni-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-cni-bin\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c-agent-certs\") pod \"konnectivity-agent-gx8r9\" (UID: \"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c\") " pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-cni-bin\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clsgb\" (UniqueName: \"kubernetes.io/projected/3eff98a8-abd8-4a4b-ac46-619476ad445d-kube-api-access-clsgb\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysconfig\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-etc-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-modprobe-d\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-ovn\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-registration-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83e3e6f-6855-4c8f-8d95-1b6e025179be-tmp-dir\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-cni-binary-copy\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307600    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-kubernetes\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6vtm\" (UniqueName: \"kubernetes.io/projected/6c2a342b-69fe-4189-913b-5cb34a6c354a-kube-api-access-b6vtm\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-cni-multus\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.310810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-hostroot\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a285377b-0634-4f43-8294-520305cbd4e4-ovn-node-metrics-cert\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysctl-d\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c2a342b-69fe-4189-913b-5cb34a6c354a-tmp\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b511cb1-75c5-4cd0-9641-025f1475680e-kubelet-config\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.307981    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f381b2f-6aea-4542-8666-6134f831d655-cni-binary-copy\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-netns\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-run\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-log-socket\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-env-overrides\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-socket-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysctl-conf\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-iptables-alerter-script\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-etc-kubernetes\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.311813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.308362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-kubelet\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.325856 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.325825    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wtvbx"
Sep 18 19:39:28.334508 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.334488    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wtvbx"
Sep 18 19:39:28.400817 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.400783    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-iptables-alerter-script\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-etc-kubernetes\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-kubelet\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-ovnkube-config\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-system-cni-dir\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-cnibin\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr7d2\" (UniqueName: \"kubernetes.io/projected/1966f9fa-1fde-4951-8929-43462269ce5c-kube-api-access-tr7d2\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-var-lib-kubelet\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-systemd\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c-konnectivity-ca\") pod \"konnectivity-agent-gx8r9\" (UID: \"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c\") " pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-run-netns\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-node-log\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-host-slash\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8w7\" (UniqueName: \"kubernetes.io/projected/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-kube-api-access-xx8w7\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.411089 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.408978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-system-cni-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5611f814-7222-4961-8759-3d039e5395eb-host\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d83e3e6f-6855-4c8f-8d95-1b6e025179be-hosts-file\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgtjh\" (UniqueName: \"kubernetes.io/projected/5d0b7ad3-b63a-4bca-b203-376da025850a-kube-api-access-wgtjh\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-systemd\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b511cb1-75c5-4cd0-9641-025f1475680e-dbus\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-multus-certs\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5611f814-7222-4961-8759-3d039e5395eb-serviceca\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqld\" (UniqueName: \"kubernetes.io/projected/5611f814-7222-4961-8759-3d039e5395eb-kube-api-access-wxqld\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-host\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-cnibin\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-kubelet\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-sys\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-conf-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f381b2f-6aea-4542-8666-6134f831d655-multus-daemon-config\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.412263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phksh\" (UniqueName: \"kubernetes.io/projected/a285377b-0634-4f43-8294-520305cbd4e4-kube-api-access-phksh\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-slash\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409524    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-system-cni-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-socket-dir-parent\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-systemd-units\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-var-lib-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-cni-netd\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-device-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-tuned\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-k8s-cni-cncf-io\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcw27\" (UniqueName: \"kubernetes.io/projected/6f381b2f-6aea-4542-8666-6134f831d655-kube-api-access-rcw27\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-ovnkube-script-lib\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c62j\" (UniqueName: \"kubernetes.io/projected/d83e3e6f-6855-4c8f-8d95-1b6e025179be-kube-api-access-9c62j\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.413147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-etc-kubernetes\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-sys-fs\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-lib-modules\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-sys-fs\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.409992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-cni-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5611f814-7222-4961-8759-3d039e5395eb-host\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-cni-bin\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c-agent-certs\") pod \"konnectivity-agent-gx8r9\" (UID: \"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c\") " pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d83e3e6f-6855-4c8f-8d95-1b6e025179be-hosts-file\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-kubelet\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-iptables-alerter-script\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-systemd\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-multus-certs\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b511cb1-75c5-4cd0-9641-025f1475680e-dbus\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410644    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-ovnkube-config\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-run-netns\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-node-log\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.413667 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-host-slash\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c-konnectivity-ca\") pod \"konnectivity-agent-gx8r9\" (UID: \"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c\") " pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-cnibin\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-kubelet\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5611f814-7222-4961-8759-3d039e5395eb-serviceca\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411651    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-system-cni-dir\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.411961    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-sys\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.412027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-conf-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.412123    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.412406    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-cnibin\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.412599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-host\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.412650    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.412786    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:28.912749035 +0000 UTC m=+4.671557015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.413335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f381b2f-6aea-4542-8666-6134f831d655-multus-daemon-config\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.413388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-socket-dir-parent\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.413434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-slash\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.414289    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.410079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-cni-bin\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.413444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-systemd-units\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clsgb\" (UniqueName: \"kubernetes.io/projected/3eff98a8-abd8-4a4b-ac46-619476ad445d-kube-api-access-clsgb\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysconfig\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.414444    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:28.914410877 +0000 UTC m=+4.673218860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-etc-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysconfig\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-modprobe-d\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-ovn\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414685    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-etc-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.414735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-k8s-cni-cncf-io\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-registration-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83e3e6f-6855-4c8f-8d95-1b6e025179be-tmp-dir\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-cni-binary-copy\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d0b7ad3-b63a-4bca-b203-376da025850a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-kubernetes\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vtm\" (UniqueName: \"kubernetes.io/projected/6c2a342b-69fe-4189-913b-5cb34a6c354a-kube-api-access-b6vtm\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-cni-multus\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-device-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-cni-bin\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-hostroot\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-multus-cni-dir\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.415146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-cni-multus\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.415492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-registration-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.415492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-systemd\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.415492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d83e3e6f-6855-4c8f-8d95-1b6e025179be-tmp-dir\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.415492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-modprobe-d\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.415677 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.414948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-cni-netd\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.415677 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.415500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-run-ovn\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416021 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416099 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a285377b-0634-4f43-8294-520305cbd4e4-ovn-node-metrics-cert\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416166 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysctl-d\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.416166 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c2a342b-69fe-4189-913b-5cb34a6c354a-tmp\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.416166 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-ovnkube-script-lib\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416322 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b511cb1-75c5-4cd0-9641-025f1475680e-kubelet-config\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.416473 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b511cb1-75c5-4cd0-9641-025f1475680e-kubelet-config\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.416548 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f381b2f-6aea-4542-8666-6134f831d655-cni-binary-copy\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.416548 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-netns\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.416548 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-run\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.416548 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-log-socket\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-env-overrides\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.416736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-socket-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.416736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysctl-conf\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.416736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416626    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d0b7ad3-b63a-4bca-b203-376da025850a-cni-binary-copy\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.416736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-var-lib-kubelet\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.417096 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1966f9fa-1fde-4951-8929-43462269ce5c-socket-dir\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.417096 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.416981    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-tuned\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.417202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.417096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a285377b-0634-4f43-8294-520305cbd4e4-env-overrides\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.417202 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.417099    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:28.417202 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.417149    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:28.417202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.417147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-var-lib-cni-bin\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.417202 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.417163    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:28.417436 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.417210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-hostroot\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.417436 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.417222    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:39:28.91720552 +0000 UTC m=+4.676013506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:28.417436 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.417075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysctl-d\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.417436 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.417283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-kubernetes\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.417436 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.417413    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-etc-sysctl-conf\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418126    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f381b2f-6aea-4542-8666-6134f831d655-cni-binary-copy\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-run\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418128    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f381b2f-6aea-4542-8666-6134f831d655-host-run-netns\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-log-socket\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a285377b-0634-4f43-8294-520305cbd4e4-var-lib-openvswitch\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c2a342b-69fe-4189-913b-5cb34a6c354a-lib-modules\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.419409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.418729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c-agent-certs\") pod \"konnectivity-agent-gx8r9\" (UID: \"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c\") " pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.420251 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.420175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgtjh\" (UniqueName: \"kubernetes.io/projected/5d0b7ad3-b63a-4bca-b203-376da025850a-kube-api-access-wgtjh\") pod \"multus-additional-cni-plugins-87grs\" (UID: \"5d0b7ad3-b63a-4bca-b203-376da025850a\") " pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.420574 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.420555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c2a342b-69fe-4189-913b-5cb34a6c354a-tmp\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.420814 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.420725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8w7\" (UniqueName: \"kubernetes.io/projected/ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6-kube-api-access-xx8w7\") pod \"iptables-alerter-zwqh9\" (UID: \"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6\") " pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.422102 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.422078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqld\" (UniqueName: \"kubernetes.io/projected/5611f814-7222-4961-8759-3d039e5395eb-kube-api-access-wxqld\") pod \"node-ca-m484c\" (UID: \"5611f814-7222-4961-8759-3d039e5395eb\") " pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.422675 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.422653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcw27\" (UniqueName: \"kubernetes.io/projected/6f381b2f-6aea-4542-8666-6134f831d655-kube-api-access-rcw27\") pod \"multus-lm2nh\" (UID: \"6f381b2f-6aea-4542-8666-6134f831d655\") " pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.423315 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.423288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a285377b-0634-4f43-8294-520305cbd4e4-ovn-node-metrics-cert\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.424228 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.424182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phksh\" (UniqueName: \"kubernetes.io/projected/a285377b-0634-4f43-8294-520305cbd4e4-kube-api-access-phksh\") pod \"ovnkube-node-q2d5t\" (UID: \"a285377b-0634-4f43-8294-520305cbd4e4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.425481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.425459    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c62j\" (UniqueName: \"kubernetes.io/projected/d83e3e6f-6855-4c8f-8d95-1b6e025179be-kube-api-access-9c62j\") pod \"node-resolver-g9ftl\" (UID: \"d83e3e6f-6855-4c8f-8d95-1b6e025179be\") " pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.426776 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.426753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr7d2\" (UniqueName: \"kubernetes.io/projected/1966f9fa-1fde-4951-8929-43462269ce5c-kube-api-access-tr7d2\") pod \"aws-ebs-csi-driver-node-6gpkh\" (UID: \"1966f9fa-1fde-4951-8929-43462269ce5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.428052 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.428031    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6vtm\" (UniqueName: \"kubernetes.io/projected/6c2a342b-69fe-4189-913b-5cb34a6c354a-kube-api-access-b6vtm\") pod \"tuned-9d9dp\" (UID: \"6c2a342b-69fe-4189-913b-5cb34a6c354a\") " pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.429091 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.429068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clsgb\" (UniqueName: \"kubernetes.io/projected/3eff98a8-abd8-4a4b-ac46-619476ad445d-kube-api-access-clsgb\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.440577 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.440519    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"9e70fcf4e6b756809a2612ebd8cc6497","Type":"ContainerStarted","Data":"f15ddfb71ad8c65ff9db039cd7af7ad4eaa49190a01bd3e791144a868dbcd37a"}
Sep 18 19:39:28.442175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.442146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"7b1aba493d65d32cf9925e6f47a0671c","Type":"ContainerStarted","Data":"a1fb21080f8499b39a8e7cc74e3676dcb63e8fd33518d5b5461f77720ed8af6e"}
Sep 18 19:39:28.568504 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.568469    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zwqh9"
Sep 18 19:39:28.576381 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.576360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g9ftl"
Sep 18 19:39:28.588237 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.588167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lm2nh"
Sep 18 19:39:28.595338 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.595314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:28.604034 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.604009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m484c"
Sep 18 19:39:28.615161 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.615132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-87grs"
Sep 18 19:39:28.623184 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.623157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:28.631935 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.631913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh"
Sep 18 19:39:28.637748 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.637723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9d9dp"
Sep 18 19:39:28.920577 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.920487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:28.920577 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.920538    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:28.920580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920642    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920676    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920689    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920701    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920706    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:29.920685267 +0000 UTC m=+5.679493249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:28.920779 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920733    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:39:29.920723442 +0000 UTC m=+5.679531407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:28.921253 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920791    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:28.921253 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:28.920821    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:29.920810471 +0000 UTC m=+5.679618440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:29.304255 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.304213    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f381b2f_6aea_4542_8666_6134f831d655.slice/crio-9b1f947c521bb75616967bb92cf19d480f3665733420d81d28192160b8143a9a WatchSource:0}: Error finding container 9b1f947c521bb75616967bb92cf19d480f3665733420d81d28192160b8143a9a: Status 404 returned error can't find the container with id 9b1f947c521bb75616967bb92cf19d480f3665733420d81d28192160b8143a9a
Sep 18 19:39:29.305564 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.305537    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d3152a_6fb2_4b4e_ac5a_24ca554ade3c.slice/crio-678e0b5394651743318ed0fa4ccc1e77c022c1c06ee59657776f0535c015239e WatchSource:0}: Error finding container 678e0b5394651743318ed0fa4ccc1e77c022c1c06ee59657776f0535c015239e: Status 404 returned error can't find the container with id 678e0b5394651743318ed0fa4ccc1e77c022c1c06ee59657776f0535c015239e
Sep 18 19:39:29.307719 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.307579    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1966f9fa_1fde_4951_8929_43462269ce5c.slice/crio-b283cd08381ed97530db258368941c88f5cee0f699fe7f4d4c30a03b1e64a1cb WatchSource:0}: Error finding container b283cd08381ed97530db258368941c88f5cee0f699fe7f4d4c30a03b1e64a1cb: Status 404 returned error can't find the container with id b283cd08381ed97530db258368941c88f5cee0f699fe7f4d4c30a03b1e64a1cb
Sep 18 19:39:29.310579 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.310543    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0b7ad3_b63a_4bca_b203_376da025850a.slice/crio-987a59f4365210e96dde806ab5ec1ba0a5b52208d0dfe77eda753da7414d8833 WatchSource:0}: Error finding container 987a59f4365210e96dde806ab5ec1ba0a5b52208d0dfe77eda753da7414d8833: Status 404 returned error can't find the container with id 987a59f4365210e96dde806ab5ec1ba0a5b52208d0dfe77eda753da7414d8833
Sep 18 19:39:29.313174 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.312646    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2a342b_69fe_4189_913b_5cb34a6c354a.slice/crio-369e701a4ff549c81cf816ef8aabe6b26c334f254f9e0c04512cbbdb47e4f6fc WatchSource:0}: Error finding container 369e701a4ff549c81cf816ef8aabe6b26c334f254f9e0c04512cbbdb47e4f6fc: Status 404 returned error can't find the container with id 369e701a4ff549c81cf816ef8aabe6b26c334f254f9e0c04512cbbdb47e4f6fc
Sep 18 19:39:29.316483 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.314050    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5611f814_7222_4961_8759_3d039e5395eb.slice/crio-dc4eac60be40b6cd4e71bc84c08a1176e0a194f31e10867492c82b94240a7be2 WatchSource:0}: Error finding container dc4eac60be40b6cd4e71bc84c08a1176e0a194f31e10867492c82b94240a7be2: Status 404 returned error can't find the container with id dc4eac60be40b6cd4e71bc84c08a1176e0a194f31e10867492c82b94240a7be2
Sep 18 19:39:29.316483 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:39:29.315098    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda285377b_0634_4f43_8294_520305cbd4e4.slice/crio-4a0bab348626d36e9423537ee3f806f4c91fcc435db71a2441fc65ed04f70da8 WatchSource:0}: Error finding container 4a0bab348626d36e9423537ee3f806f4c91fcc435db71a2441fc65ed04f70da8: Status 404 returned error can't find the container with id 4a0bab348626d36e9423537ee3f806f4c91fcc435db71a2441fc65ed04f70da8
Sep 18 19:39:29.337474 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.337442    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:34:28 +0000 UTC" deadline="2028-04-30 03:28:38.532157611 +0000 UTC"
Sep 18 19:39:29.337474 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.337473    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14143h49m9.19468928s"
Sep 18 19:39:29.434238 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.434205    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:29.434238 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.434233    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:29.434427 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.434324    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:29.434472 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.434448    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:29.446019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.445987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zwqh9" event={"ID":"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6","Type":"ContainerStarted","Data":"4bcff8b616a97a34ca00e801d5ec6c6c848f421a43b5f0b1c4472f9b87aad40f"}
Sep 18 19:39:29.447214 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.447159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g9ftl" event={"ID":"d83e3e6f-6855-4c8f-8d95-1b6e025179be","Type":"ContainerStarted","Data":"8bea48164708bf517a644ee8f6796d22ab81c21673d8078e36272be3f890ed6a"}
Sep 18 19:39:29.449391 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.449366    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"4a0bab348626d36e9423537ee3f806f4c91fcc435db71a2441fc65ed04f70da8"}
Sep 18 19:39:29.450506 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.450486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m484c" event={"ID":"5611f814-7222-4961-8759-3d039e5395eb","Type":"ContainerStarted","Data":"dc4eac60be40b6cd4e71bc84c08a1176e0a194f31e10867492c82b94240a7be2"}
Sep 18 19:39:29.451600 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.451572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gx8r9" event={"ID":"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c","Type":"ContainerStarted","Data":"678e0b5394651743318ed0fa4ccc1e77c022c1c06ee59657776f0535c015239e"}
Sep 18 19:39:29.453706 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.453684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lm2nh" event={"ID":"6f381b2f-6aea-4542-8666-6134f831d655","Type":"ContainerStarted","Data":"9b1f947c521bb75616967bb92cf19d480f3665733420d81d28192160b8143a9a"}
Sep 18 19:39:29.454863 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.454844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9d9dp" event={"ID":"6c2a342b-69fe-4189-913b-5cb34a6c354a","Type":"ContainerStarted","Data":"369e701a4ff549c81cf816ef8aabe6b26c334f254f9e0c04512cbbdb47e4f6fc"}
Sep 18 19:39:29.457330 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.457301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerStarted","Data":"987a59f4365210e96dde806ab5ec1ba0a5b52208d0dfe77eda753da7414d8833"}
Sep 18 19:39:29.458451 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.458432    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh" event={"ID":"1966f9fa-1fde-4951-8929-43462269ce5c","Type":"ContainerStarted","Data":"b283cd08381ed97530db258368941c88f5cee0f699fe7f4d4c30a03b1e64a1cb"}
Sep 18 19:39:29.461755 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.461727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"9e70fcf4e6b756809a2612ebd8cc6497","Type":"ContainerStarted","Data":"889bda4e697ca7f7a1b45d0f82c74defed1270d6c6987188563cc93dbd3c6b61"}
Sep 18 19:39:29.477092 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.477039    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" podStartSLOduration=2.477022421 podStartE2EDuration="2.477022421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:29.476547578 +0000 UTC m=+5.235355559" watchObservedRunningTime="2026-09-18 19:39:29.477022421 +0000 UTC m=+5.235830403"
Sep 18 19:39:29.927962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.927629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:29.928153 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.927970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:29.928153 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:29.928013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:29.928153 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928050    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:29.928153 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928084    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:29.928153 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928098    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:29.928153 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928127    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:29.928476 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928158    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:39:31.92813888 +0000 UTC m=+7.686946848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:29.928476 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928212    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:29.928476 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928248    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:31.928233222 +0000 UTC m=+7.687041192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:29.928476 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:29.928331    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:31.928317271 +0000 UTC m=+7.687125239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:30.338646 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:30.338531    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:34:28 +0000 UTC" deadline="2028-02-29 13:49:32.585120752 +0000 UTC"
Sep 18 19:39:30.338646 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:30.338593    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12690h10m2.246532237s"
Sep 18 19:39:30.437299 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:30.436777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:30.437299 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:30.436937    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:30.474401 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:30.474346    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b1aba493d65d32cf9925e6f47a0671c" containerID="e013553548a55a35a64dc3e1c9edb6cfe766d87d8fd822413b529d9a4596db1e" exitCode=0
Sep 18 19:39:30.475332 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:30.475302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"7b1aba493d65d32cf9925e6f47a0671c","Type":"ContainerDied","Data":"e013553548a55a35a64dc3e1c9edb6cfe766d87d8fd822413b529d9a4596db1e"}
Sep 18 19:39:31.433989 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:31.433950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:31.434457 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.434081    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:31.434457 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:31.434453    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:31.434571 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.434545    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:31.489710 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:31.489675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"7b1aba493d65d32cf9925e6f47a0671c","Type":"ContainerStarted","Data":"7d17f7e226f46152273ef3deadd7c195b7df336dd4bfa00d5ce025f205d4bf0e"}
Sep 18 19:39:31.945271 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:31.945188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:31.945271 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:31.945267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:31.945488 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:31.945306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:31.945488 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.945435    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:31.945602 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.945498    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:35.945479645 +0000 UTC m=+11.704287608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:31.946974 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.945958    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:31.946974 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.945984    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:31.946974 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.945997    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:31.946974 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.946046    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:39:35.9460306 +0000 UTC m=+11.704838569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:31.946974 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.946105    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:31.946974 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:31.946136    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:35.946125794 +0000 UTC m=+11.704933761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:32.434848 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:32.434762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:32.435316 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:32.434938    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:33.433979 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:33.433943    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:33.434155 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:33.434082    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:33.434527 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:33.434500    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:33.434634 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:33.434607    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:34.433838 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:34.433801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:34.434307 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:34.434045    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:35.434806 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:35.434770    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:35.435241 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.434931    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:35.435352 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:35.435330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:35.435477 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.435440    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:35.983831    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:35.983922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:35.983958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984100    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984159    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:43.984140437 +0000 UTC m=+19.742948404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984542    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984560    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984569    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984615    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:39:43.984599599 +0000 UTC m=+19.743407562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984686    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:35.984756 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:35.984720    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:43.98470907 +0000 UTC m=+19.743517038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:36.439774 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:36.439554    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:36.439774 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:36.439677    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:37.435033 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:37.434488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:37.435033 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:37.434491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:37.435033 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:37.434635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:37.435033 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:37.434712    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:38.437567 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:38.437540    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:38.437970 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:38.437656    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:39.434622 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:39.434596    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:39.434831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:39.434605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:39.434831 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:39.434712    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:39.434831 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:39.434794    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:40.437544 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:40.437512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:40.438025 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:40.437644    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:41.434712 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:41.434679    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:41.434712 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:41.434687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:41.434989 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:41.434818    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:41.434989 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:41.434975    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:42.437093 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:42.437062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:42.437471 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:42.437190    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:43.434521 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:43.434478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:43.434521 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:43.434507    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:43.434763 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:43.434604    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:43.434763 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:43.434713    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:44.044815 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:44.044772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:44.044844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:44.044906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.044967    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.044981    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.045002    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.045013    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.045017    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.045038    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.045017585 +0000 UTC m=+35.803825571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.045054    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.045044454 +0000 UTC m=+35.803852418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:44.045292 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.045071    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.045062461 +0000 UTC m=+35.803870423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:44.437107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:44.437037    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:44.437271 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:44.437175    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:45.434851 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:45.434799    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:45.435332 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:45.434995    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:45.435530 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:45.435502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:45.435686 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:45.435663    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:46.434962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:46.434929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:46.435427 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:46.435027    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:47.434827 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.434798    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:47.434963 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.434845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:47.435012 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:47.434961    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:47.435381 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:47.435030    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:47.520679 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.520652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g9ftl" event={"ID":"d83e3e6f-6855-4c8f-8d95-1b6e025179be","Type":"ContainerStarted","Data":"6d8eabbbecf80157bb9e1284ff29d22e1197d0787dae73b10666347c49775138"}
Sep 18 19:39:47.522178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.522156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"adf597d0959111fabdaf2865ea31bcee35589a868534c092b5b9bdacd3b6a1da"}
Sep 18 19:39:47.523532 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.523509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m484c" event={"ID":"5611f814-7222-4961-8759-3d039e5395eb","Type":"ContainerStarted","Data":"0e5a73fab919c57a0ed5c3870016b39e69ff5595df1c5e19212f50981671b0cf"}
Sep 18 19:39:47.524812 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.524792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gx8r9" event={"ID":"d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c","Type":"ContainerStarted","Data":"74a16c46fcb87535bb7f1815002c7ab62da7987d5de94ebcd8e07c6bcd4200b3"}
Sep 18 19:39:47.526179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.526158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lm2nh" event={"ID":"6f381b2f-6aea-4542-8666-6134f831d655","Type":"ContainerStarted","Data":"8b61ceeeb4788e9e5372216d0702bffe10262274edff23ac4a5d24bae95e7e1c"}
Sep 18 19:39:47.527599 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.527576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9d9dp" event={"ID":"6c2a342b-69fe-4189-913b-5cb34a6c354a","Type":"ContainerStarted","Data":"6231378a061bfe0b0103e6b972e84f00c794f8f5dc746f7a8e955d36fa5fc3f3"}
Sep 18 19:39:47.528905 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.528863    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerStarted","Data":"7e2b1d09da3fbb289b7524e4458db70a33c976f0a7e1a180b41686ea4d6b0161"}
Sep 18 19:39:47.530250 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.530234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh" event={"ID":"1966f9fa-1fde-4951-8929-43462269ce5c","Type":"ContainerStarted","Data":"8ea3301b3e034f62e6b07d67f8862ec3171b31f58ad6a85fbb463256055135ed"}
Sep 18 19:39:47.547085 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.547046    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g9ftl" podStartSLOduration=3.872642098 podStartE2EDuration="21.54703283s" totalImagesPullingTime="17.674390732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:47.54647634 +0000 UTC m=+23.305284326" watchObservedRunningTime="2026-09-18 19:39:47.54703283 +0000 UTC m=+23.305840814"
Sep 18 19:39:47.547181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.547139    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" podStartSLOduration=20.547135396 podStartE2EDuration="20.547135396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:31.50593665 +0000 UTC m=+7.264744637" watchObservedRunningTime="2026-09-18 19:39:47.547135396 +0000 UTC m=+23.305943410"
Sep 18 19:39:47.571313 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.571270    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9d9dp" podStartSLOduration=3.6909478460000003 podStartE2EDuration="21.571255244s" totalImagesPullingTime="17.880307398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:47.571081551 +0000 UTC m=+23.329889535" watchObservedRunningTime="2026-09-18 19:39:47.571255244 +0000 UTC m=+23.330063228"
Sep 18 19:39:47.593378 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.593335    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lm2nh" podStartSLOduration=3.654186094 podStartE2EDuration="21.593320406s" totalImagesPullingTime="17.939134312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:47.592291983 +0000 UTC m=+23.351099970" watchObservedRunningTime="2026-09-18 19:39:47.593320406 +0000 UTC m=+23.352128388"
Sep 18 19:39:47.609670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.609624    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m484c" podStartSLOduration=3.755627948 podStartE2EDuration="21.609610449s" totalImagesPullingTime="17.853982501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:47.609195027 +0000 UTC m=+23.368003013" watchObservedRunningTime="2026-09-18 19:39:47.609610449 +0000 UTC m=+23.368418442"
Sep 18 19:39:47.628235 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:47.628189    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gx8r9" podStartSLOduration=8.060465645 podStartE2EDuration="21.628165736s" totalImagesPullingTime="13.567700091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:47.627942606 +0000 UTC m=+23.386750606" watchObservedRunningTime="2026-09-18 19:39:47.628165736 +0000 UTC m=+23.386973722"
Sep 18 19:39:48.434896 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.434657    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:48.435073 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:48.434946    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:48.533856 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.533827    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d0b7ad3-b63a-4bca-b203-376da025850a" containerID="7e2b1d09da3fbb289b7524e4458db70a33c976f0a7e1a180b41686ea4d6b0161" exitCode=0
Sep 18 19:39:48.534091 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.533920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerDied","Data":"7e2b1d09da3fbb289b7524e4458db70a33c976f0a7e1a180b41686ea4d6b0161"}
Sep 18 19:39:48.537952 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.537936    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:39:48.538264 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.538246    2582 generic.go:356] "Generic (PLEG): container finished" podID="a285377b-0634-4f43-8294-520305cbd4e4" containerID="99e1079d9eeee9e2a798ff9bcca6e3752a053f521187373aed370d3f681e5f02" exitCode=1
Sep 18 19:39:48.538358 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.538338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"3ba464535822e6bb8eb832495cc76015f34f1db7cb0ae6f27f50dc017f866bce"}
Sep 18 19:39:48.538474 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.538402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"1469584b4bb8bf5295b3b9317f6d2ad2a30925f89d99c858ec1c93934a24e8a2"}
Sep 18 19:39:48.538474 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.538436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"d2b62ab9f59af061ead5b7f755acf110bc84956e5495c4900eeabda67001ecd3"}
Sep 18 19:39:48.538474 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.538464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"eae84ad1ce48833ec37a0b7812e0ba61d7ad651c8f141c98ec7a46b721fedd6b"}
Sep 18 19:39:48.538602 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.538493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerDied","Data":"99e1079d9eeee9e2a798ff9bcca6e3752a053f521187373aed370d3f681e5f02"}
Sep 18 19:39:48.693910 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.693868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:48.746534 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.746511    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 19:39:48.984467 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.984385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:48.984988 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:48.984970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:49.368031 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.367867    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T19:39:48.746529417Z","UUID":"a0d7179a-c3e1-497c-ab59-5ed478fa3ada","Handler":null,"Name":"","Endpoint":""}
Sep 18 19:39:49.369549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.369531    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 19:39:49.369666 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.369559    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 19:39:49.434770 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.434742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:49.434965 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.434741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:49.434965 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:49.434850    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:49.434965 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:49.434952    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:49.543732 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.543686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zwqh9" event={"ID":"ecb95cfc-3b1d-44b2-b14a-00f1bd409fb6","Type":"ContainerStarted","Data":"a32674a74918815a8ccbfbd9e33f48cecc151a6167bde9a18174d3549f0f5cb3"}
Sep 18 19:39:49.546503 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.546470    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh" event={"ID":"1966f9fa-1fde-4951-8929-43462269ce5c","Type":"ContainerStarted","Data":"0a88d8f629bbff378b2f51adc7ec8b1f248a85374419c61be74b680952d3156c"}
Sep 18 19:39:49.547190 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.547165    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gx8r9"
Sep 18 19:39:49.560079 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:49.559997    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zwqh9" podStartSLOduration=5.908460368 podStartE2EDuration="23.559976624s" totalImagesPullingTime="17.651516256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:49.559255579 +0000 UTC m=+25.318063564" watchObservedRunningTime="2026-09-18 19:39:49.559976624 +0000 UTC m=+25.318784612"
Sep 18 19:39:50.434175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:50.434088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:50.434341 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:50.434229    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:50.551841 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:50.551814    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:39:50.552245 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:50.552222    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"492531fdd98863bc64ca25b4a8bc3b3ebbe9fda3768a1e76c4104a27f5c81bbc"}
Sep 18 19:39:50.554284 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:50.554260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh" event={"ID":"1966f9fa-1fde-4951-8929-43462269ce5c","Type":"ContainerStarted","Data":"165c370a4fca44492443bd13b7bca213b4570edc92a15a89dd33f0a6a5baabce"}
Sep 18 19:39:50.577466 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:50.577424    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6gpkh" podStartSLOduration=4.582146623 podStartE2EDuration="24.577410901s" totalImagesPullingTime="19.995264278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:50.577258864 +0000 UTC m=+26.336066860" watchObservedRunningTime="2026-09-18 19:39:50.577410901 +0000 UTC m=+26.336218882"
Sep 18 19:39:51.434723 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:51.434694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:51.434723 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:51.434731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:51.434931 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:51.434815    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:51.434971 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:51.434954    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:52.434795 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:52.434535    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:52.435205 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:52.434866    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:53.433979 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.433953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:53.433979 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.433967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:53.434129 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:53.434063    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:53.434214 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:53.434196    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:53.562978 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.562901    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d0b7ad3-b63a-4bca-b203-376da025850a" containerID="c3e9b02108fddfe05c3cad6c0d661604c9159e0f931d5268c95a192325288806" exitCode=0
Sep 18 19:39:53.563748 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.562993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerDied","Data":"c3e9b02108fddfe05c3cad6c0d661604c9159e0f931d5268c95a192325288806"}
Sep 18 19:39:53.566422 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.566402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:39:53.566763 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.566743    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"13a4dd6767738268cfda54fa7ab18b0ddbe8d816432352d464c316de8d04a93c"}
Sep 18 19:39:53.567044 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.567030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:53.567113 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.567076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:53.567180 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.567161    2582 scope.go:117] "RemoveContainer" containerID="99e1079d9eeee9e2a798ff9bcca6e3752a053f521187373aed370d3f681e5f02"
Sep 18 19:39:53.582736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:53.582534    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:54.434724 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:54.434689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:54.434868 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:54.434807    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:54.572980 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:54.572956    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:39:54.573407 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:54.573381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" event={"ID":"a285377b-0634-4f43-8294-520305cbd4e4","Type":"ContainerStarted","Data":"298a1bf1669f589bea5cbcb5b4d480711f085d98c50b812a8d4bb8301feb6cf1"}
Sep 18 19:39:54.573627 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:54.573611    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:54.590546 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:54.590522    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:39:54.604271 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:54.604231    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t" podStartSLOduration=10.725372805 podStartE2EDuration="28.604216273s" totalImagesPullingTime="17.878843468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:54.604007973 +0000 UTC m=+30.362815958" watchObservedRunningTime="2026-09-18 19:39:54.604216273 +0000 UTC m=+30.363024258"
Sep 18 19:39:55.000847 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.000753    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-scwmc"]
Sep 18 19:39:55.001045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.000903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:55.001045 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:55.000996    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:55.001533 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.001509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-phct6"]
Sep 18 19:39:55.001607 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.001594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:55.001723 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:55.001703    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:55.002894 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.002857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-52csd"]
Sep 18 19:39:55.002986 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.002977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:55.003511 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:55.003470    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:55.578361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.578326    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d0b7ad3-b63a-4bca-b203-376da025850a" containerID="2c02cf7e33dfe6c0dbeb32d4fd89167c207443479b8df165638f204ff2c82edb" exitCode=0
Sep 18 19:39:55.578782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:55.578399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerDied","Data":"2c02cf7e33dfe6c0dbeb32d4fd89167c207443479b8df165638f204ff2c82edb"}
Sep 18 19:39:56.435403 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:56.435368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:56.435578 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:56.435461    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:56.435578 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:56.435512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:56.435690 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:56.435608    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:57.434375 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:57.434348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:57.434717 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:57.434447    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:39:57.585673 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:57.585640    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d0b7ad3-b63a-4bca-b203-376da025850a" containerID="c0381b7a0f6c6eef149eb1279a1dded1e2cb71755c46da3fbb959889c8029abb" exitCode=0
Sep 18 19:39:57.585834 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:57.585681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerDied","Data":"c0381b7a0f6c6eef149eb1279a1dded1e2cb71755c46da3fbb959889c8029abb"}
Sep 18 19:39:58.434484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:58.434404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:39:58.434855 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:58.434540    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:39:58.434855 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:58.434401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:39:58.434973 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:58.434910    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-scwmc" podUID="1b511cb1-75c5-4cd0-9641-025f1475680e"
Sep 18 19:39:59.434640 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:39:59.434599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:39:59.435041 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:39:59.434716    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52csd" podUID="33c7e111-cd7d-4536-80ab-0d54cacf286a"
Sep 18 19:40:00.061347 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.061309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.061363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.061408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061464    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061486    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061538    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:40:32.06151839 +0000 UTC m=+67.820326366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061536    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:40:00.061569 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061573    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:40:00.061992 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061587    2582 projected.go:196] Error preparing data for projected volume kube-api-access-82txc for pod openshift-network-diagnostics/network-check-target-52csd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:40:00.061992 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061552    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret podName:1b511cb1-75c5-4cd0-9641-025f1475680e nodeName:}" failed. No retries permitted until 2026-09-18 19:40:32.061546282 +0000 UTC m=+67.820354245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret") pod "global-pull-secret-syncer-scwmc" (UID: "1b511cb1-75c5-4cd0-9641-025f1475680e") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:40:00.061992 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.061643    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc podName:33c7e111-cd7d-4536-80ab-0d54cacf286a nodeName:}" failed. No retries permitted until 2026-09-18 19:40:32.061628828 +0000 UTC m=+67.820436797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-82txc" (UniqueName: "kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc") pod "network-check-target-52csd" (UID: "33c7e111-cd7d-4536-80ab-0d54cacf286a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:40:00.170675 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.170640    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeReady"
Sep 18 19:40:00.170901 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.170799    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 19:40:00.227981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.227944    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6wrzq"]
Sep 18 19:40:00.247672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.246574    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wxz8r"]
Sep 18 19:40:00.247672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.246973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.250321 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.250297    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 19:40:00.250442 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.250324    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 19:40:00.250788 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.250768    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v8jjp\""
Sep 18 19:40:00.265072 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.265048    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.265194 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.265050    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6wrzq"]
Sep 18 19:40:00.265271 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.265226    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxz8r"]
Sep 18 19:40:00.267721 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.267699    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 19:40:00.267862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.267807    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 19:40:00.268128 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.267949    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 19:40:00.268128 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.268076    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wfwhm\""
Sep 18 19:40:00.364167 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.364127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-config-volume\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.364357 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.364171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.364357 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.364197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b89a9e2-b45c-42d1-87c3-846db555eacf-cert\") pod \"ingress-canary-wxz8r\" (UID: \"3b89a9e2-b45c-42d1-87c3-846db555eacf\") " pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.364472 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.364342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4lf\" (UniqueName: \"kubernetes.io/projected/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-kube-api-access-lt4lf\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.364472 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.364392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq8lm\" (UniqueName: \"kubernetes.io/projected/3b89a9e2-b45c-42d1-87c3-846db555eacf-kube-api-access-xq8lm\") pod \"ingress-canary-wxz8r\" (UID: \"3b89a9e2-b45c-42d1-87c3-846db555eacf\") " pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.364472 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.364421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-tmp-dir\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.434553 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.434512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:40:00.434756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.434734    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:40:00.437745 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.437723    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9tpx\""
Sep 18 19:40:00.437845 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.437723    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 19:40:00.437845 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.437728    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 19:40:00.464833 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.464796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-config-volume\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.464981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.464848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.464981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.464915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b89a9e2-b45c-42d1-87c3-846db555eacf-cert\") pod \"ingress-canary-wxz8r\" (UID: \"3b89a9e2-b45c-42d1-87c3-846db555eacf\") " pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.464981 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.464972    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:00.465131 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.465055    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.965033636 +0000 UTC m=+36.723841602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:00.465131 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.464977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4lf\" (UniqueName: \"kubernetes.io/projected/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-kube-api-access-lt4lf\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.465131 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.465109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq8lm\" (UniqueName: \"kubernetes.io/projected/3b89a9e2-b45c-42d1-87c3-846db555eacf-kube-api-access-xq8lm\") pod \"ingress-canary-wxz8r\" (UID: \"3b89a9e2-b45c-42d1-87c3-846db555eacf\") " pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.465257 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.465151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-tmp-dir\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.465419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.465400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-tmp-dir\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.465472 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.465456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-config-volume\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.469617 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.469594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b89a9e2-b45c-42d1-87c3-846db555eacf-cert\") pod \"ingress-canary-wxz8r\" (UID: \"3b89a9e2-b45c-42d1-87c3-846db555eacf\") " pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.475454 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.475424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4lf\" (UniqueName: \"kubernetes.io/projected/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-kube-api-access-lt4lf\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.475454 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.475449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq8lm\" (UniqueName: \"kubernetes.io/projected/3b89a9e2-b45c-42d1-87c3-846db555eacf-kube-api-access-xq8lm\") pod \"ingress-canary-wxz8r\" (UID: \"3b89a9e2-b45c-42d1-87c3-846db555eacf\") " pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.574840 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.574763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wxz8r"
Sep 18 19:40:00.968785 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:00.968744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:00.968998 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.968897    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:00.968998 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:00.968966    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:01.968946457 +0000 UTC m=+37.727754432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:01.434308 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:01.434266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:40:01.437743 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:01.437716    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 19:40:01.438214 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:01.437777    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 19:40:01.439079 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:01.439055    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5jrl\""
Sep 18 19:40:01.935101 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:01.934921    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wxz8r"]
Sep 18 19:40:01.938347 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:40:01.938313    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b89a9e2_b45c_42d1_87c3_846db555eacf.slice/crio-89f2f89b1b7766452f30d7d0921bf0741e89b97d7f4fbd78bfdb5ebdef937a23 WatchSource:0}: Error finding container 89f2f89b1b7766452f30d7d0921bf0741e89b97d7f4fbd78bfdb5ebdef937a23: Status 404 returned error can't find the container with id 89f2f89b1b7766452f30d7d0921bf0741e89b97d7f4fbd78bfdb5ebdef937a23
Sep 18 19:40:01.976848 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:01.976811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:01.977028 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:01.976998    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:01.977068 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:01.977058    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:03.977042437 +0000 UTC m=+39.735850400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:02.600666 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:02.600634    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d0b7ad3-b63a-4bca-b203-376da025850a" containerID="aee0aee433453be4c4fbb68857d44ac8798e119fd175a4cc2b2ba13d3051f326" exitCode=0
Sep 18 19:40:02.601270 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:02.600665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerDied","Data":"aee0aee433453be4c4fbb68857d44ac8798e119fd175a4cc2b2ba13d3051f326"}
Sep 18 19:40:02.601776 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:02.601751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxz8r" event={"ID":"3b89a9e2-b45c-42d1-87c3-846db555eacf","Type":"ContainerStarted","Data":"89f2f89b1b7766452f30d7d0921bf0741e89b97d7f4fbd78bfdb5ebdef937a23"}
Sep 18 19:40:03.608586 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:03.608553    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d0b7ad3-b63a-4bca-b203-376da025850a" containerID="94375cf9c786fbf4ae0e3e54ec74ffc8d1727732d2c83e8cab91ebb874896c45" exitCode=0
Sep 18 19:40:03.609077 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:03.608616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerDied","Data":"94375cf9c786fbf4ae0e3e54ec74ffc8d1727732d2c83e8cab91ebb874896c45"}
Sep 18 19:40:03.993371 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:03.993333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:03.993558 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:03.993545    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:03.993612 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:03.993603    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:07.99358671 +0000 UTC m=+43.752394672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:04.614804 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:04.614699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87grs" event={"ID":"5d0b7ad3-b63a-4bca-b203-376da025850a","Type":"ContainerStarted","Data":"d8d37f5ab0a666f57e9eb84ead4d9491aee79e502af4631de3506a5fc5c148a0"}
Sep 18 19:40:04.616280 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:04.616255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wxz8r" event={"ID":"3b89a9e2-b45c-42d1-87c3-846db555eacf","Type":"ContainerStarted","Data":"c47a6e1e9a4081b9eb7b16e97425fbbb6ffb224487cdc64adfeb48983fcc5e41"}
Sep 18 19:40:04.639946 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:04.639859    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-87grs" podStartSLOduration=9.912809304 podStartE2EDuration="38.63983609s" totalImagesPullingTime="28.727026786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:04.637690067 +0000 UTC m=+40.396498053" watchObservedRunningTime="2026-09-18 19:40:04.63983609 +0000 UTC m=+40.398644076"
Sep 18 19:40:04.655854 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:04.655802    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wxz8r" podStartSLOduration=2.126829789 podStartE2EDuration="4.655782442s" totalImagesPullingTime="2.528952653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:04.655521795 +0000 UTC m=+40.414329782" watchObservedRunningTime="2026-09-18 19:40:04.655782442 +0000 UTC m=+40.414590429"
Sep 18 19:40:08.023317 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:08.023119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:08.023742 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:08.023284    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:08.023742 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:08.023415    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:16.02340084 +0000 UTC m=+51.782208802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:16.079149 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:16.079104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:16.079719 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:16.079245    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:16.079719 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:16.079329    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:32.079307716 +0000 UTC m=+67.838115682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:26.591465 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:26.591437    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2d5t"
Sep 18 19:40:32.081318 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.081272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:40:32.081318 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.081322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:40:32.081868 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.081345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:40:32.081868 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.081364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:40:32.081868 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:32.081438    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:32.081868 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:32.081524    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:41:04.081504052 +0000 UTC m=+99.840312035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:32.083981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.083962    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 19:40:32.083981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.083978    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 19:40:32.084079 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.084042    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 19:40:32.092455 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:32.092436    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:40:32.092518 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:40:32.092493    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:41:36.09248048 +0000 UTC m=+131.851288442 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : secret "metrics-daemon-secret" not found
Sep 18 19:40:32.095063 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.095043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 19:40:32.096388 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.096361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b511cb1-75c5-4cd0-9641-025f1475680e-original-pull-secret\") pod \"global-pull-secret-syncer-scwmc\" (UID: \"1b511cb1-75c5-4cd0-9641-025f1475680e\") " pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:40:32.105080 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.105057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82txc\" (UniqueName: \"kubernetes.io/projected/33c7e111-cd7d-4536-80ab-0d54cacf286a-kube-api-access-82txc\") pod \"network-check-target-52csd\" (UID: \"33c7e111-cd7d-4536-80ab-0d54cacf286a\") " pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:40:32.252188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.252154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-scwmc"
Sep 18 19:40:32.348049 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.347974    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5jrl\""
Sep 18 19:40:32.356264 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.356239    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:40:32.522739 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.522711    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-scwmc"]
Sep 18 19:40:32.525785 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:40:32.525759    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b511cb1_75c5_4cd0_9641_025f1475680e.slice/crio-105c5aaad6235d3d593b78550169bcd5515aa59c7ed770d44058182ef79afb99 WatchSource:0}: Error finding container 105c5aaad6235d3d593b78550169bcd5515aa59c7ed770d44058182ef79afb99: Status 404 returned error can't find the container with id 105c5aaad6235d3d593b78550169bcd5515aa59c7ed770d44058182ef79afb99
Sep 18 19:40:32.620702 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.620627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-52csd"]
Sep 18 19:40:32.623569 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:40:32.623545    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c7e111_cd7d_4536_80ab_0d54cacf286a.slice/crio-a577b0d065db639037e9e85361de816b1f89a03bf205788bf8011b3ac825ee4f WatchSource:0}: Error finding container a577b0d065db639037e9e85361de816b1f89a03bf205788bf8011b3ac825ee4f: Status 404 returned error can't find the container with id a577b0d065db639037e9e85361de816b1f89a03bf205788bf8011b3ac825ee4f
Sep 18 19:40:32.682756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.682720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-52csd" event={"ID":"33c7e111-cd7d-4536-80ab-0d54cacf286a","Type":"ContainerStarted","Data":"a577b0d065db639037e9e85361de816b1f89a03bf205788bf8011b3ac825ee4f"}
Sep 18 19:40:32.683890 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:32.683849    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-scwmc" event={"ID":"1b511cb1-75c5-4cd0-9641-025f1475680e","Type":"ContainerStarted","Data":"105c5aaad6235d3d593b78550169bcd5515aa59c7ed770d44058182ef79afb99"}
Sep 18 19:40:37.699289 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:37.699244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-52csd" event={"ID":"33c7e111-cd7d-4536-80ab-0d54cacf286a","Type":"ContainerStarted","Data":"583df6779624d44bc509d3f54b6ba1fdfe01ade10e43ca9d605d0edef06ea5e2"}
Sep 18 19:40:37.699756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:37.699313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:40:37.700685 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:37.700664    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-scwmc" event={"ID":"1b511cb1-75c5-4cd0-9641-025f1475680e","Type":"ContainerStarted","Data":"8062be3ff7911fb2d5027f4499fdf8e86940b8082662b9c06112c9765b326f19"}
Sep 18 19:40:37.715312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:37.715265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-52csd" podStartSLOduration=67.388323543 podStartE2EDuration="1m11.71525206s" totalImagesPullingTime="4.326928517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:37.714868393 +0000 UTC m=+73.473676399" watchObservedRunningTime="2026-09-18 19:40:37.71525206 +0000 UTC m=+73.474060037"
Sep 18 19:40:37.728501 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:37.728454    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-scwmc" podStartSLOduration=67.300383147 podStartE2EDuration="1m11.72843982s" totalImagesPullingTime="4.428056673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:37.727897122 +0000 UTC m=+73.486705106" watchObservedRunningTime="2026-09-18 19:40:37.72843982 +0000 UTC m=+73.487247805"
Sep 18 19:40:41.954067 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.954037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"]
Sep 18 19:40:41.955944 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.955929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:41.958378 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.958358    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 18 19:40:41.959675 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.959653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 19:40:41.959801 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.959691    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 19:40:41.959801 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.959686    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 18 19:40:41.959801 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.959752    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 19:40:41.959801 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.959765    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 18 19:40:41.959801 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.959693    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 18 19:40:41.970705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:41.970685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"]
Sep 18 19:40:42.045266 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.045226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-hub\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.045447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.045285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.045447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.045313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.045447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.045331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.045447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.045364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-ca\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.045447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.045380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtkc\" (UniqueName: \"kubernetes.io/projected/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-kube-api-access-6gtkc\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.146672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.146639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-hub\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.146839 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.146676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.146839 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.146697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.146839 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.146714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.147033 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.146838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-ca\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.147033 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.146897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtkc\" (UniqueName: \"kubernetes.io/projected/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-kube-api-access-6gtkc\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.147715 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.147689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.149350 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.149322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-ca\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.149434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.149357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-hub\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.149544 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.149522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.149625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.149613    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.154865 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.154831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtkc\" (UniqueName: \"kubernetes.io/projected/58476e3c-9e0c-42a3-a0ad-452aa5c07a57-kube-api-access-6gtkc\") pod \"cluster-proxy-proxy-agent-6898c56996-5h5tl\" (UID: \"58476e3c-9e0c-42a3-a0ad-452aa5c07a57\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.278366 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.278277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:40:42.550283 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.550203    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"]
Sep 18 19:40:42.553823 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:40:42.553799    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58476e3c_9e0c_42a3_a0ad_452aa5c07a57.slice/crio-f4a3ec25013354b0a3ac1a2d482d19dbf72a5b45b6c0680c0bdfd921eff34541 WatchSource:0}: Error finding container f4a3ec25013354b0a3ac1a2d482d19dbf72a5b45b6c0680c0bdfd921eff34541: Status 404 returned error can't find the container with id f4a3ec25013354b0a3ac1a2d482d19dbf72a5b45b6c0680c0bdfd921eff34541
Sep 18 19:40:42.713603 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:42.713565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" event={"ID":"58476e3c-9e0c-42a3-a0ad-452aa5c07a57","Type":"ContainerStarted","Data":"f4a3ec25013354b0a3ac1a2d482d19dbf72a5b45b6c0680c0bdfd921eff34541"}
Sep 18 19:40:46.726587 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:46.726550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" event={"ID":"58476e3c-9e0c-42a3-a0ad-452aa5c07a57","Type":"ContainerStarted","Data":"5b24dec944471a049d4c4aba75f69c7b84c7cd0f9317e52428197b80e99479d2"}
Sep 18 19:40:46.726961 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:46.726599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" event={"ID":"58476e3c-9e0c-42a3-a0ad-452aa5c07a57","Type":"ContainerStarted","Data":"1cfb839f819c6a8018370ffa0e98f77155681670dc41c7d83eba146503f8e29a"}
Sep 18 19:40:46.726961 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:46.726620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" event={"ID":"58476e3c-9e0c-42a3-a0ad-452aa5c07a57","Type":"ContainerStarted","Data":"508d7d67b8c6feb182ee1b2b0d7254169b4f48d2709ca61a81b92698a702af5c"}
Sep 18 19:40:46.745182 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:40:46.745144    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" podStartSLOduration=2.360451392 podStartE2EDuration="5.745132008s" totalImagesPullingTime="3.384680616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:46.744463495 +0000 UTC m=+82.503271480" watchObservedRunningTime="2026-09-18 19:40:46.745132008 +0000 UTC m=+82.503939992"
Sep 18 19:41:04.097782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:41:04.097741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:41:04.098311 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:41:04.097860    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:41:04.098311 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:41:04.097942    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:42:08.097928091 +0000 UTC m=+163.856736054 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:41:08.706216 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:41:08.706186    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-52csd"
Sep 18 19:41:36.118034 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:41:36.118000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:41:36.118474 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:41:36.118146    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:41:36.118474 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:41:36.118219    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:43:38.118202515 +0000 UTC m=+253.877010482 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : secret "metrics-daemon-secret" not found
Sep 18 19:42:03.258825 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:42:03.258774    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6wrzq" podUID="a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865"
Sep 18 19:42:03.446156 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:42:03.446122    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:42:03.937570 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:42:03.937542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:42:08.132925 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:42:08.132816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:42:08.133297 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:42:08.132951    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:42:08.133297 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:42:08.133013    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls podName:a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:10.133000167 +0000 UTC m=+285.891808130 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls") pod "dns-default-6wrzq" (UID: "a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865") : secret "dns-default-metrics-tls" not found
Sep 18 19:42:14.434409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:42:14.434379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:43:38.134736 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:38.134643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:43:38.135233 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:38.134754    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:43:38.135233 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:38.134818    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs podName:3eff98a8-abd8-4a4b-ac46-619476ad445d nodeName:}" failed. No retries permitted until 2026-09-18 19:45:40.134803295 +0000 UTC m=+375.893611257 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs") pod "network-metrics-daemon-phct6" (UID: "3eff98a8-abd8-4a4b-ac46-619476ad445d") : secret "metrics-daemon-secret" not found
Sep 18 19:43:47.454895 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.454841    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8kqw5"]
Sep 18 19:43:47.456806 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.456789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.462495 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.462470    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:43:47.463119 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.463096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 18 19:43:47.463216 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.463120    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 18 19:43:47.463539 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.463523    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 18 19:43:47.463912 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.463899    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bgjzx\""
Sep 18 19:43:47.470132 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.470108    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 18 19:43:47.474976 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.474955    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8kqw5"]
Sep 18 19:43:47.595507 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.595471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snpdf\" (UniqueName: \"kubernetes.io/projected/c4aca0af-2a65-4dfb-ad7e-2108a454584d-kube-api-access-snpdf\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.595674 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.595526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4aca0af-2a65-4dfb-ad7e-2108a454584d-trusted-ca\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.595674 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.595587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4aca0af-2a65-4dfb-ad7e-2108a454584d-serving-cert\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.595769 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.595684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4aca0af-2a65-4dfb-ad7e-2108a454584d-config\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.696563 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.696537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4aca0af-2a65-4dfb-ad7e-2108a454584d-config\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.696711 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.696580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snpdf\" (UniqueName: \"kubernetes.io/projected/c4aca0af-2a65-4dfb-ad7e-2108a454584d-kube-api-access-snpdf\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.696778 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.696704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4aca0af-2a65-4dfb-ad7e-2108a454584d-trusted-ca\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.696778 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.696735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4aca0af-2a65-4dfb-ad7e-2108a454584d-serving-cert\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.697246 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.697225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4aca0af-2a65-4dfb-ad7e-2108a454584d-config\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.697423 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.697379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4aca0af-2a65-4dfb-ad7e-2108a454584d-trusted-ca\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.699215 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.699189    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4aca0af-2a65-4dfb-ad7e-2108a454584d-serving-cert\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.704831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.704808    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snpdf\" (UniqueName: \"kubernetes.io/projected/c4aca0af-2a65-4dfb-ad7e-2108a454584d-kube-api-access-snpdf\") pod \"console-operator-fd4bb46c-8kqw5\" (UID: \"c4aca0af-2a65-4dfb-ad7e-2108a454584d\") " pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:47.765046 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:47.764960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:48.030748 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:48.030680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-8kqw5"]
Sep 18 19:43:48.033754 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:43:48.033722    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4aca0af_2a65_4dfb_ad7e_2108a454584d.slice/crio-36161b21fd88b3d3fe2483170fba0df830eb7bdb042bdfc4ef646f7207de8b45 WatchSource:0}: Error finding container 36161b21fd88b3d3fe2483170fba0df830eb7bdb042bdfc4ef646f7207de8b45: Status 404 returned error can't find the container with id 36161b21fd88b3d3fe2483170fba0df830eb7bdb042bdfc4ef646f7207de8b45
Sep 18 19:43:48.225200 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:48.225160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" event={"ID":"c4aca0af-2a65-4dfb-ad7e-2108a454584d","Type":"ContainerStarted","Data":"36161b21fd88b3d3fe2483170fba0df830eb7bdb042bdfc4ef646f7207de8b45"}
Sep 18 19:43:50.232551 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:50.232518    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/0.log"
Sep 18 19:43:50.232949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:50.232560    2582 generic.go:356] "Generic (PLEG): container finished" podID="c4aca0af-2a65-4dfb-ad7e-2108a454584d" containerID="dfdeb176073648f0c416bc698d8aedc585a682d7f21dcce72689dc2523f45826" exitCode=255
Sep 18 19:43:50.232949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:50.232648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" event={"ID":"c4aca0af-2a65-4dfb-ad7e-2108a454584d","Type":"ContainerDied","Data":"dfdeb176073648f0c416bc698d8aedc585a682d7f21dcce72689dc2523f45826"}
Sep 18 19:43:50.232949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:50.232788    2582 scope.go:117] "RemoveContainer" containerID="dfdeb176073648f0c416bc698d8aedc585a682d7f21dcce72689dc2523f45826"
Sep 18 19:43:51.240604 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.240579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:43:51.241070 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.241052    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/0.log"
Sep 18 19:43:51.241149 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.241094    2582 generic.go:356] "Generic (PLEG): container finished" podID="c4aca0af-2a65-4dfb-ad7e-2108a454584d" containerID="5f7630c786237e622ad181351316d0e06b960be373e2ba432a50b6cf01563f14" exitCode=255
Sep 18 19:43:51.241202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.241152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" event={"ID":"c4aca0af-2a65-4dfb-ad7e-2108a454584d","Type":"ContainerDied","Data":"5f7630c786237e622ad181351316d0e06b960be373e2ba432a50b6cf01563f14"}
Sep 18 19:43:51.241265 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.241252    2582 scope.go:117] "RemoveContainer" containerID="dfdeb176073648f0c416bc698d8aedc585a682d7f21dcce72689dc2523f45826"
Sep 18 19:43:51.241423 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.241407    2582 scope.go:117] "RemoveContainer" containerID="5f7630c786237e622ad181351316d0e06b960be373e2ba432a50b6cf01563f14"
Sep 18 19:43:51.241607 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:51.241583    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8kqw5_openshift-console-operator(c4aca0af-2a65-4dfb-ad7e-2108a454584d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" podUID="c4aca0af-2a65-4dfb-ad7e-2108a454584d"
Sep 18 19:43:51.818819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.818787    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vvf4g"]
Sep 18 19:43:51.823070 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.823055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:51.825971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.825952    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 19:43:51.826085 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.826019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 19:43:51.826201 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.826188    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ldqld\""
Sep 18 19:43:51.827152 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.827136    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 19:43:51.827257 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.827235    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 19:43:51.836795 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.836772    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvf4g"]
Sep 18 19:43:51.928527 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.928496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d09adcf3-af95-4b4b-a109-751b85ce9801-data-volume\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:51.928716 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.928554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:51.928716 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.928614    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:51.928716 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.928637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d09adcf3-af95-4b4b-a109-751b85ce9801-crio-socket\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:51.928716 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:51.928664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xdds\" (UniqueName: \"kubernetes.io/projected/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-api-access-8xdds\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029714 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.029680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029714 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.029714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d09adcf3-af95-4b4b-a109-751b85ce9801-crio-socket\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.029733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xdds\" (UniqueName: \"kubernetes.io/projected/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-api-access-8xdds\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.029756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d09adcf3-af95-4b4b-a109-751b85ce9801-data-volume\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.029802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.029830    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.029926    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.029829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d09adcf3-af95-4b4b-a109-751b85ce9801-crio-socket\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.029971 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.029964    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:52.529942036 +0000 UTC m=+268.288750018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:52.030186 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.029991    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:52.529974319 +0000 UTC m=+268.288782304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:52.030186 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.030118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d09adcf3-af95-4b4b-a109-751b85ce9801-data-volume\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.040665 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.040645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xdds\" (UniqueName: \"kubernetes.io/projected/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-api-access-8xdds\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.245178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.245150    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:43:52.245543 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.245450    2582 scope.go:117] "RemoveContainer" containerID="5f7630c786237e622ad181351316d0e06b960be373e2ba432a50b6cf01563f14"
Sep 18 19:43:52.245607 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.245584    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8kqw5_openshift-console-operator(c4aca0af-2a65-4dfb-ad7e-2108a454584d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" podUID="c4aca0af-2a65-4dfb-ad7e-2108a454584d"
Sep 18 19:43:52.534320 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.534230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.534474 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:52.534319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:52.534474 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.534341    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:52.534474 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.534387    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:53.534374312 +0000 UTC m=+269.293182275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:52.534474 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.534396    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:52.534474 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:52.534452    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:53.534437836 +0000 UTC m=+269.293245822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:53.542920 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:53.542850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:53.543309 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:53.542960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:53.543309 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:53.543002    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:53.543309 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:53.543061    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:53.543309 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:53.543067    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.543049984 +0000 UTC m=+271.301857948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:53.543309 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:53.543101    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.54308936 +0000 UTC m=+271.301897323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:54.555739 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:54.555714    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g9ftl_d83e3e6f-6855-4c8f-8d95-1b6e025179be/dns-node-resolver/0.log"
Sep 18 19:43:55.554821 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:55.554795    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m484c_5611f814-7222-4961-8759-3d039e5395eb/node-ca/0.log"
Sep 18 19:43:55.556058 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:55.556039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:55.556389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:55.556098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:55.556389 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:55.556182    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:55.556389 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:55.556257    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:55.556389 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:55.556260    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:59.556242854 +0000 UTC m=+275.315050818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:55.556389 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:55.556335    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:59.556317823 +0000 UTC m=+275.315125790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:56.556081 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:56.556053    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxz8r_3b89a9e2-b45c-42d1-87c3-846db555eacf/serve-healthcheck-canary/0.log"
Sep 18 19:43:57.765684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:57.765647    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:57.766188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:57.765746    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:43:57.766188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:57.766175    2582 scope.go:117] "RemoveContainer" containerID="5f7630c786237e622ad181351316d0e06b960be373e2ba432a50b6cf01563f14"
Sep 18 19:43:57.766379 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:57.766356    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-8kqw5_openshift-console-operator(c4aca0af-2a65-4dfb-ad7e-2108a454584d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" podUID="c4aca0af-2a65-4dfb-ad7e-2108a454584d"
Sep 18 19:43:59.588745 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:59.588708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:59.589172 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:43:59.588788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:43:59.589172 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:59.588819    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:59.589172 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:59.588897    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:07.588863153 +0000 UTC m=+283.347671119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:59.589172 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:59.588908    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:59.589172 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:43:59.588951    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls podName:d09adcf3-af95-4b4b-a109-751b85ce9801 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:07.588940276 +0000 UTC m=+283.347748257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvf4g" (UID: "d09adcf3-af95-4b4b-a109-751b85ce9801") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:44:06.938661 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:44:06.938616    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6wrzq" podUID="a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865"
Sep 18 19:44:07.290629 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:07.290555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:44:07.647278 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:07.647193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:44:07.647278 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:07.647245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:44:07.647824 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:07.647799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d09adcf3-af95-4b4b-a109-751b85ce9801-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:44:07.649676 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:07.649661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d09adcf3-af95-4b4b-a109-751b85ce9801-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvf4g\" (UID: \"d09adcf3-af95-4b4b-a109-751b85ce9801\") " pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:44:07.732337 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:07.732314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvf4g"
Sep 18 19:44:08.000220 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:08.000191    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvf4g"]
Sep 18 19:44:08.003617 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:08.003595    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09adcf3_af95_4b4b_a109_751b85ce9801.slice/crio-acb7cfd3e9dcd8e3799d4f2d2f55a51a2496645c078e47cecbbef9c8d90b6820 WatchSource:0}: Error finding container acb7cfd3e9dcd8e3799d4f2d2f55a51a2496645c078e47cecbbef9c8d90b6820: Status 404 returned error can't find the container with id acb7cfd3e9dcd8e3799d4f2d2f55a51a2496645c078e47cecbbef9c8d90b6820
Sep 18 19:44:08.294663 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:08.294584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvf4g" event={"ID":"d09adcf3-af95-4b4b-a109-751b85ce9801","Type":"ContainerStarted","Data":"2309ce836d6a0aa619717af9a75b4106a0a0308d57c92b013c01d78a0fa71444"}
Sep 18 19:44:08.294663 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:08.294639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvf4g" event={"ID":"d09adcf3-af95-4b4b-a109-751b85ce9801","Type":"ContainerStarted","Data":"acb7cfd3e9dcd8e3799d4f2d2f55a51a2496645c078e47cecbbef9c8d90b6820"}
Sep 18 19:44:09.300504 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:09.300467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvf4g" event={"ID":"d09adcf3-af95-4b4b-a109-751b85ce9801","Type":"ContainerStarted","Data":"9819a621ad9c0ea61c2c1fe9410cab37ddbc49efb0278f9181616e2181cd839d"}
Sep 18 19:44:10.165747 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.165712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:44:10.169668 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.168913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865-metrics-tls\") pod \"dns-default-6wrzq\" (UID: \"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865\") " pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:44:10.293722 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.293693    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v8jjp\""
Sep 18 19:44:10.301315 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.301294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:44:10.305771 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.305744    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvf4g" event={"ID":"d09adcf3-af95-4b4b-a109-751b85ce9801","Type":"ContainerStarted","Data":"190146a8f5abf858736dc1439d0a0f247ae5db9a86fc29771d76ea3b3326a849"}
Sep 18 19:44:10.324971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.324919    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vvf4g" podStartSLOduration=17.332157577 podStartE2EDuration="19.324897668s" totalImagesPullingTime="1.992740091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:43:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:10.323123569 +0000 UTC m=+286.081931557" watchObservedRunningTime="2026-09-18 19:44:10.324897668 +0000 UTC m=+286.083705845"
Sep 18 19:44:10.568789 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:10.568744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6wrzq"]
Sep 18 19:44:10.571487 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:10.571459    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bb4fc3_34e1_4aef_8c96_2d4f6e8c6865.slice/crio-05dbfa535f002ef1c3861007e97bd17239b96261e7c2868bc29f4ec62b370bcb WatchSource:0}: Error finding container 05dbfa535f002ef1c3861007e97bd17239b96261e7c2868bc29f4ec62b370bcb: Status 404 returned error can't find the container with id 05dbfa535f002ef1c3861007e97bd17239b96261e7c2868bc29f4ec62b370bcb
Sep 18 19:44:11.310752 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:11.310713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wrzq" event={"ID":"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865","Type":"ContainerStarted","Data":"05dbfa535f002ef1c3861007e97bd17239b96261e7c2868bc29f4ec62b370bcb"}
Sep 18 19:44:12.315655 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:12.315571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wrzq" event={"ID":"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865","Type":"ContainerStarted","Data":"82b30f530300b4945c57b6d4220315bc39d3fe15d85ccbb6c878e9ee44cf20bc"}
Sep 18 19:44:12.315655 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:12.315618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wrzq" event={"ID":"a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865","Type":"ContainerStarted","Data":"50a17d1e3fcf5e6fd80efd87afd385df9a76b63fa67b60cbbd9b2d82a6b9e76b"}
Sep 18 19:44:12.316091 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:12.315709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:44:12.334354 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:12.334300    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6wrzq" podStartSLOduration=250.983446708 podStartE2EDuration="4m12.334285355s" totalImagesPullingTime="1.350838647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:12.332862862 +0000 UTC m=+288.091670862" watchObservedRunningTime="2026-09-18 19:44:12.334285355 +0000 UTC m=+288.093093337"
Sep 18 19:44:12.434390 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:12.434352    2582 scope.go:117] "RemoveContainer" containerID="5f7630c786237e622ad181351316d0e06b960be373e2ba432a50b6cf01563f14"
Sep 18 19:44:13.320920 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:13.320872    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:44:13.321288 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:13.321012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" event={"ID":"c4aca0af-2a65-4dfb-ad7e-2108a454584d","Type":"ContainerStarted","Data":"e0d2223880f9ba8ae0ebc6e2a0de69e4d844c9c3d27309d6c004f0c7455e1f50"}
Sep 18 19:44:13.321463 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:13.321443    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:44:13.338806 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:13.338761    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5" podStartSLOduration=24.589918182 podStartE2EDuration="26.338748001s" totalImagesPullingTime="1.748829819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:13.337752769 +0000 UTC m=+289.096560758" watchObservedRunningTime="2026-09-18 19:44:13.338748001 +0000 UTC m=+289.097555986"
Sep 18 19:44:13.694764 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:13.694740    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-8kqw5"
Sep 18 19:44:14.936090 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.936059    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6958b47ccf-sjp2r"]
Sep 18 19:44:14.938113 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.938095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.941849 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.941828    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 19:44:14.941967 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.941866    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b9rnh\""
Sep 18 19:44:14.942981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.942955    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 19:44:14.946920 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.943411    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 19:44:14.950767 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.950750    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 19:44:14.957176 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.957157    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6958b47ccf-sjp2r"]
Sep 18 19:44:14.998788 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-image-registry-private-configuration\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.998922 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-registry-certificates\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.998922 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-trusted-ca\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.999006 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-bound-sa-token\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.999006 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-ca-trust-extracted\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.999006 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-registry-tls\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.999006 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.998994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-installation-pull-secrets\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:14.999136 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:14.999047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9z8\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-kube-api-access-jr9z8\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099690 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-trusted-ca\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-bound-sa-token\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-ca-trust-extracted\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-registry-tls\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-installation-pull-secrets\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9z8\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-kube-api-access-jr9z8\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-image-registry-private-configuration\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.099832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.099833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-registry-certificates\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.100298 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.100266    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-ca-trust-extracted\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.100635 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.100617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-registry-certificates\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.100900 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.100811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-trusted-ca\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.102553 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.102529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-image-registry-private-configuration\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.102844 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.102829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-registry-tls\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.102961 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.102848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-installation-pull-secrets\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.111362 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.111336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-bound-sa-token\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.111492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.111474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9z8\" (UniqueName: \"kubernetes.io/projected/3af77a49-175b-4dfe-ac2d-1fb2d32c3655-kube-api-access-jr9z8\") pod \"image-registry-6958b47ccf-sjp2r\" (UID: \"3af77a49-175b-4dfe-ac2d-1fb2d32c3655\") " pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.249218 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.249154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:15.524171 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:15.524057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6958b47ccf-sjp2r"]
Sep 18 19:44:15.528071 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:15.528040    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af77a49_175b_4dfe_ac2d_1fb2d32c3655.slice/crio-94499d514fdb0e2be0982512be98d7d0131b8b02d29580cec7fade8ad54860ee WatchSource:0}: Error finding container 94499d514fdb0e2be0982512be98d7d0131b8b02d29580cec7fade8ad54860ee: Status 404 returned error can't find the container with id 94499d514fdb0e2be0982512be98d7d0131b8b02d29580cec7fade8ad54860ee
Sep 18 19:44:16.333853 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:16.333800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r" event={"ID":"3af77a49-175b-4dfe-ac2d-1fb2d32c3655","Type":"ContainerStarted","Data":"bfe0f5b26f5a330548da549300cf71f7158ca058de04f0964891a29a28416620"}
Sep 18 19:44:16.334232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:16.333892    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r" event={"ID":"3af77a49-175b-4dfe-ac2d-1fb2d32c3655","Type":"ContainerStarted","Data":"94499d514fdb0e2be0982512be98d7d0131b8b02d29580cec7fade8ad54860ee"}
Sep 18 19:44:16.334232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:16.333944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:16.357406 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:16.357364    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r" podStartSLOduration=2.357351927 podStartE2EDuration="2.357351927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:16.356022178 +0000 UTC m=+292.114830164" watchObservedRunningTime="2026-09-18 19:44:16.357351927 +0000 UTC m=+292.116159926"
Sep 18 19:44:17.434995 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:44:17.434960    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-phct6" podUID="3eff98a8-abd8-4a4b-ac46-619476ad445d"
Sep 18 19:44:22.323697 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:22.323666    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6wrzq"
Sep 18 19:44:24.040766 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.040734    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pwws5"]
Sep 18 19:44:24.045640 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.045618    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.048285 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.048260    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 19:44:24.048434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.048351    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 19:44:24.048434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.048406    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 19:44:24.049535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.049510    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 19:44:24.049668 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.049518    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 19:44:24.049668 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.049519    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wzv5\""
Sep 18 19:44:24.049668 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.049519    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 19:44:24.056517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-sys\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056623 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-root\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056623 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056623 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1755dba-f099-4830-a1af-c682ecf4931f-metrics-client-ca\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056776 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvv5t\" (UniqueName: \"kubernetes.io/projected/f1755dba-f099-4830-a1af-c682ecf4931f-kube-api-access-zvv5t\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056776 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-textfile\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056776 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056776 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-wtmp\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.056956 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.056794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-tls\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.157857 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-tls\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-sys\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-root\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1755dba-f099-4830-a1af-c682ecf4931f-metrics-client-ca\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-sys\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvv5t\" (UniqueName: \"kubernetes.io/projected/f1755dba-f099-4830-a1af-c682ecf4931f-kube-api-access-zvv5t\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:44:24.157998    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-textfile\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158076 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:44:24.158075    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-tls podName:f1755dba-f099-4830-a1af-c682ecf4931f nodeName:}" failed. No retries permitted until 2026-09-18 19:44:24.658054275 +0000 UTC m=+300.416862254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-tls") pod "node-exporter-pwws5" (UID: "f1755dba-f099-4830-a1af-c682ecf4931f") : secret "node-exporter-tls" not found
Sep 18 19:44:24.158510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.157975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-root\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-wtmp\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-wtmp\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-textfile\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158636 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.158636 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.158569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1755dba-f099-4830-a1af-c682ecf4931f-metrics-client-ca\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.160481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.160464    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.166358 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.166339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvv5t\" (UniqueName: \"kubernetes.io/projected/f1755dba-f099-4830-a1af-c682ecf4931f-kube-api-access-zvv5t\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.662692 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.662654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-tls\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.665253 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.665225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1755dba-f099-4830-a1af-c682ecf4931f-node-exporter-tls\") pod \"node-exporter-pwws5\" (UID: \"f1755dba-f099-4830-a1af-c682ecf4931f\") " pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.786349 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.786307    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d968bc48-sqb8l"]
Sep 18 19:44:24.791278 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.791251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.793705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.793680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 19:44:24.793911 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.793760    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 19:44:24.793911 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.793770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbqz6\""
Sep 18 19:44:24.793911 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.793849    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 19:44:24.794906 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.794867    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 19:44:24.795024 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.794865    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 19:44:24.795024 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.794888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 19:44:24.795024 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.794888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 19:44:24.800098 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.800074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d968bc48-sqb8l"]
Sep 18 19:44:24.864141 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.864107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-oauth-serving-cert\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.864141 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.864144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-serving-cert\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.864368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.864169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-service-ca\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.864368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.864198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-console-config\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.864368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.864249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-oauth-config\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.864368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.864304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zhgf\" (UniqueName: \"kubernetes.io/projected/b91b2eea-333a-4932-9d32-0d672368be1c-kube-api-access-9zhgf\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.954717 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.954680    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwws5"
Sep 18 19:44:24.964987 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.964951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-oauth-serving-cert\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.964987 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.964990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-serving-cert\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.965181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.965015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-service-ca\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.965181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.965045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-console-config\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.965181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.965112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-oauth-config\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.965334 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.965181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zhgf\" (UniqueName: \"kubernetes.io/projected/b91b2eea-333a-4932-9d32-0d672368be1c-kube-api-access-9zhgf\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.965592 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:24.965552    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1755dba_f099_4830_a1af_c682ecf4931f.slice/crio-e8222e743b05fa766b1c87540923963362a3a44fc32c0fcda51fb49eb9983fe2 WatchSource:0}: Error finding container e8222e743b05fa766b1c87540923963362a3a44fc32c0fcda51fb49eb9983fe2: Status 404 returned error can't find the container with id e8222e743b05fa766b1c87540923963362a3a44fc32c0fcda51fb49eb9983fe2
Sep 18 19:44:24.965947 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.965926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-oauth-serving-cert\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.966306 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.966282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-service-ca\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.966571 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.966549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-console-config\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.967960 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.967942    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-serving-cert\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.968115 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.968094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-oauth-config\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:24.982991 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:24.982967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zhgf\" (UniqueName: \"kubernetes.io/projected/b91b2eea-333a-4932-9d32-0d672368be1c-kube-api-access-9zhgf\") pod \"console-69d968bc48-sqb8l\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") " pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:25.101626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.101584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:25.115232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.115206    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:44:25.118954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.118931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.121471 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 19:44:25.121567 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121457    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 19:44:25.121655 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121638    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 19:44:25.121655 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 19:44:25.121755 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121659    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-69jt8\""
Sep 18 19:44:25.121755 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 19:44:25.121850 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.121638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 19:44:25.122049 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.122035    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 19:44:25.122049 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.122045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 19:44:25.122166 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.122037    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 19:44:25.135915 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.135870    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv885\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-kube-api-access-qv885\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-out\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-web-config\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.166661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.166605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-web-config\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267613 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267613 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.267613 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.267301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.268340 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.268318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.268912 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.268862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv885\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-kube-api-access-qv885\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.269178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.268929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.269178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.268959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-out\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.269178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.269052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.269178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.269089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.269514 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:44:25.269488    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle podName:8f015a90-7d5a-4f57-955b-ec0e68a173e8 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:25.769466155 +0000 UTC m=+301.528274137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8") : configmap references non-existent config key: ca-bundle.crt
Sep 18 19:44:25.270065 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.270039    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.270570 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.270543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-web-config\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.270824 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.270802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.270990 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.270966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.271082 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.271063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.271305 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.271276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.271524 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.271496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.272374 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.272351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.272490 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.272474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-out\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.273115 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.273101    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.282034 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.282011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv885\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-kube-api-access-qv885\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.363310 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.363272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwws5" event={"ID":"f1755dba-f099-4830-a1af-c682ecf4931f","Type":"ContainerStarted","Data":"e8222e743b05fa766b1c87540923963362a3a44fc32c0fcda51fb49eb9983fe2"}
Sep 18 19:44:25.384222 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.384193    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d968bc48-sqb8l"]
Sep 18 19:44:25.387052 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:25.387021    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91b2eea_333a_4932_9d32_0d672368be1c.slice/crio-ff642486082a5d384801beac577acdcabb4b958f40737f5deb33119cc19be7c5 WatchSource:0}: Error finding container ff642486082a5d384801beac577acdcabb4b958f40737f5deb33119cc19be7c5: Status 404 returned error can't find the container with id ff642486082a5d384801beac577acdcabb4b958f40737f5deb33119cc19be7c5
Sep 18 19:44:25.774494 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.774445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:25.775517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:25.775490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:26.030490 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.030221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:44:26.311305 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.311132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:44:26.330629 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.330539    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:44:26.337526 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.337498    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:44:26.341993 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.341916    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:44:26.348764 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.348742    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 19:44:26.371543 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.371306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d968bc48-sqb8l" event={"ID":"b91b2eea-333a-4932-9d32-0d672368be1c","Type":"ContainerStarted","Data":"ff642486082a5d384801beac577acdcabb4b958f40737f5deb33119cc19be7c5"}
Sep 18 19:44:26.402429 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.373385    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1755dba-f099-4830-a1af-c682ecf4931f" containerID="abedc10a8898fbac5259127c9910e052c42a66932d8d10b31e78de340f591b09" exitCode=0
Sep 18 19:44:26.402429 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.373466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwws5" event={"ID":"f1755dba-f099-4830-a1af-c682ecf4931f","Type":"ContainerDied","Data":"abedc10a8898fbac5259127c9910e052c42a66932d8d10b31e78de340f591b09"}
Sep 18 19:44:26.402429 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:26.395517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:44:26.402429 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:26.401808    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f015a90_7d5a_4f57_955b_ec0e68a173e8.slice/crio-0119ca60195ae268494d3e9c1aba81d68cbb304e1f70489521999bde54c7dc04 WatchSource:0}: Error finding container 0119ca60195ae268494d3e9c1aba81d68cbb304e1f70489521999bde54c7dc04: Status 404 returned error can't find the container with id 0119ca60195ae268494d3e9c1aba81d68cbb304e1f70489521999bde54c7dc04
Sep 18 19:44:27.378215 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:27.378179    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"0119ca60195ae268494d3e9c1aba81d68cbb304e1f70489521999bde54c7dc04"}
Sep 18 19:44:27.380555 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:27.380527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwws5" event={"ID":"f1755dba-f099-4830-a1af-c682ecf4931f","Type":"ContainerStarted","Data":"8dc71dcbda073f64c26c6ebe93dd89fd7c49b599e741c140d716b6c241dcf71b"}
Sep 18 19:44:27.380684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:27.380574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwws5" event={"ID":"f1755dba-f099-4830-a1af-c682ecf4931f","Type":"ContainerStarted","Data":"c7f35dc743e69e7fba4c7c206e9916b02006af8429c43efe6f33fe747b27cfe6"}
Sep 18 19:44:27.400410 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:27.400365    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pwws5" podStartSLOduration=2.130037293 podStartE2EDuration="3.400350997s" totalImagesPullingTime="1.179234999s" totalInitContainerRuntime="91.078705ms" isStatefulPod=true podCreationTimestamp="2026-09-18 19:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:27.399064123 +0000 UTC m=+303.157872108" watchObservedRunningTime="2026-09-18 19:44:27.400350997 +0000 UTC m=+303.159158981"
Sep 18 19:44:28.315033 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.314997    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-97688cdd6-h96vf"]
Sep 18 19:44:28.318526 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.318506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.321436 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.321410    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 18 19:44:28.322764 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.322742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 19:44:28.322866 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.322837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vs8tg\""
Sep 18 19:44:28.322866 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.322856    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 18 19:44:28.323015 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.322857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cj9mf9e812t51\""
Sep 18 19:44:28.323015 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.322929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 18 19:44:28.329602 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.329581    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-97688cdd6-h96vf"]
Sep 18 19:44:28.398718 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-secret-metrics-server-tls\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.399168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d72b0043-6319-422f-b42b-7cf364a1241e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.399168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d72b0043-6319-422f-b42b-7cf364a1241e-audit-log\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.399168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-secret-metrics-server-client-certs\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.399168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-client-ca-bundle\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.399168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d72b0043-6319-422f-b42b-7cf364a1241e-metrics-server-audit-profiles\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.399168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.398987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mbxs\" (UniqueName: \"kubernetes.io/projected/d72b0043-6319-422f-b42b-7cf364a1241e-kube-api-access-8mbxs\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.499701 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.499662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-secret-metrics-server-client-certs\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.499904 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.499724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-client-ca-bundle\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.499904 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.499756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d72b0043-6319-422f-b42b-7cf364a1241e-metrics-server-audit-profiles\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.499904 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.499820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mbxs\" (UniqueName: \"kubernetes.io/projected/d72b0043-6319-422f-b42b-7cf364a1241e-kube-api-access-8mbxs\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.499904 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.499851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-secret-metrics-server-tls\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.500175 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.500142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d72b0043-6319-422f-b42b-7cf364a1241e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.500303 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.500241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d72b0043-6319-422f-b42b-7cf364a1241e-audit-log\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.501343 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.501319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d72b0043-6319-422f-b42b-7cf364a1241e-metrics-server-audit-profiles\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.501443 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.501411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d72b0043-6319-422f-b42b-7cf364a1241e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.501694 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.501668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d72b0043-6319-422f-b42b-7cf364a1241e-audit-log\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.502562 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.502539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-client-ca-bundle\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.502889 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.502846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-secret-metrics-server-tls\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.502968 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.502867    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d72b0043-6319-422f-b42b-7cf364a1241e-secret-metrics-server-client-certs\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.508809 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.508756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mbxs\" (UniqueName: \"kubernetes.io/projected/d72b0043-6319-422f-b42b-7cf364a1241e-kube-api-access-8mbxs\") pod \"metrics-server-97688cdd6-h96vf\" (UID: \"d72b0043-6319-422f-b42b-7cf364a1241e\") " pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:28.630391 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:28.630306    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:29.328603 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.328568    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5476464f76-72w42"]
Sep 18 19:44:29.332583 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.332562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.335491 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.335469    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 18 19:44:29.338688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.337637    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 18 19:44:29.338688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.337929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 18 19:44:29.338688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.337961    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 18 19:44:29.338688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.338314    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 18 19:44:29.338688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.338381    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fzq2b\""
Sep 18 19:44:29.345817 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.345794    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 18 19:44:29.353232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.353208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5476464f76-72w42"]
Sep 18 19:44:29.408153 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-telemeter-client-tls\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-federate-client-tls\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-metrics-client-ca\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-serving-certs-ca-bundle\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjs2q\" (UniqueName: \"kubernetes.io/projected/405eeade-944a-4853-a3c2-676b1a545a33-kube-api-access-kjs2q\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-secret-telemeter-client\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.408605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.408518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509737 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-federate-client-tls\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-metrics-client-ca\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-serving-certs-ca-bundle\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjs2q\" (UniqueName: \"kubernetes.io/projected/405eeade-944a-4853-a3c2-676b1a545a33-kube-api-access-kjs2q\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-secret-telemeter-client\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.509954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.510261 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.509991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-telemeter-client-tls\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.510626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.510600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-serving-certs-ca-bundle\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.510753 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.510629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-metrics-client-ca\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.511058 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.511037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/405eeade-944a-4853-a3c2-676b1a545a33-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.513120 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.513098    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-telemeter-client-tls\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.513702 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.513681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-secret-telemeter-client\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.513855 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.513834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-federate-client-tls\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.514030 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.514004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/405eeade-944a-4853-a3c2-676b1a545a33-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.519391 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.519370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjs2q\" (UniqueName: \"kubernetes.io/projected/405eeade-944a-4853-a3c2-676b1a545a33-kube-api-access-kjs2q\") pod \"telemeter-client-5476464f76-72w42\" (UID: \"405eeade-944a-4853-a3c2-676b1a545a33\") " pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.568670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.568589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-97688cdd6-h96vf"]
Sep 18 19:44:29.594713 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:29.594672    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72b0043_6319_422f_b42b_7cf364a1241e.slice/crio-bc5a710c0a2eb1aa2b10e4828c7018491647516bccb4c0c4ef20b4a1a593b153 WatchSource:0}: Error finding container bc5a710c0a2eb1aa2b10e4828c7018491647516bccb4c0c4ef20b4a1a593b153: Status 404 returned error can't find the container with id bc5a710c0a2eb1aa2b10e4828c7018491647516bccb4c0c4ef20b4a1a593b153
Sep 18 19:44:29.596940 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.596920    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:44:29.647626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.647606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5476464f76-72w42"
Sep 18 19:44:29.930909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:29.930867    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5476464f76-72w42"]
Sep 18 19:44:29.934482 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:44:29.934456    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405eeade_944a_4853_a3c2_676b1a545a33.slice/crio-8900d30b1625be2372dcb10a89af1d6f1679946bebba4dea1378d25ab1d90b14 WatchSource:0}: Error finding container 8900d30b1625be2372dcb10a89af1d6f1679946bebba4dea1378d25ab1d90b14: Status 404 returned error can't find the container with id 8900d30b1625be2372dcb10a89af1d6f1679946bebba4dea1378d25ab1d90b14
Sep 18 19:44:30.393387 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.393308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d968bc48-sqb8l" event={"ID":"b91b2eea-333a-4932-9d32-0d672368be1c","Type":"ContainerStarted","Data":"a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf"}
Sep 18 19:44:30.395384 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.395345    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd" exitCode=0
Sep 18 19:44:30.395531 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.395442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"}
Sep 18 19:44:30.396852 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.396802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf" event={"ID":"d72b0043-6319-422f-b42b-7cf364a1241e","Type":"ContainerStarted","Data":"bc5a710c0a2eb1aa2b10e4828c7018491647516bccb4c0c4ef20b4a1a593b153"}
Sep 18 19:44:30.398136 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.398100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5476464f76-72w42" event={"ID":"405eeade-944a-4853-a3c2-676b1a545a33","Type":"ContainerStarted","Data":"8900d30b1625be2372dcb10a89af1d6f1679946bebba4dea1378d25ab1d90b14"}
Sep 18 19:44:30.412782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.412741    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d968bc48-sqb8l" podStartSLOduration=2.190254954 podStartE2EDuration="6.412721229s" totalImagesPullingTime="4.222466275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:30.412125131 +0000 UTC m=+306.170933118" watchObservedRunningTime="2026-09-18 19:44:30.412721229 +0000 UTC m=+306.171529213"
Sep 18 19:44:30.434012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:30.433982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:44:31.404222 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:31.404189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf" event={"ID":"d72b0043-6319-422f-b42b-7cf364a1241e","Type":"ContainerStarted","Data":"e0090dd32c91dbcc56714ebd6f2a7f31c6a8dca13e3bf67e1ac1c7813187a6dd"}
Sep 18 19:44:31.424199 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:31.424136    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf" podStartSLOduration=1.7411963510000001 podStartE2EDuration="3.424120186s" totalImagesPullingTime="1.682923835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:31.422420175 +0000 UTC m=+307.181228161" watchObservedRunningTime="2026-09-18 19:44:31.424120186 +0000 UTC m=+307.182928171"
Sep 18 19:44:32.279692 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:32.279646    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" podUID="58476e3c-9e0c-42a3-a0ad-452aa5c07a57" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 18 19:44:32.411627 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:32.411487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"}
Sep 18 19:44:32.411627 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:32.411577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"}
Sep 18 19:44:32.414224 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:32.414199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5476464f76-72w42" event={"ID":"405eeade-944a-4853-a3c2-676b1a545a33","Type":"ContainerStarted","Data":"da11fc90bcc6b9c3b3393c08cf5f442c2d5965a171cf591e968321e8637a6dd1"}
Sep 18 19:44:32.414385 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:32.414369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5476464f76-72w42" event={"ID":"405eeade-944a-4853-a3c2-676b1a545a33","Type":"ContainerStarted","Data":"3f75aab538124435cbcfc21419d9e7b39a9b077b113e99754e6f7f37c3301ab9"}
Sep 18 19:44:33.419727 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.419696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5476464f76-72w42" event={"ID":"405eeade-944a-4853-a3c2-676b1a545a33","Type":"ContainerStarted","Data":"6a897b2002fec6c76c6c5fa5651632e6f98602db44d4cdfb03257eaced4ad040"}
Sep 18 19:44:33.427822 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.427798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"}
Sep 18 19:44:33.427977 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.427892    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"}
Sep 18 19:44:33.427977 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.427919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"}
Sep 18 19:44:33.427977 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.427943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerStarted","Data":"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"}
Sep 18 19:44:33.445467 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.445422    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5476464f76-72w42" podStartSLOduration=2.143764943 podStartE2EDuration="4.445409857s" totalImagesPullingTime="2.301644914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:33.444733371 +0000 UTC m=+309.203541357" watchObservedRunningTime="2026-09-18 19:44:33.445409857 +0000 UTC m=+309.204217841"
Sep 18 19:44:33.472112 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:33.472073    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.650255253 podStartE2EDuration="8.472059524s" totalImagesPullingTime="5.802105489s" totalInitContainerRuntime="19.698782ms" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:33.470187613 +0000 UTC m=+309.228995604" watchObservedRunningTime="2026-09-18 19:44:33.472059524 +0000 UTC m=+309.230867509"
Sep 18 19:44:35.102486 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:35.102442    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:35.102830 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:35.102515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:35.107450 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:35.107429    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:35.441168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:35.441144    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:44:37.341328 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:37.341298    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6958b47ccf-sjp2r"
Sep 18 19:44:42.279543 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:42.279507    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" podUID="58476e3c-9e0c-42a3-a0ad-452aa5c07a57" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 18 19:44:48.631029 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:48.631004    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:48.631401 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:48.631065    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:44:51.962442 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:51.962411    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d968bc48-sqb8l"]
Sep 18 19:44:52.279770 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.279688    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" podUID="58476e3c-9e0c-42a3-a0ad-452aa5c07a57" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 18 19:44:52.279770 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.279769    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl"
Sep 18 19:44:52.280347 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.280315    2582 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5b24dec944471a049d4c4aba75f69c7b84c7cd0f9317e52428197b80e99479d2"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 18 19:44:52.280391 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.280373    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" podUID="58476e3c-9e0c-42a3-a0ad-452aa5c07a57" containerName="service-proxy" containerID="cri-o://5b24dec944471a049d4c4aba75f69c7b84c7cd0f9317e52428197b80e99479d2" gracePeriod=30
Sep 18 19:44:52.500758 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.500722    2582 generic.go:356] "Generic (PLEG): container finished" podID="58476e3c-9e0c-42a3-a0ad-452aa5c07a57" containerID="5b24dec944471a049d4c4aba75f69c7b84c7cd0f9317e52428197b80e99479d2" exitCode=2
Sep 18 19:44:52.500929 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.500789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" event={"ID":"58476e3c-9e0c-42a3-a0ad-452aa5c07a57","Type":"ContainerDied","Data":"5b24dec944471a049d4c4aba75f69c7b84c7cd0f9317e52428197b80e99479d2"}
Sep 18 19:44:52.500929 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:44:52.500833    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6898c56996-5h5tl" event={"ID":"58476e3c-9e0c-42a3-a0ad-452aa5c07a57","Type":"ContainerStarted","Data":"6a4536476157304296fd18881a4a596bf32b395464afc6a48cc603ec001d00dd"}
Sep 18 19:45:08.636658 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:08.636581    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:45:08.640404 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:08.640380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-97688cdd6-h96vf"
Sep 18 19:45:16.988489 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:16.988448    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69d968bc48-sqb8l" podUID="b91b2eea-333a-4932-9d32-0d672368be1c" containerName="console" containerID="cri-o://a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf" gracePeriod=15
Sep 18 19:45:17.227838 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.227817    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:45:17.310013 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.309933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-console-config\") pod \"b91b2eea-333a-4932-9d32-0d672368be1c\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") "
Sep 18 19:45:17.310013 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.309967    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-oauth-config\") pod \"b91b2eea-333a-4932-9d32-0d672368be1c\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") "
Sep 18 19:45:17.310013 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.309991    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-serving-cert\") pod \"b91b2eea-333a-4932-9d32-0d672368be1c\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") "
Sep 18 19:45:17.310218 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-oauth-serving-cert\") pod \"b91b2eea-333a-4932-9d32-0d672368be1c\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") "
Sep 18 19:45:17.310260 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310214    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-service-ca\") pod \"b91b2eea-333a-4932-9d32-0d672368be1c\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") "
Sep 18 19:45:17.310312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310280    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zhgf\" (UniqueName: \"kubernetes.io/projected/b91b2eea-333a-4932-9d32-0d672368be1c-kube-api-access-9zhgf\") pod \"b91b2eea-333a-4932-9d32-0d672368be1c\" (UID: \"b91b2eea-333a-4932-9d32-0d672368be1c\") "
Sep 18 19:45:17.310423 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310404    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b91b2eea-333a-4932-9d32-0d672368be1c" (UID: "b91b2eea-333a-4932-9d32-0d672368be1c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:17.310573 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310549    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-console-config" (OuterVolumeSpecName: "console-config") pod "b91b2eea-333a-4932-9d32-0d672368be1c" (UID: "b91b2eea-333a-4932-9d32-0d672368be1c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:17.310633 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b91b2eea-333a-4932-9d32-0d672368be1c" (UID: "b91b2eea-333a-4932-9d32-0d672368be1c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:17.310633 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.310617    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-oauth-serving-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:17.312473 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.312452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b91b2eea-333a-4932-9d32-0d672368be1c" (UID: "b91b2eea-333a-4932-9d32-0d672368be1c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:17.312563 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.312482    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b91b2eea-333a-4932-9d32-0d672368be1c" (UID: "b91b2eea-333a-4932-9d32-0d672368be1c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:17.312607 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.312560    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91b2eea-333a-4932-9d32-0d672368be1c-kube-api-access-9zhgf" (OuterVolumeSpecName: "kube-api-access-9zhgf") pod "b91b2eea-333a-4932-9d32-0d672368be1c" (UID: "b91b2eea-333a-4932-9d32-0d672368be1c"). InnerVolumeSpecName "kube-api-access-9zhgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:17.411559 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.411525    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-console-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:17.411559 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.411551    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-oauth-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:17.411559 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.411560    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91b2eea-333a-4932-9d32-0d672368be1c-console-serving-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:17.411559 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.411568    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91b2eea-333a-4932-9d32-0d672368be1c-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:17.411791 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.411576    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zhgf\" (UniqueName: \"kubernetes.io/projected/b91b2eea-333a-4932-9d32-0d672368be1c-kube-api-access-9zhgf\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:17.592831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.592744    2582 generic.go:356] "Generic (PLEG): container finished" podID="b91b2eea-333a-4932-9d32-0d672368be1c" containerID="a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf" exitCode=0
Sep 18 19:45:17.592831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.592794    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d968bc48-sqb8l"
Sep 18 19:45:17.593009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.592828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d968bc48-sqb8l" event={"ID":"b91b2eea-333a-4932-9d32-0d672368be1c","Type":"ContainerDied","Data":"a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf"}
Sep 18 19:45:17.593009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.592895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d968bc48-sqb8l" event={"ID":"b91b2eea-333a-4932-9d32-0d672368be1c","Type":"ContainerDied","Data":"ff642486082a5d384801beac577acdcabb4b958f40737f5deb33119cc19be7c5"}
Sep 18 19:45:17.593009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.592921    2582 scope.go:117] "RemoveContainer" containerID="a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf"
Sep 18 19:45:17.601084 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.601068    2582 scope.go:117] "RemoveContainer" containerID="a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf"
Sep 18 19:45:17.601355 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:17.601335    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf\": container with ID starting with a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf not found: ID does not exist" containerID="a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf"
Sep 18 19:45:17.601397 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.601367    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf"} err="failed to get container status \"a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf\": rpc error: code = NotFound desc = could not find container \"a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf\": container with ID starting with a08f943037bb84ccf087abea3ef6eb755b35b36218548dd3669f2107f2f617cf not found: ID does not exist"
Sep 18 19:45:17.614769 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.614745    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d968bc48-sqb8l"]
Sep 18 19:45:17.622120 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:17.619039    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d968bc48-sqb8l"]
Sep 18 19:45:18.438571 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:18.438541    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b91b2eea-333a-4932-9d32-0d672368be1c" path="/var/lib/kubelet/pods/b91b2eea-333a-4932-9d32-0d672368be1c/volumes"
Sep 18 19:45:40.192288 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:40.192254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:45:40.194705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:40.194682    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3eff98a8-abd8-4a4b-ac46-619476ad445d-metrics-certs\") pod \"network-metrics-daemon-phct6\" (UID: \"3eff98a8-abd8-4a4b-ac46-619476ad445d\") " pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:45:40.336863 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:40.336835    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9tpx\""
Sep 18 19:45:40.345137 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:40.345117    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-phct6"
Sep 18 19:45:40.611188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:40.611111    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-phct6"]
Sep 18 19:45:40.614088 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:45:40.614058    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eff98a8_abd8_4a4b_ac46_619476ad445d.slice/crio-3617e3188d309a4236e605d86868d45f2b6a2df40a84b7461dd0f9e32d46f3fe WatchSource:0}: Error finding container 3617e3188d309a4236e605d86868d45f2b6a2df40a84b7461dd0f9e32d46f3fe: Status 404 returned error can't find the container with id 3617e3188d309a4236e605d86868d45f2b6a2df40a84b7461dd0f9e32d46f3fe
Sep 18 19:45:40.675824 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:40.675790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-phct6" event={"ID":"3eff98a8-abd8-4a4b-ac46-619476ad445d","Type":"ContainerStarted","Data":"3617e3188d309a4236e605d86868d45f2b6a2df40a84b7461dd0f9e32d46f3fe"}
Sep 18 19:45:41.681276 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:41.681244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-phct6" event={"ID":"3eff98a8-abd8-4a4b-ac46-619476ad445d","Type":"ContainerStarted","Data":"11af8a1b726cd9e544dbe067589a8ef86098610ab10ac1674417c45e8b61c8e7"}
Sep 18 19:45:41.681612 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:41.681298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-phct6" event={"ID":"3eff98a8-abd8-4a4b-ac46-619476ad445d","Type":"ContainerStarted","Data":"acf1c3d8ce5c67fa8ca84f3c7dfdd5700056eb6eb34514489c49bc2ee77d682a"}
Sep 18 19:45:41.697126 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:41.697047    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-phct6" podStartSLOduration=374.869281976 podStartE2EDuration="6m15.697033217s" totalImagesPullingTime="827.751241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:41.696620814 +0000 UTC m=+377.455428802" watchObservedRunningTime="2026-09-18 19:45:41.697033217 +0000 UTC m=+377.455841202"
Sep 18 19:45:44.342618 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342587    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:45:44.343008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342836    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="alertmanager" containerID="cri-o://19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b" gracePeriod=120
Sep 18 19:45:44.343008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342922    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-web" containerID="cri-o://fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977" gracePeriod=120
Sep 18 19:45:44.343008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342926    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-metric" containerID="cri-o://423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c" gracePeriod=120
Sep 18 19:45:44.343008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342961    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="config-reloader" containerID="cri-o://aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c" gracePeriod=120
Sep 18 19:45:44.343008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342941    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy" containerID="cri-o://9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121" gracePeriod=120
Sep 18 19:45:44.343270 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.342992    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="prom-label-proxy" containerID="cri-o://a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17" gracePeriod=120
Sep 18 19:45:44.696907 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696861    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17" exitCode=0
Sep 18 19:45:44.696907 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696899    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121" exitCode=0
Sep 18 19:45:44.696907 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696907    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c" exitCode=0
Sep 18 19:45:44.696907 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696913    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b" exitCode=0
Sep 18 19:45:44.697179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"}
Sep 18 19:45:44.697179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"}
Sep 18 19:45:44.697179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.696996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"}
Sep 18 19:45:44.697179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:44.697021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"}
Sep 18 19:45:45.584394 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.584372    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:45.704488 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704448    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c" exitCode=0
Sep 18 19:45:45.704488 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704479    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerID="fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977" exitCode=0
Sep 18 19:45:45.704703 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704531    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:45.704703 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"}
Sep 18 19:45:45.704703 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"}
Sep 18 19:45:45.704703 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f015a90-7d5a-4f57-955b-ec0e68a173e8","Type":"ContainerDied","Data":"0119ca60195ae268494d3e9c1aba81d68cbb304e1f70489521999bde54c7dc04"}
Sep 18 19:45:45.704703 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.704680    2582 scope.go:117] "RemoveContainer" containerID="a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"
Sep 18 19:45:45.712120 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.712097    2582 scope.go:117] "RemoveContainer" containerID="423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"
Sep 18 19:45:45.719081 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.719065    2582 scope.go:117] "RemoveContainer" containerID="9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"
Sep 18 19:45:45.725650 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.725635    2582 scope.go:117] "RemoveContainer" containerID="fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"
Sep 18 19:45:45.732178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732162    2582 scope.go:117] "RemoveContainer" containerID="aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"
Sep 18 19:45:45.732319 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732299    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-volume\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732360 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv885\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-kube-api-access-qv885\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732397 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732397 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732381    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732469 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-out\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732469 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732431    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-main-tls\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732570 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732487    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-main-db\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732570 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-web-config\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.732892 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.732844    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:45:45.733310 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733011    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-metrics-client-ca\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.733310 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.733310 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733282    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.733497 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733319    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-tls-assets\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.733497 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733353    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-cluster-tls-config\") pod \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\" (UID: \"8f015a90-7d5a-4f57-955b-ec0e68a173e8\") "
Sep 18 19:45:45.733650 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733610    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-main-db\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.733705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.733650    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:45.734176 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.734064    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:45.735816 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.735788    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.736301 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.736271    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.736590 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.736563    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.737492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.737454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:45.737581 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.737485    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.737739 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.737703    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-volume" (OuterVolumeSpecName: "config-volume") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.737840 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.737764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-kube-api-access-qv885" (OuterVolumeSpecName: "kube-api-access-qv885") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "kube-api-access-qv885". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:45.737840 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.737820    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-out" (OuterVolumeSpecName: "config-out") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:45:45.740606 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.740491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.747180 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.747160    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-web-config" (OuterVolumeSpecName: "web-config") pod "8f015a90-7d5a-4f57-955b-ec0e68a173e8" (UID: "8f015a90-7d5a-4f57-955b-ec0e68a173e8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:45.748274 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.748257    2582 scope.go:117] "RemoveContainer" containerID="19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"
Sep 18 19:45:45.755369 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.755351    2582 scope.go:117] "RemoveContainer" containerID="c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"
Sep 18 19:45:45.762115 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.762099    2582 scope.go:117] "RemoveContainer" containerID="a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"
Sep 18 19:45:45.762370 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.762352    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17\": container with ID starting with a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17 not found: ID does not exist" containerID="a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"
Sep 18 19:45:45.762414 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.762380    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"} err="failed to get container status \"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17\": rpc error: code = NotFound desc = could not find container \"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17\": container with ID starting with a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17 not found: ID does not exist"
Sep 18 19:45:45.762414 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.762397    2582 scope.go:117] "RemoveContainer" containerID="423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"
Sep 18 19:45:45.762664 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.762647    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c\": container with ID starting with 423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c not found: ID does not exist" containerID="423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"
Sep 18 19:45:45.762709 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.762671    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"} err="failed to get container status \"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c\": rpc error: code = NotFound desc = could not find container \"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c\": container with ID starting with 423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c not found: ID does not exist"
Sep 18 19:45:45.762709 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.762688    2582 scope.go:117] "RemoveContainer" containerID="9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"
Sep 18 19:45:45.763032 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.763014    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121\": container with ID starting with 9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121 not found: ID does not exist" containerID="9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"
Sep 18 19:45:45.763086 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763034    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"} err="failed to get container status \"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121\": rpc error: code = NotFound desc = could not find container \"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121\": container with ID starting with 9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121 not found: ID does not exist"
Sep 18 19:45:45.763086 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763047    2582 scope.go:117] "RemoveContainer" containerID="fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"
Sep 18 19:45:45.763294 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.763277    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977\": container with ID starting with fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977 not found: ID does not exist" containerID="fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"
Sep 18 19:45:45.763333 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763299    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"} err="failed to get container status \"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977\": rpc error: code = NotFound desc = could not find container \"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977\": container with ID starting with fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977 not found: ID does not exist"
Sep 18 19:45:45.763333 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763313    2582 scope.go:117] "RemoveContainer" containerID="aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"
Sep 18 19:45:45.763546 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.763525    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c\": container with ID starting with aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c not found: ID does not exist" containerID="aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"
Sep 18 19:45:45.763632 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763549    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"} err="failed to get container status \"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c\": rpc error: code = NotFound desc = could not find container \"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c\": container with ID starting with aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c not found: ID does not exist"
Sep 18 19:45:45.763632 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763561    2582 scope.go:117] "RemoveContainer" containerID="19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"
Sep 18 19:45:45.763743 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.763727    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b\": container with ID starting with 19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b not found: ID does not exist" containerID="19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"
Sep 18 19:45:45.763791 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763745    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"} err="failed to get container status \"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b\": rpc error: code = NotFound desc = could not find container \"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b\": container with ID starting with 19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b not found: ID does not exist"
Sep 18 19:45:45.763791 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.763756    2582 scope.go:117] "RemoveContainer" containerID="c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"
Sep 18 19:45:45.764001 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:45:45.763986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd\": container with ID starting with c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd not found: ID does not exist" containerID="c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"
Sep 18 19:45:45.764045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764004    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"} err="failed to get container status \"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd\": rpc error: code = NotFound desc = could not find container \"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd\": container with ID starting with c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd not found: ID does not exist"
Sep 18 19:45:45.764045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764016    2582 scope.go:117] "RemoveContainer" containerID="a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"
Sep 18 19:45:45.764272 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764252    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17"} err="failed to get container status \"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17\": rpc error: code = NotFound desc = could not find container \"a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17\": container with ID starting with a63e7b6af8c0293a85589c633b68c31cbc43c9e9540d48ba50fb81842aa36b17 not found: ID does not exist"
Sep 18 19:45:45.764343 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764285    2582 scope.go:117] "RemoveContainer" containerID="423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"
Sep 18 19:45:45.764507 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764492    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c"} err="failed to get container status \"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c\": rpc error: code = NotFound desc = could not find container \"423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c\": container with ID starting with 423eb0008cff9eea12a43af9e6d70a0f4767df38c6a96aae4b581ee3a3e9a14c not found: ID does not exist"
Sep 18 19:45:45.764553 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764506    2582 scope.go:117] "RemoveContainer" containerID="9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"
Sep 18 19:45:45.764691 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764678    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121"} err="failed to get container status \"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121\": rpc error: code = NotFound desc = could not find container \"9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121\": container with ID starting with 9957926f3c837464f0ba5346521842f08c7b17c000026fe334f06f322fc88121 not found: ID does not exist"
Sep 18 19:45:45.764735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764691    2582 scope.go:117] "RemoveContainer" containerID="fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"
Sep 18 19:45:45.764924 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764907    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977"} err="failed to get container status \"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977\": rpc error: code = NotFound desc = could not find container \"fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977\": container with ID starting with fc4de57f36d27016e2ddec41b71a218ed37c430b21bf2dd05b8d2579bbb1e977 not found: ID does not exist"
Sep 18 19:45:45.764965 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.764926    2582 scope.go:117] "RemoveContainer" containerID="aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"
Sep 18 19:45:45.765154 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.765138    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c"} err="failed to get container status \"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c\": rpc error: code = NotFound desc = could not find container \"aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c\": container with ID starting with aaabb94f4ef8d395617a87b46ecfbece928392088e50e6ee4686944b60ded03c not found: ID does not exist"
Sep 18 19:45:45.765221 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.765156    2582 scope.go:117] "RemoveContainer" containerID="19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"
Sep 18 19:45:45.765397 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.765383    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b"} err="failed to get container status \"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b\": rpc error: code = NotFound desc = could not find container \"19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b\": container with ID starting with 19eedd6e62e1effd0f8592fb34990861b93324b1364f106e4acdd758eb1cd25b not found: ID does not exist"
Sep 18 19:45:45.765397 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.765396    2582 scope.go:117] "RemoveContainer" containerID="c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"
Sep 18 19:45:45.765614 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.765596    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd"} err="failed to get container status \"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd\": rpc error: code = NotFound desc = could not find container \"c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd\": container with ID starting with c7516451c32e9fd3838a4a24c236c6ba017bed00e59d2de98810ff0394b6dcdd not found: ID does not exist"
Sep 18 19:45:45.834189 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834160    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-tls-assets\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834189 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834183    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-cluster-tls-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834198    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834208    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv885\" (UniqueName: \"kubernetes.io/projected/8f015a90-7d5a-4f57-955b-ec0e68a173e8-kube-api-access-qv885\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834218    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834228    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834236    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f015a90-7d5a-4f57-955b-ec0e68a173e8-config-out\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834243    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-main-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834251    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-web-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834259    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-metrics-client-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834267    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f015a90-7d5a-4f57-955b-ec0e68a173e8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:45.834361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:45.834276    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f015a90-7d5a-4f57-955b-ec0e68a173e8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:45:46.028532 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.028504    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:45:46.032742 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.032717    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:45:46.058532 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058510    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:45:46.058738 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058727    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="alertmanager"
Sep 18 19:45:46.058783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058741    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="alertmanager"
Sep 18 19:45:46.058783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058755    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="init-config-reloader"
Sep 18 19:45:46.058783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058764    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="init-config-reloader"
Sep 18 19:45:46.058783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058772    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-web"
Sep 18 19:45:46.058783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058778    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-web"
Sep 18 19:45:46.058783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058784    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058790    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058802    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="config-reloader"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058807    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="config-reloader"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058815    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-metric"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058819    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-metric"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058827    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="prom-label-proxy"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058833    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="prom-label-proxy"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058839    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91b2eea-333a-4932-9d32-0d672368be1c" containerName="console"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058844    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91b2eea-333a-4932-9d32-0d672368be1c" containerName="console"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058895    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="config-reloader"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058901    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-web"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058908    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy-metric"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058915    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="kube-rbac-proxy"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058920    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b91b2eea-333a-4932-9d32-0d672368be1c" containerName="console"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058925    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="alertmanager"
Sep 18 19:45:46.058972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.058930    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" containerName="prom-label-proxy"
Sep 18 19:45:46.062403 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.062389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.064977 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.064957    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-69jt8\""
Sep 18 19:45:46.065092 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.064985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 19:45:46.065092 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.064985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 19:45:46.065092 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.065067    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 19:45:46.065419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.065400    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 19:45:46.065419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.065412    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 19:45:46.065419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.065415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 19:45:46.065612 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.065425    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 19:45:46.065612 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.065407    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 19:45:46.069619 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.069600    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 19:45:46.078051 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.078025    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:45:46.136167 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136167 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82c792d9-03fa-485b-82fe-870733fde55d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82c792d9-03fa-485b-82fe-870733fde55d-config-out\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136242    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-config-volume\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-web-config\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136643 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136404    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmkbs\" (UniqueName: \"kubernetes.io/projected/82c792d9-03fa-485b-82fe-870733fde55d-kube-api-access-xmkbs\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136643 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c792d9-03fa-485b-82fe-870733fde55d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136643 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136643 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82c792d9-03fa-485b-82fe-870733fde55d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.136643 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.136522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c792d9-03fa-485b-82fe-870733fde55d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237102 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82c792d9-03fa-485b-82fe-870733fde55d-config-out\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237102 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-config-volume\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-web-config\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkbs\" (UniqueName: \"kubernetes.io/projected/82c792d9-03fa-485b-82fe-870733fde55d-kube-api-access-xmkbs\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c792d9-03fa-485b-82fe-870733fde55d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82c792d9-03fa-485b-82fe-870733fde55d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c792d9-03fa-485b-82fe-870733fde55d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.237549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82c792d9-03fa-485b-82fe-870733fde55d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.239510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.237908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82c792d9-03fa-485b-82fe-870733fde55d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.239510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.239172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82c792d9-03fa-485b-82fe-870733fde55d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.240383 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240352    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82c792d9-03fa-485b-82fe-870733fde55d-config-out\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.240487 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-config-volume\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.240668 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.240668 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82c792d9-03fa-485b-82fe-870733fde55d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.240805 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-web-config\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.240805 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240730    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.241015 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.240998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.241223 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.241201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c792d9-03fa-485b-82fe-870733fde55d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.241856 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.241838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.242448 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.242432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82c792d9-03fa-485b-82fe-870733fde55d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.245195 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.245179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkbs\" (UniqueName: \"kubernetes.io/projected/82c792d9-03fa-485b-82fe-870733fde55d-kube-api-access-xmkbs\") pod \"alertmanager-main-0\" (UID: \"82c792d9-03fa-485b-82fe-870733fde55d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.371558 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.371473    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 19:45:46.444557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.440656    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f015a90-7d5a-4f57-955b-ec0e68a173e8" path="/var/lib/kubelet/pods/8f015a90-7d5a-4f57-955b-ec0e68a173e8/volumes"
Sep 18 19:45:46.654515 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.654488    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 19:45:46.655439 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:45:46.655413    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c792d9_03fa_485b_82fe_870733fde55d.slice/crio-abc1758eb883a34e8bd432988b591430276993c3138da02f51f1cf6c4302c95d WatchSource:0}: Error finding container abc1758eb883a34e8bd432988b591430276993c3138da02f51f1cf6c4302c95d: Status 404 returned error can't find the container with id abc1758eb883a34e8bd432988b591430276993c3138da02f51f1cf6c4302c95d
Sep 18 19:45:46.710649 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:46.710619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"abc1758eb883a34e8bd432988b591430276993c3138da02f51f1cf6c4302c95d"}
Sep 18 19:45:47.716238 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:47.716204    2582 generic.go:356] "Generic (PLEG): container finished" podID="82c792d9-03fa-485b-82fe-870733fde55d" containerID="33af2d5873f2267326a70cb9c62809f1994e56143571f7c9c29725bad1c291be" exitCode=0
Sep 18 19:45:47.716581 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:47.716287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerDied","Data":"33af2d5873f2267326a70cb9c62809f1994e56143571f7c9c29725bad1c291be"}
Sep 18 19:45:48.723572 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.723539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"3b20594180a0937278f4505b60a75239242d23e4d02369f6afe160ff88344122"}
Sep 18 19:45:48.723999 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.723608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"f1818aefc95f840b79eebba6eda41dbfcfb5e666e2bd106137370adcf7148b40"}
Sep 18 19:45:48.723999 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.723652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"439e29c80aa095064798b6e49a8f8adc42c590ca9ca886350a717add857484f2"}
Sep 18 19:45:48.723999 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.723681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"cdcdbe44ee71f791400132644cd372c7441e2a3ebbba4fc4d6607413e9461fe0"}
Sep 18 19:45:48.723999 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.723707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"70e0e1df3ef1d6f7d43c1f70e3b40c72bdb2e8783aaf4177618743a2d819db7e"}
Sep 18 19:45:48.723999 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.723752    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82c792d9-03fa-485b-82fe-870733fde55d","Type":"ContainerStarted","Data":"1bc1c907aef8d3af561488a65baae796e52e13598888863c28bcad7655c57e6a"}
Sep 18 19:45:48.758864 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:45:48.758812    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.743119585 podStartE2EDuration="2.758794367s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.674782ms" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:48.757223543 +0000 UTC m=+384.516031521" watchObservedRunningTime="2026-09-18 19:45:48.758794367 +0000 UTC m=+384.517602353"
Sep 18 19:46:57.095689 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.095657    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7tlgr"]
Sep 18 19:46:57.098933 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.098918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.101558 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.101536    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 19:46:57.101673 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.101588    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 19:46:57.101673 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.101589    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nvw42\""
Sep 18 19:46:57.106976 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.106953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7tlgr"]
Sep 18 19:46:57.179136 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.179112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzn9\" (UniqueName: \"kubernetes.io/projected/100fea1a-47fa-420b-a8b2-ddae601317a9-kube-api-access-cbzn9\") pod \"cert-manager-55b4d954d5-7tlgr\" (UID: \"100fea1a-47fa-420b-a8b2-ddae601317a9\") " pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.179259 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.179162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/100fea1a-47fa-420b-a8b2-ddae601317a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-7tlgr\" (UID: \"100fea1a-47fa-420b-a8b2-ddae601317a9\") " pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.279723 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.279695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/100fea1a-47fa-420b-a8b2-ddae601317a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-7tlgr\" (UID: \"100fea1a-47fa-420b-a8b2-ddae601317a9\") " pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.279812 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.279740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzn9\" (UniqueName: \"kubernetes.io/projected/100fea1a-47fa-420b-a8b2-ddae601317a9-kube-api-access-cbzn9\") pod \"cert-manager-55b4d954d5-7tlgr\" (UID: \"100fea1a-47fa-420b-a8b2-ddae601317a9\") " pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.289066 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.289034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/100fea1a-47fa-420b-a8b2-ddae601317a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-7tlgr\" (UID: \"100fea1a-47fa-420b-a8b2-ddae601317a9\") " pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.289269 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.289247    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzn9\" (UniqueName: \"kubernetes.io/projected/100fea1a-47fa-420b-a8b2-ddae601317a9-kube-api-access-cbzn9\") pod \"cert-manager-55b4d954d5-7tlgr\" (UID: \"100fea1a-47fa-420b-a8b2-ddae601317a9\") " pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.408108 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.408020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7tlgr"
Sep 18 19:46:57.675118 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.675095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7tlgr"]
Sep 18 19:46:57.677485 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:46:57.677455    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod100fea1a_47fa_420b_a8b2_ddae601317a9.slice/crio-7c8e631d8538ca1f2aa81d5164305f229c48cc6c6300e727ddbd4169485e0ae6 WatchSource:0}: Error finding container 7c8e631d8538ca1f2aa81d5164305f229c48cc6c6300e727ddbd4169485e0ae6: Status 404 returned error can't find the container with id 7c8e631d8538ca1f2aa81d5164305f229c48cc6c6300e727ddbd4169485e0ae6
Sep 18 19:46:57.967517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:46:57.967439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7tlgr" event={"ID":"100fea1a-47fa-420b-a8b2-ddae601317a9","Type":"ContainerStarted","Data":"7c8e631d8538ca1f2aa81d5164305f229c48cc6c6300e727ddbd4169485e0ae6"}
Sep 18 19:47:00.980394 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:00.980358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7tlgr" event={"ID":"100fea1a-47fa-420b-a8b2-ddae601317a9","Type":"ContainerStarted","Data":"7a78f5b0b9e67d4b184182c3cb4598a73c040515a380e973734df0936e5973fb"}
Sep 18 19:47:00.996109 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:00.996062    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7tlgr" podStartSLOduration=1.076906607 podStartE2EDuration="3.996048218s" totalImagesPullingTime="2.919141611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:00.995711495 +0000 UTC m=+456.754519483" watchObservedRunningTime="2026-09-18 19:47:00.996048218 +0000 UTC m=+456.754856203"
Sep 18 19:47:16.925588 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.925556    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"]
Sep 18 19:47:16.928552 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.928537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:16.933528 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.933503    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 19:47:16.934635 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.934615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 19:47:16.934969 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.934653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 19:47:16.934969 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.934616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bdx4v\""
Sep 18 19:47:16.934969 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.934932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 19:47:16.967466 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:16.967441    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"]
Sep 18 19:47:17.033467 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.033429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/762c4bf4-3f53-4295-89f4-53b14955412b-manifests\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.033467 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.033473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/762c4bf4-3f53-4295-89f4-53b14955412b-tmp\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.033720 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.033509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/762c4bf4-3f53-4295-89f4-53b14955412b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.033720 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.033638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/762c4bf4-3f53-4295-89f4-53b14955412b-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.033720 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.033693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmpng\" (UniqueName: \"kubernetes.io/projected/762c4bf4-3f53-4295-89f4-53b14955412b-kube-api-access-lmpng\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.134830 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.134794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/762c4bf4-3f53-4295-89f4-53b14955412b-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.134830 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.134839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmpng\" (UniqueName: \"kubernetes.io/projected/762c4bf4-3f53-4295-89f4-53b14955412b-kube-api-access-lmpng\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.135102 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.135023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/762c4bf4-3f53-4295-89f4-53b14955412b-manifests\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.135102 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.135065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/762c4bf4-3f53-4295-89f4-53b14955412b-tmp\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.135206 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.135105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/762c4bf4-3f53-4295-89f4-53b14955412b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.135444 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.135419    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/762c4bf4-3f53-4295-89f4-53b14955412b-manifests\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.137481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.137452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/762c4bf4-3f53-4295-89f4-53b14955412b-tmp\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.137622 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.137570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/762c4bf4-3f53-4295-89f4-53b14955412b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.137622 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.137574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/762c4bf4-3f53-4295-89f4-53b14955412b-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.145740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.145703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmpng\" (UniqueName: \"kubernetes.io/projected/762c4bf4-3f53-4295-89f4-53b14955412b-kube-api-access-lmpng\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g\" (UID: \"762c4bf4-3f53-4295-89f4-53b14955412b\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.238368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.238301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:17.513686 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:17.513664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"]
Sep 18 19:47:17.516278 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:17.516248    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762c4bf4_3f53_4295_89f4_53b14955412b.slice/crio-c6f1eea4bc9355f11d3711ebf12a7f8224d5173ef9def6056b3dde20b28e05af WatchSource:0}: Error finding container c6f1eea4bc9355f11d3711ebf12a7f8224d5173ef9def6056b3dde20b28e05af: Status 404 returned error can't find the container with id c6f1eea4bc9355f11d3711ebf12a7f8224d5173ef9def6056b3dde20b28e05af
Sep 18 19:47:18.044600 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:18.044562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g" event={"ID":"762c4bf4-3f53-4295-89f4-53b14955412b","Type":"ContainerStarted","Data":"c6f1eea4bc9355f11d3711ebf12a7f8224d5173ef9def6056b3dde20b28e05af"}
Sep 18 19:47:21.064134 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:21.064094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g" event={"ID":"762c4bf4-3f53-4295-89f4-53b14955412b","Type":"ContainerStarted","Data":"79a2110b48e1e4e9b161ebc4ec45e89854eb98aab759b7aeb3a8a1fa55e35b71"}
Sep 18 19:47:22.069708 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:22.069675    2582 generic.go:356] "Generic (PLEG): container finished" podID="762c4bf4-3f53-4295-89f4-53b14955412b" containerID="79a2110b48e1e4e9b161ebc4ec45e89854eb98aab759b7aeb3a8a1fa55e35b71" exitCode=0
Sep 18 19:47:22.070116 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:22.069725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g" event={"ID":"762c4bf4-3f53-4295-89f4-53b14955412b","Type":"ContainerDied","Data":"79a2110b48e1e4e9b161ebc4ec45e89854eb98aab759b7aeb3a8a1fa55e35b71"}
Sep 18 19:47:23.075982 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:23.075945    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g" event={"ID":"762c4bf4-3f53-4295-89f4-53b14955412b","Type":"ContainerStarted","Data":"d4a0e9cadf6515d2140b16529675b2c034b2579f3c2c675e7dc1c2721260a965"}
Sep 18 19:47:23.076439 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:23.076052    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:23.098698 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:23.098649    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g" podStartSLOduration=2.79269631 podStartE2EDuration="7.098631284s" totalImagesPullingTime="3.301631253s" totalInitContainerRuntime="1.004303721s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:23.096810394 +0000 UTC m=+478.855618380" watchObservedRunningTime="2026-09-18 19:47:23.098631284 +0000 UTC m=+478.857439273"
Sep 18 19:47:34.082029 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:34.081998    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g"
Sep 18 19:47:36.260705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.260679    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"]
Sep 18 19:47:36.398215 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.398182    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"]
Sep 18 19:47:36.398363 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.398274    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.401418 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.401397    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 18 19:47:36.401622 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.401607    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 18 19:47:36.403417 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.403403    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 19:47:36.403819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.403795    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 19:47:36.476925 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.476906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-tls-certs\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.477038 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.476946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-tmp\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.477038 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.476981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99jd\" (UniqueName: \"kubernetes.io/projected/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-kube-api-access-v99jd\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.577483 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.577410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-tls-certs\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.577483 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.577445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-tmp\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.577483 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.577470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99jd\" (UniqueName: \"kubernetes.io/projected/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-kube-api-access-v99jd\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.579930 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.579913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-tmp\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.580154 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.580137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-tls-certs\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.589593 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.589570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99jd\" (UniqueName: \"kubernetes.io/projected/3a9c636c-b884-43c8-bc70-67bbbf0d4dde-kube-api-access-v99jd\") pod \"kube-auth-proxy-6bc78fcbdb-lmldp\" (UID: \"3a9c636c-b884-43c8-bc70-67bbbf0d4dde\") " pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.708019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.707987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"
Sep 18 19:47:36.994783 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:36.994752    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp"]
Sep 18 19:47:36.997593 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:36.997566    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9c636c_b884_43c8_bc70_67bbbf0d4dde.slice/crio-d1d4460e0ee0cb40642b2b7d3d24f4bd3593d57b24e857e63d95e3abf4e77d60 WatchSource:0}: Error finding container d1d4460e0ee0cb40642b2b7d3d24f4bd3593d57b24e857e63d95e3abf4e77d60: Status 404 returned error can't find the container with id d1d4460e0ee0cb40642b2b7d3d24f4bd3593d57b24e857e63d95e3abf4e77d60
Sep 18 19:47:37.129508 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.129476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp" event={"ID":"3a9c636c-b884-43c8-bc70-67bbbf0d4dde","Type":"ContainerStarted","Data":"d1d4460e0ee0cb40642b2b7d3d24f4bd3593d57b24e857e63d95e3abf4e77d60"}
Sep 18 19:47:37.575926 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.575890    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"]
Sep 18 19:47:37.578153 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.578138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.581253 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.581230    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 19:47:37.581355 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.581268    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 19:47:37.581507 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.581494    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 19:47:37.581557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.581502    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 19:47:37.581557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.581495    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgxz2\""
Sep 18 19:47:37.583916 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.583895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78c84b-44be-4ec6-ac08-33a1d7af0531-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.583974 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.583933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thn2\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-kube-api-access-5thn2\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.584011 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.583970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.584011 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.584004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.584080 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.584030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.584080 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.584051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.584152 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.584137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.592052 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.592034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"]
Sep 18 19:47:37.685682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78c84b-44be-4ec6-ac08-33a1d7af0531-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.685682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thn2\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-kube-api-access-5thn2\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.685682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.686012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.686012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.686012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.686012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.685810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.686530 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.686480    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.689188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.689160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.689521 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.689496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.689756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.689740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.689917 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.689839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78c84b-44be-4ec6-ac08-33a1d7af0531-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.694591 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.694564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thn2\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-kube-api-access-5thn2\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.694782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.694743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-862d2\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:37.894196 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:37.894046    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:38.202833 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:38.202808    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"]
Sep 18 19:47:38.204990 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:38.204962    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf78c84b_44be_4ec6_ac08_33a1d7af0531.slice/crio-aed72ca86db3e854b81b10acececf4a975e000847181f7c56459d5ab67024aa6 WatchSource:0}: Error finding container aed72ca86db3e854b81b10acececf4a975e000847181f7c56459d5ab67024aa6: Status 404 returned error can't find the container with id aed72ca86db3e854b81b10acececf4a975e000847181f7c56459d5ab67024aa6
Sep 18 19:47:39.141850 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:39.141802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" event={"ID":"df78c84b-44be-4ec6-ac08-33a1d7af0531","Type":"ContainerStarted","Data":"aed72ca86db3e854b81b10acececf4a975e000847181f7c56459d5ab67024aa6"}
Sep 18 19:47:40.150908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:40.150803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp" event={"ID":"3a9c636c-b884-43c8-bc70-67bbbf0d4dde","Type":"ContainerStarted","Data":"1cda41852324e9761effdbc712da5812fd5cbfa40bac684a3b9b4f81083d755d"}
Sep 18 19:47:40.167984 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:40.167835    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp" podStartSLOduration=1.40498592 podStartE2EDuration="4.167814816s" totalImagesPullingTime="2.762828896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:40.166505164 +0000 UTC m=+495.925313153" watchObservedRunningTime="2026-09-18 19:47:40.167814816 +0000 UTC m=+495.926622801"
Sep 18 19:47:41.453167 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:41.453131    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:47:41.453444 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:41.453194    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:47:42.160995 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:42.160959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" event={"ID":"df78c84b-44be-4ec6-ac08-33a1d7af0531","Type":"ContainerStarted","Data":"39ab95654320a9af9519a07696bca3975595e5a2a919a3f41ba7935eae84fae0"}
Sep 18 19:47:42.161191 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:42.161167    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:42.162940 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:42.162913    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-862d2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 19:47:42.163045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:42.162970    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:47:43.166582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:43.166553    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:43.188092 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:43.188046    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" podStartSLOduration=2.9426487740000002 podStartE2EDuration="6.18803025s" totalImagesPullingTime="3.245381476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:42.18149711 +0000 UTC m=+497.940305098" watchObservedRunningTime="2026-09-18 19:47:43.18803025 +0000 UTC m=+498.946838235"
Sep 18 19:47:47.001227 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.001186    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jrczj"]
Sep 18 19:47:47.003662 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.003639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.006493 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.006473    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 18 19:47:47.006493 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.006490    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cgwqm\""
Sep 18 19:47:47.016045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.016022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jrczj"]
Sep 18 19:47:47.062282 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.062248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-664xj\" (UniqueName: \"kubernetes.io/projected/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-kube-api-access-664xj\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.062478 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.062309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.163516 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.163484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-664xj\" (UniqueName: \"kubernetes.io/projected/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-kube-api-access-664xj\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.163688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.163538    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.163688 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:47.163661    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 18 19:47:47.163758 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:47.163733    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert podName:06a63c5e-24db-4b1e-a0cb-0960ef8d67ad nodeName:}" failed. No retries permitted until 2026-09-18 19:47:47.663713365 +0000 UTC m=+503.422521342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert") pod "odh-model-controller-7998c67dc4-jrczj" (UID: "06a63c5e-24db-4b1e-a0cb-0960ef8d67ad") : secret "odh-model-controller-webhook-cert" not found
Sep 18 19:47:47.174663 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.174636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-664xj\" (UniqueName: \"kubernetes.io/projected/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-kube-api-access-664xj\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.667991 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.667956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:47.668157 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:47.668098    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 18 19:47:47.668205 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:47.668162    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert podName:06a63c5e-24db-4b1e-a0cb-0960ef8d67ad nodeName:}" failed. No retries permitted until 2026-09-18 19:47:48.668144398 +0000 UTC m=+504.426952366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert") pod "odh-model-controller-7998c67dc4-jrczj" (UID: "06a63c5e-24db-4b1e-a0cb-0960ef8d67ad") : secret "odh-model-controller-webhook-cert" not found
Sep 18 19:47:47.674834 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.674803    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-568sq"]
Sep 18 19:47:47.676918 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.676903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:47.679233 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.679211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 18 19:47:47.679462 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.679445    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zqhk2\""
Sep 18 19:47:47.687749 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.687723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-568sq"]
Sep 18 19:47:47.768926 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.768859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/182be8c6-b56e-4c45-94b5-192f982457f3-tls-certs\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:47.769077 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.768993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76v2d\" (UniqueName: \"kubernetes.io/projected/182be8c6-b56e-4c45-94b5-192f982457f3-kube-api-access-76v2d\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:47.869620 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.869587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/182be8c6-b56e-4c45-94b5-192f982457f3-tls-certs\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:47.869788 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.869646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76v2d\" (UniqueName: \"kubernetes.io/projected/182be8c6-b56e-4c45-94b5-192f982457f3-kube-api-access-76v2d\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:47.869788 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:47.869734    2582 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 18 19:47:47.869858 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:47.869799    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/182be8c6-b56e-4c45-94b5-192f982457f3-tls-certs podName:182be8c6-b56e-4c45-94b5-192f982457f3 nodeName:}" failed. No retries permitted until 2026-09-18 19:47:48.369782299 +0000 UTC m=+504.128590261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/182be8c6-b56e-4c45-94b5-192f982457f3-tls-certs") pod "model-serving-api-54d89bd5fc-568sq" (UID: "182be8c6-b56e-4c45-94b5-192f982457f3") : secret "model-serving-api-tls" not found
Sep 18 19:47:47.878595 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:47.878577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76v2d\" (UniqueName: \"kubernetes.io/projected/182be8c6-b56e-4c45-94b5-192f982457f3-kube-api-access-76v2d\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:48.373963 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.373925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/182be8c6-b56e-4c45-94b5-192f982457f3-tls-certs\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:48.376498 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.376478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/182be8c6-b56e-4c45-94b5-192f982457f3-tls-certs\") pod \"model-serving-api-54d89bd5fc-568sq\" (UID: \"182be8c6-b56e-4c45-94b5-192f982457f3\") " pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:48.587443 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.587408    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:48.675832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.675803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:48.678300 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.678277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a63c5e-24db-4b1e-a0cb-0960ef8d67ad-cert\") pod \"odh-model-controller-7998c67dc4-jrczj\" (UID: \"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:48.813654 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.813627    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:48.856389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:48.856367    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-568sq"]
Sep 18 19:47:48.857854 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:48.857801    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182be8c6_b56e_4c45_94b5_192f982457f3.slice/crio-5c2e6a70a980eed4e440ec013e915b4169905b5182e23c7f486f7c1e8779479e WatchSource:0}: Error finding container 5c2e6a70a980eed4e440ec013e915b4169905b5182e23c7f486f7c1e8779479e: Status 404 returned error can't find the container with id 5c2e6a70a980eed4e440ec013e915b4169905b5182e23c7f486f7c1e8779479e
Sep 18 19:47:49.082317 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:49.082152    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jrczj"]
Sep 18 19:47:49.084718 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:49.084691    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a63c5e_24db_4b1e_a0cb_0960ef8d67ad.slice/crio-8cd8c056f5bd343929a01d7044696ff59fc1d799afc68696596e0779b0d1335b WatchSource:0}: Error finding container 8cd8c056f5bd343929a01d7044696ff59fc1d799afc68696596e0779b0d1335b: Status 404 returned error can't find the container with id 8cd8c056f5bd343929a01d7044696ff59fc1d799afc68696596e0779b0d1335b
Sep 18 19:47:49.193246 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:49.193207    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-568sq" event={"ID":"182be8c6-b56e-4c45-94b5-192f982457f3","Type":"ContainerStarted","Data":"5c2e6a70a980eed4e440ec013e915b4169905b5182e23c7f486f7c1e8779479e"}
Sep 18 19:47:49.194365 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:49.194336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj" event={"ID":"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad","Type":"ContainerStarted","Data":"8cd8c056f5bd343929a01d7044696ff59fc1d799afc68696596e0779b0d1335b"}
Sep 18 19:47:52.211861 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:52.211819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-568sq" event={"ID":"182be8c6-b56e-4c45-94b5-192f982457f3","Type":"ContainerStarted","Data":"d4851331fba032544b6d7a5898fc79b1e80ae43fcefaba4a767feb175160efc9"}
Sep 18 19:47:52.212296 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:52.211942    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:47:52.213620 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:52.213596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj" event={"ID":"06a63c5e-24db-4b1e-a0cb-0960ef8d67ad","Type":"ContainerStarted","Data":"2db99536729f32a33941576f8a6b4e890f6df92c6de976ad4bea7b180867868a"}
Sep 18 19:47:52.213732 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:52.213648    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:47:52.231221 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:52.231176    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-568sq" podStartSLOduration=2.368526081 podStartE2EDuration="5.231162184s" totalImagesPullingTime="2.862636103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:52.23030746 +0000 UTC m=+507.989115455" watchObservedRunningTime="2026-09-18 19:47:52.231162184 +0000 UTC m=+507.989970169"
Sep 18 19:47:52.256032 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:52.255989    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj" podStartSLOduration=3.562977809 podStartE2EDuration="6.255970674s" totalImagesPullingTime="2.692992865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:52.255009442 +0000 UTC m=+508.013817428" watchObservedRunningTime="2026-09-18 19:47:52.255970674 +0000 UTC m=+508.014778659"
Sep 18 19:47:56.317188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.317152    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"]
Sep 18 19:47:56.320535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.320513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.324771 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.324749    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 18 19:47:56.324771 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.324753    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vv44z\""
Sep 18 19:47:56.334177 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.334155    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"]
Sep 18 19:47:56.337888 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.337854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"]
Sep 18 19:47:56.338019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.337993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.340575 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.340557    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-995xq\""
Sep 18 19:47:56.340680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.340574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 18 19:47:56.346697 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.346675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw9wz\" (UniqueName: \"kubernetes.io/projected/e12201f6-6021-432f-aae2-4842e288b7b3-kube-api-access-tw9wz\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.346779 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.346744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e12201f6-6021-432f-aae2-4842e288b7b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.353959 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.353938    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"]
Sep 18 19:47:56.448024 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.447997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpp7\" (UniqueName: \"kubernetes.io/projected/b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644-kube-api-access-2bpp7\") pod \"llmisvc-controller-manager-777c6bd7d5-k8sbw\" (UID: \"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.448181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.448067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9wz\" (UniqueName: \"kubernetes.io/projected/e12201f6-6021-432f-aae2-4842e288b7b3-kube-api-access-tw9wz\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.448181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.448099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k8sbw\" (UID: \"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.448181 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.448168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e12201f6-6021-432f-aae2-4842e288b7b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.448318 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:56.448246    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 18 19:47:56.448318 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:47:56.448299    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12201f6-6021-432f-aae2-4842e288b7b3-cert podName:e12201f6-6021-432f-aae2-4842e288b7b3 nodeName:}" failed. No retries permitted until 2026-09-18 19:47:56.94827949 +0000 UTC m=+512.707087457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e12201f6-6021-432f-aae2-4842e288b7b3-cert") pod "kserve-controller-manager-d6f4b65b8-pvf8l" (UID: "e12201f6-6021-432f-aae2-4842e288b7b3") : secret "kserve-webhook-server-cert" not found
Sep 18 19:47:56.468387 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.468359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw9wz\" (UniqueName: \"kubernetes.io/projected/e12201f6-6021-432f-aae2-4842e288b7b3-kube-api-access-tw9wz\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.548720 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.548688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpp7\" (UniqueName: \"kubernetes.io/projected/b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644-kube-api-access-2bpp7\") pod \"llmisvc-controller-manager-777c6bd7d5-k8sbw\" (UID: \"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.548720 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.548724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k8sbw\" (UID: \"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.551224 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.551197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k8sbw\" (UID: \"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.557995 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.557971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpp7\" (UniqueName: \"kubernetes.io/projected/b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644-kube-api-access-2bpp7\") pod \"llmisvc-controller-manager-777c6bd7d5-k8sbw\" (UID: \"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.647125 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.647061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:47:56.934368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.934345    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"]
Sep 18 19:47:56.936230 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:56.936204    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8e1e2f2_1b52_4b2c_b6fb_b25cdde56644.slice/crio-259ba7292880af596be7070c9590f3d3c903bf6986d998e956c993cf814c9222 WatchSource:0}: Error finding container 259ba7292880af596be7070c9590f3d3c903bf6986d998e956c993cf814c9222: Status 404 returned error can't find the container with id 259ba7292880af596be7070c9590f3d3c903bf6986d998e956c993cf814c9222
Sep 18 19:47:56.951686 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.951661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e12201f6-6021-432f-aae2-4842e288b7b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:56.954329 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:56.954309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e12201f6-6021-432f-aae2-4842e288b7b3-cert\") pod \"kserve-controller-manager-d6f4b65b8-pvf8l\" (UID: \"e12201f6-6021-432f-aae2-4842e288b7b3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:57.229785 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:57.229688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:47:57.234902 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:57.234861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw" event={"ID":"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644","Type":"ContainerStarted","Data":"259ba7292880af596be7070c9590f3d3c903bf6986d998e956c993cf814c9222"}
Sep 18 19:47:57.507211 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:57.507132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"]
Sep 18 19:47:57.539243 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:47:57.539214    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12201f6_6021_432f_aae2_4842e288b7b3.slice/crio-eaf74bbfa46705928b75506e07647edf354bbf485391dc8e208c14137df19d5f WatchSource:0}: Error finding container eaf74bbfa46705928b75506e07647edf354bbf485391dc8e208c14137df19d5f: Status 404 returned error can't find the container with id eaf74bbfa46705928b75506e07647edf354bbf485391dc8e208c14137df19d5f
Sep 18 19:47:57.870420 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:57.870345    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"]
Sep 18 19:47:57.870560 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:57.870542    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerName="discovery" containerID="cri-o://39ab95654320a9af9519a07696bca3975595e5a2a919a3f41ba7935eae84fae0" gracePeriod=30
Sep 18 19:47:58.241684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.241650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l" event={"ID":"e12201f6-6021-432f-aae2-4842e288b7b3","Type":"ContainerStarted","Data":"eaf74bbfa46705928b75506e07647edf354bbf485391dc8e208c14137df19d5f"}
Sep 18 19:47:58.244209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.244116    2582 generic.go:356] "Generic (PLEG): container finished" podID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerID="39ab95654320a9af9519a07696bca3975595e5a2a919a3f41ba7935eae84fae0" exitCode=0
Sep 18 19:47:58.244209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.244166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" event={"ID":"df78c84b-44be-4ec6-ac08-33a1d7af0531","Type":"ContainerDied","Data":"39ab95654320a9af9519a07696bca3975595e5a2a919a3f41ba7935eae84fae0"}
Sep 18 19:47:58.266951 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.266915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:58.363048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363015    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78c84b-44be-4ec6-ac08-33a1d7af0531-local-certs\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363048 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-cacerts\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363074    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-ca-configmap\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-token\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363185    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5thn2\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-kube-api-access-5thn2\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-dns-cert\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363257    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-kubeconfig\") pod \"df78c84b-44be-4ec6-ac08-33a1d7af0531\" (UID: \"df78c84b-44be-4ec6-ac08-33a1d7af0531\") "
Sep 18 19:47:58.363832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.363753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:47:58.366391 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.366362    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df78c84b-44be-4ec6-ac08-33a1d7af0531-local-certs" (OuterVolumeSpecName: "local-certs") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:47:58.366492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.366463    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-cacerts" (OuterVolumeSpecName: "cacerts") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:47:58.366626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.366601    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-token" (OuterVolumeSpecName: "istio-token") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:47:58.366854 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.366831    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:47:58.366949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.366900    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:47:58.367159 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.367139    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-kube-api-access-5thn2" (OuterVolumeSpecName: "kube-api-access-5thn2") pod "df78c84b-44be-4ec6-ac08-33a1d7af0531" (UID: "df78c84b-44be-4ec6-ac08-33a1d7af0531"). InnerVolumeSpecName "kube-api-access-5thn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:47:58.464171 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464139    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78c84b-44be-4ec6-ac08-33a1d7af0531-local-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:58.464287 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464235    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-cacerts\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:58.464287 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464251    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-ca-configmap\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:58.464287 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464264    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:58.464287 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464278    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5thn2\" (UniqueName: \"kubernetes.io/projected/df78c84b-44be-4ec6-ac08-33a1d7af0531-kube-api-access-5thn2\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:58.464550 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464295    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-csr-dns-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:58.464550 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:58.464309    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df78c84b-44be-4ec6-ac08-33a1d7af0531-istio-kubeconfig\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:47:59.251091 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:59.251051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" event={"ID":"df78c84b-44be-4ec6-ac08-33a1d7af0531","Type":"ContainerDied","Data":"aed72ca86db3e854b81b10acececf4a975e000847181f7c56459d5ab67024aa6"}
Sep 18 19:47:59.251091 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:59.251076    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"
Sep 18 19:47:59.251582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:59.251134    2582 scope.go:117] "RemoveContainer" containerID="39ab95654320a9af9519a07696bca3975595e5a2a919a3f41ba7935eae84fae0"
Sep 18 19:47:59.270735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:59.270711    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"]
Sep 18 19:47:59.275471 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:47:59.275448    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2"]
Sep 18 19:48:00.257591 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.257552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l" event={"ID":"e12201f6-6021-432f-aae2-4842e288b7b3","Type":"ContainerStarted","Data":"491f00299d8f779be0b16e97435af2347c28dd838c304f7cfb629bfe88796abf"}
Sep 18 19:48:00.258039 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.257646    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:48:00.259379 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.259354    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw" event={"ID":"b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644","Type":"ContainerStarted","Data":"21f8d60f229f6758925ceec5dc036fac8f4d18264c9e1e7935dfd2406349861d"}
Sep 18 19:48:00.259513 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.259448    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:48:00.277342 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.277291    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l" podStartSLOduration=1.656066748 podStartE2EDuration="4.277277378s" totalImagesPullingTime="2.62121063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:48:00.27544581 +0000 UTC m=+516.034253795" watchObservedRunningTime="2026-09-18 19:48:00.277277378 +0000 UTC m=+516.036085357"
Sep 18 19:48:00.293939 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.293867    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw" podStartSLOduration=1.071110434 podStartE2EDuration="4.293852581s" totalImagesPullingTime="3.222742147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:48:00.293236978 +0000 UTC m=+516.052044964" watchObservedRunningTime="2026-09-18 19:48:00.293852581 +0000 UTC m=+516.052660643"
Sep 18 19:48:00.443164 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:00.443128    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" path="/var/lib/kubelet/pods/df78c84b-44be-4ec6-ac08-33a1d7af0531/volumes"
Sep 18 19:48:03.166623 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:03.166586    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-862d2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.20:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 19:48:03.167053 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:03.166653    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.20:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 19:48:03.219300 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:03.219272    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jrczj"
Sep 18 19:48:03.221551 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:03.221531    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-568sq"
Sep 18 19:48:31.266115 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:31.266088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k8sbw"
Sep 18 19:48:31.269059 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:48:31.269038    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pvf8l"
Sep 18 19:49:06.768584 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.768552    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"]
Sep 18 19:49:06.769022 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.768847    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerName="discovery"
Sep 18 19:49:06.769022 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.768857    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerName="discovery"
Sep 18 19:49:06.769022 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.768945    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="df78c84b-44be-4ec6-ac08-33a1d7af0531" containerName="discovery"
Sep 18 19:49:06.770867 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.770850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:06.774458 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.774436    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 19:49:06.775732 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.775719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 19:49:06.776935 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.776700    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2wh2f\""
Sep 18 19:49:06.787105 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.787080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"]
Sep 18 19:49:06.929084 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.929047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmsmp\" (UniqueName: \"kubernetes.io/projected/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-kube-api-access-dmsmp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:06.929251 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:06.929112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:07.030216 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.030138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:07.030216 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.030202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmsmp\" (UniqueName: \"kubernetes.io/projected/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-kube-api-access-dmsmp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:07.030519 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.030498    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:07.040746 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.040727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmsmp\" (UniqueName: \"kubernetes.io/projected/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-kube-api-access-dmsmp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:07.082759 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.082719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:07.373465 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.373442    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"]
Sep 18 19:49:07.374530 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:07.374507    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c1efcd_4794_4033_bdc9_7977c9fd31ca.slice/crio-660ddd2b8bb70d5ec482b35e141c08792727a319e846e83d87ad6d59067ee50e WatchSource:0}: Error finding container 660ddd2b8bb70d5ec482b35e141c08792727a319e846e83d87ad6d59067ee50e: Status 404 returned error can't find the container with id 660ddd2b8bb70d5ec482b35e141c08792727a319e846e83d87ad6d59067ee50e
Sep 18 19:49:07.541578 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:07.541541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp" event={"ID":"f0c1efcd-4794-4033-bdc9-7977c9fd31ca","Type":"ContainerStarted","Data":"660ddd2b8bb70d5ec482b35e141c08792727a319e846e83d87ad6d59067ee50e"}
Sep 18 19:49:08.719441 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.719385    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"]
Sep 18 19:49:08.721855 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.721822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:08.725545 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.725520    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 18 19:49:08.725664 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.725547    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bwml9\""
Sep 18 19:49:08.754506 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.754435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"]
Sep 18 19:49:08.845754 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.845720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zvgb\" (UniqueName: \"kubernetes.io/projected/a7cbbbb0-0856-4998-8b9c-b88a983ec836-kube-api-access-2zvgb\") pod \"dns-operator-controller-manager-7b84cd7c9c-4wmcc\" (UID: \"a7cbbbb0-0856-4998-8b9c-b88a983ec836\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:08.947107 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.947071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zvgb\" (UniqueName: \"kubernetes.io/projected/a7cbbbb0-0856-4998-8b9c-b88a983ec836-kube-api-access-2zvgb\") pod \"dns-operator-controller-manager-7b84cd7c9c-4wmcc\" (UID: \"a7cbbbb0-0856-4998-8b9c-b88a983ec836\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:08.959405 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:08.959364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zvgb\" (UniqueName: \"kubernetes.io/projected/a7cbbbb0-0856-4998-8b9c-b88a983ec836-kube-api-access-2zvgb\") pod \"dns-operator-controller-manager-7b84cd7c9c-4wmcc\" (UID: \"a7cbbbb0-0856-4998-8b9c-b88a983ec836\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:09.035561 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:09.035476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:10.046421 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:10.046372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"]
Sep 18 19:49:10.048427 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:10.048402    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cbbbb0_0856_4998_8b9c_b88a983ec836.slice/crio-705eead3d2b83370e643961ceea53dc0e5635d718b4df44933a8d2ee1a25a68d WatchSource:0}: Error finding container 705eead3d2b83370e643961ceea53dc0e5635d718b4df44933a8d2ee1a25a68d: Status 404 returned error can't find the container with id 705eead3d2b83370e643961ceea53dc0e5635d718b4df44933a8d2ee1a25a68d
Sep 18 19:49:10.560992 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:10.560957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc" event={"ID":"a7cbbbb0-0856-4998-8b9c-b88a983ec836","Type":"ContainerStarted","Data":"705eead3d2b83370e643961ceea53dc0e5635d718b4df44933a8d2ee1a25a68d"}
Sep 18 19:49:11.309924 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.309893    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8t6h8"]
Sep 18 19:49:11.312247 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.312230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:11.314519 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.314500    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znbzc\""
Sep 18 19:49:11.322625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.322604    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8t6h8"]
Sep 18 19:49:11.470472 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.470437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrzm\" (UniqueName: \"kubernetes.io/projected/7aeee20b-0d44-481c-a743-dc8a7aa25db8-kube-api-access-rcrzm\") pod \"authorino-operator-76b478bd78-8t6h8\" (UID: \"7aeee20b-0d44-481c-a743-dc8a7aa25db8\") " pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:11.569354 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.569269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp" event={"ID":"f0c1efcd-4794-4033-bdc9-7977c9fd31ca","Type":"ContainerStarted","Data":"27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804"}
Sep 18 19:49:11.569521 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.569390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:11.570960 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.570935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrzm\" (UniqueName: \"kubernetes.io/projected/7aeee20b-0d44-481c-a743-dc8a7aa25db8-kube-api-access-rcrzm\") pod \"authorino-operator-76b478bd78-8t6h8\" (UID: \"7aeee20b-0d44-481c-a743-dc8a7aa25db8\") " pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:11.580030 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.579996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrzm\" (UniqueName: \"kubernetes.io/projected/7aeee20b-0d44-481c-a743-dc8a7aa25db8-kube-api-access-rcrzm\") pod \"authorino-operator-76b478bd78-8t6h8\" (UID: \"7aeee20b-0d44-481c-a743-dc8a7aa25db8\") " pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:11.590242 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.590193    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp" podStartSLOduration=1.615125631 podStartE2EDuration="5.590172794s" totalImagesPullingTime="3.975047163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:11.589599956 +0000 UTC m=+587.348407943" watchObservedRunningTime="2026-09-18 19:49:11.590172794 +0000 UTC m=+587.348980780"
Sep 18 19:49:11.624896 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.624853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:11.917992 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:11.917860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-8t6h8"]
Sep 18 19:49:12.206592 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:12.206562    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aeee20b_0d44_481c_a743_dc8a7aa25db8.slice/crio-86145eb2f380dd32cf463aadaa5ac36f6e00d245cfcfb754c35cdc08c9112abd WatchSource:0}: Error finding container 86145eb2f380dd32cf463aadaa5ac36f6e00d245cfcfb754c35cdc08c9112abd: Status 404 returned error can't find the container with id 86145eb2f380dd32cf463aadaa5ac36f6e00d245cfcfb754c35cdc08c9112abd
Sep 18 19:49:12.575718 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:12.575617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc" event={"ID":"a7cbbbb0-0856-4998-8b9c-b88a983ec836","Type":"ContainerStarted","Data":"50c8e255e5762142e81f966779dc7173a37233add25fb380fd846e87227089f6"}
Sep 18 19:49:12.576169 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:12.575790    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:12.576906 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:12.576868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8" event={"ID":"7aeee20b-0d44-481c-a743-dc8a7aa25db8","Type":"ContainerStarted","Data":"86145eb2f380dd32cf463aadaa5ac36f6e00d245cfcfb754c35cdc08c9112abd"}
Sep 18 19:49:12.597492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:12.597441    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc" podStartSLOduration=2.408840427 podStartE2EDuration="4.597425791s" totalImagesPullingTime="2.188585364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:12.596177093 +0000 UTC m=+588.354985077" watchObservedRunningTime="2026-09-18 19:49:12.597425791 +0000 UTC m=+588.356233776"
Sep 18 19:49:13.745253 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:13.745212    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"]
Sep 18 19:49:13.747787 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:13.747765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:13.751395 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:13.751376    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f6w7j\""
Sep 18 19:49:13.760113 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:13.760089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"]
Sep 18 19:49:13.891847 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:13.891757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsd9p\" (UniqueName: \"kubernetes.io/projected/7d017087-1cfb-49dc-be7b-355bee47276d-kube-api-access-xsd9p\") pod \"limitador-operator-controller-manager-74495c69f8-zxs45\" (UID: \"7d017087-1cfb-49dc-be7b-355bee47276d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:13.992263 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:13.992223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsd9p\" (UniqueName: \"kubernetes.io/projected/7d017087-1cfb-49dc-be7b-355bee47276d-kube-api-access-xsd9p\") pod \"limitador-operator-controller-manager-74495c69f8-zxs45\" (UID: \"7d017087-1cfb-49dc-be7b-355bee47276d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:14.001553 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.001521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsd9p\" (UniqueName: \"kubernetes.io/projected/7d017087-1cfb-49dc-be7b-355bee47276d-kube-api-access-xsd9p\") pod \"limitador-operator-controller-manager-74495c69f8-zxs45\" (UID: \"7d017087-1cfb-49dc-be7b-355bee47276d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:14.058324 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.058286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:14.328945 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.328908    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"]
Sep 18 19:49:14.333905 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:14.333858    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d017087_1cfb_49dc_be7b_355bee47276d.slice/crio-e63a4d3f8eca1bdc6077c6cc9f2cb8cbf040cf02abac55a36fecec9d7d08502a WatchSource:0}: Error finding container e63a4d3f8eca1bdc6077c6cc9f2cb8cbf040cf02abac55a36fecec9d7d08502a: Status 404 returned error can't find the container with id e63a4d3f8eca1bdc6077c6cc9f2cb8cbf040cf02abac55a36fecec9d7d08502a
Sep 18 19:49:14.574194 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.574158    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"]
Sep 18 19:49:14.577231 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.577211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.580330 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.580263    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 18 19:49:14.581208 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.581186    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 18 19:49:14.588231 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.588207    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vg27v\""
Sep 18 19:49:14.589831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.589804    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45" event={"ID":"7d017087-1cfb-49dc-be7b-355bee47276d","Type":"ContainerStarted","Data":"e63a4d3f8eca1bdc6077c6cc9f2cb8cbf040cf02abac55a36fecec9d7d08502a"}
Sep 18 19:49:14.591615 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.591585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8" event={"ID":"7aeee20b-0d44-481c-a743-dc8a7aa25db8","Type":"ContainerStarted","Data":"a6337be93914bae2f6d9c46abf8574ef9fd0b4b2b0895a910e3107c78889f418"}
Sep 18 19:49:14.591737 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.591720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:14.596457 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.596435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"]
Sep 18 19:49:14.643267 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.643217    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8" podStartSLOduration=2.283307044 podStartE2EDuration="3.643198445s" totalImagesPullingTime="1.359891401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:14.642613858 +0000 UTC m=+590.401421852" watchObservedRunningTime="2026-09-18 19:49:14.643198445 +0000 UTC m=+590.402006429"
Sep 18 19:49:14.700024 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.699983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcd2s\" (UniqueName: \"kubernetes.io/projected/5885de6d-72cd-4cea-bf05-3810faff97f6-kube-api-access-zcd2s\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.700213 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.700068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5885de6d-72cd-4cea-bf05-3810faff97f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.700213 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.700159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5885de6d-72cd-4cea-bf05-3810faff97f6-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.800576 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.800543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcd2s\" (UniqueName: \"kubernetes.io/projected/5885de6d-72cd-4cea-bf05-3810faff97f6-kube-api-access-zcd2s\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.800576 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.800583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5885de6d-72cd-4cea-bf05-3810faff97f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.801001 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.800613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5885de6d-72cd-4cea-bf05-3810faff97f6-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.801001 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:14.800703    2582 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 18 19:49:14.801001 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:14.800773    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5885de6d-72cd-4cea-bf05-3810faff97f6-plugin-serving-cert podName:5885de6d-72cd-4cea-bf05-3810faff97f6 nodeName:}" failed. No retries permitted until 2026-09-18 19:49:15.300754225 +0000 UTC m=+591.059562200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5885de6d-72cd-4cea-bf05-3810faff97f6-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-5m79x" (UID: "5885de6d-72cd-4cea-bf05-3810faff97f6") : secret "plugin-serving-cert" not found
Sep 18 19:49:14.801230 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.801214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5885de6d-72cd-4cea-bf05-3810faff97f6-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:14.809514 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:14.809495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcd2s\" (UniqueName: \"kubernetes.io/projected/5885de6d-72cd-4cea-bf05-3810faff97f6-kube-api-access-zcd2s\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:15.305782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:15.305740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5885de6d-72cd-4cea-bf05-3810faff97f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:15.308518 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:15.308489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5885de6d-72cd-4cea-bf05-3810faff97f6-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5m79x\" (UID: \"5885de6d-72cd-4cea-bf05-3810faff97f6\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:15.487664 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:15.487631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"
Sep 18 19:49:15.758258 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:15.758089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x"]
Sep 18 19:49:15.760705 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:15.760671    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5885de6d_72cd_4cea_bf05_3810faff97f6.slice/crio-c375fb62092d09883e938172a8ca3ebbce23625779acb1fe831e57a55840ed40 WatchSource:0}: Error finding container c375fb62092d09883e938172a8ca3ebbce23625779acb1fe831e57a55840ed40: Status 404 returned error can't find the container with id c375fb62092d09883e938172a8ca3ebbce23625779acb1fe831e57a55840ed40
Sep 18 19:49:16.604826 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:16.604788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45" event={"ID":"7d017087-1cfb-49dc-be7b-355bee47276d","Type":"ContainerStarted","Data":"df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5"}
Sep 18 19:49:16.605602 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:16.605581    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:16.607165 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:16.607140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x" event={"ID":"5885de6d-72cd-4cea-bf05-3810faff97f6","Type":"ContainerStarted","Data":"c375fb62092d09883e938172a8ca3ebbce23625779acb1fe831e57a55840ed40"}
Sep 18 19:49:16.622522 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:16.622456    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45" podStartSLOduration=1.814314467 podStartE2EDuration="3.622435631s" totalImagesPullingTime="1.808121164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:16.621403802 +0000 UTC m=+592.380211788" watchObservedRunningTime="2026-09-18 19:49:16.622435631 +0000 UTC m=+592.381243618"
Sep 18 19:49:20.628237 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:20.628197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x" event={"ID":"5885de6d-72cd-4cea-bf05-3810faff97f6","Type":"ContainerStarted","Data":"90f7a6e1e34356ff8776384148d7cc0935284e98f6b648fce3c7a9c1f28daf26"}
Sep 18 19:49:20.644246 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:20.644200    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5m79x" podStartSLOduration=2.241671819 podStartE2EDuration="6.644186348s" totalImagesPullingTime="4.402514529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:20.642195918 +0000 UTC m=+596.401003928" watchObservedRunningTime="2026-09-18 19:49:20.644186348 +0000 UTC m=+596.402994334"
Sep 18 19:49:22.579039 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:22.579009    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:23.585492 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:23.585465    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4wmcc"
Sep 18 19:49:24.710715 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.710682    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"]
Sep 18 19:49:24.711105 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.710860    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" containerName="manager" containerID="cri-o://27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804" gracePeriod=2
Sep 18 19:49:24.720202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.720177    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"]
Sep 18 19:49:24.737358 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.737332    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"]
Sep 18 19:49:24.737563 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.737499    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" containerName="manager" containerID="cri-o://df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5" gracePeriod=2
Sep 18 19:49:24.739811 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.739790    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.741243 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.741209    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:24.741574 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.741548    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"]
Sep 18 19:49:24.743496 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.743472    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.745701 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.745670    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:24.747813 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.747783    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.750347 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.750326    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"]
Sep 18 19:49:24.750836 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.750817    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" containerName="manager"
Sep 18 19:49:24.750893 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.750843    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" containerName="manager"
Sep 18 19:49:24.750893 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.750858    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" containerName="manager"
Sep 18 19:49:24.750893 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.750867    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" containerName="manager"
Sep 18 19:49:24.750997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.750985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" containerName="manager"
Sep 18 19:49:24.751030 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.751005    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" containerName="manager"
Sep 18 19:49:24.755511 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.755494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.769825 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.769800    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"]
Sep 18 19:49:24.788403 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.788381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11376cf5-d5c1-43b2-a3f4-8fccdb354164-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dk96v\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.788537 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.788463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvdwf\" (UniqueName: \"kubernetes.io/projected/11376cf5-d5c1-43b2-a3f4-8fccdb354164-kube-api-access-bvdwf\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dk96v\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.801315 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.801284    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:24.803642 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.803618    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.889137 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.889106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvdwf\" (UniqueName: \"kubernetes.io/projected/11376cf5-d5c1-43b2-a3f4-8fccdb354164-kube-api-access-bvdwf\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dk96v\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.889293 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.889163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11376cf5-d5c1-43b2-a3f4-8fccdb354164-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dk96v\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.889571 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.889546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11376cf5-d5c1-43b2-a3f4-8fccdb354164-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dk96v\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.898002 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.897973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvdwf\" (UniqueName: \"kubernetes.io/projected/11376cf5-d5c1-43b2-a3f4-8fccdb354164-kube-api-access-bvdwf\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dk96v\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:24.967991 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.967943    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:24.970215 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.970190    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:24.970604 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.970588    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.972443 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.972421    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.974639 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.974618    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:24.976709 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:24.976687    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:24.989636 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.989614    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmsmp\" (UniqueName: \"kubernetes.io/projected/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-kube-api-access-dmsmp\") pod \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") "
Sep 18 19:49:24.989726 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.989648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-extensions-socket-volume\") pod \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\" (UID: \"f0c1efcd-4794-4033-bdc9-7977c9fd31ca\") "
Sep 18 19:49:24.990148 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.990127    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f0c1efcd-4794-4033-bdc9-7977c9fd31ca" (UID: "f0c1efcd-4794-4033-bdc9-7977c9fd31ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:49:24.991806 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:24.991779    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-kube-api-access-dmsmp" (OuterVolumeSpecName: "kube-api-access-dmsmp") pod "f0c1efcd-4794-4033-bdc9-7977c9fd31ca" (UID: "f0c1efcd-4794-4033-bdc9-7977c9fd31ca"). InnerVolumeSpecName "kube-api-access-dmsmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:49:25.090165 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.090128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsd9p\" (UniqueName: \"kubernetes.io/projected/7d017087-1cfb-49dc-be7b-355bee47276d-kube-api-access-xsd9p\") pod \"7d017087-1cfb-49dc-be7b-355bee47276d\" (UID: \"7d017087-1cfb-49dc-be7b-355bee47276d\") "
Sep 18 19:49:25.090323 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.090259    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmsmp\" (UniqueName: \"kubernetes.io/projected/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-kube-api-access-dmsmp\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:49:25.090323 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.090270    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0c1efcd-4794-4033-bdc9-7977c9fd31ca-extensions-socket-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:49:25.092307 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.092284    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d017087-1cfb-49dc-be7b-355bee47276d-kube-api-access-xsd9p" (OuterVolumeSpecName: "kube-api-access-xsd9p") pod "7d017087-1cfb-49dc-be7b-355bee47276d" (UID: "7d017087-1cfb-49dc-be7b-355bee47276d"). InnerVolumeSpecName "kube-api-access-xsd9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:49:25.144464 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.144438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:25.190848 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.190804    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsd9p\" (UniqueName: \"kubernetes.io/projected/7d017087-1cfb-49dc-be7b-355bee47276d-kube-api-access-xsd9p\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:49:25.436222 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.436197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"]
Sep 18 19:49:25.438683 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:25.438660    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11376cf5_d5c1_43b2_a3f4_8fccdb354164.slice/crio-f495893257bfe44522fc07e4e5c50aa59fb57ab076e6adac1d64ab53db4a569d WatchSource:0}: Error finding container f495893257bfe44522fc07e4e5c50aa59fb57ab076e6adac1d64ab53db4a569d: Status 404 returned error can't find the container with id f495893257bfe44522fc07e4e5c50aa59fb57ab076e6adac1d64ab53db4a569d
Sep 18 19:49:25.599009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.598986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-8t6h8"
Sep 18 19:49:25.601565 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.601534    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.622371 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.622341    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.653682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.653654    2582 generic.go:356] "Generic (PLEG): container finished" podID="7d017087-1cfb-49dc-be7b-355bee47276d" containerID="df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5" exitCode=0
Sep 18 19:49:25.653816 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.653698    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.653816 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.653773    2582 scope.go:117] "RemoveContainer" containerID="df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5"
Sep 18 19:49:25.655590 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.655567    2582 generic.go:356] "Generic (PLEG): container finished" podID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" containerID="27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804" exitCode=0
Sep 18 19:49:25.655705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.655607    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.656440 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.656414    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.659668 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.658489    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.665130 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.661117    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.665130 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.663275    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.665130 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.663699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v" event={"ID":"11376cf5-d5c1-43b2-a3f4-8fccdb354164","Type":"ContainerStarted","Data":"ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee"}
Sep 18 19:49:25.665130 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.663788    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v" event={"ID":"11376cf5-d5c1-43b2-a3f4-8fccdb354164","Type":"ContainerStarted","Data":"f495893257bfe44522fc07e4e5c50aa59fb57ab076e6adac1d64ab53db4a569d"}
Sep 18 19:49:25.665130 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.664002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:25.666544 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.666496    2582 scope.go:117] "RemoveContainer" containerID="df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5"
Sep 18 19:49:25.667007 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.666968    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5\": container with ID starting with df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5 not found: ID does not exist" containerID="df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5"
Sep 18 19:49:25.667115 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.667016    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5"} err="failed to get container status \"df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5\": rpc error: code = NotFound desc = could not find container \"df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5\": container with ID starting with df1ec73073eca00101f1c650b0772b336f59cdbe71716a36c5691f6882a5bcb5 not found: ID does not exist"
Sep 18 19:49:25.667115 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.667040    2582 scope.go:117] "RemoveContainer" containerID="27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804"
Sep 18 19:49:25.676537 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.676520    2582 scope.go:117] "RemoveContainer" containerID="27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804"
Sep 18 19:49:25.676789 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.676770    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804\": container with ID starting with 27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804 not found: ID does not exist" containerID="27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804"
Sep 18 19:49:25.676849 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.676801    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804"} err="failed to get container status \"27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804\": rpc error: code = NotFound desc = could not find container \"27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804\": container with ID starting with 27e221aed44ed2ba15f35d9822ecc0f3df45b78430008922cc2390d736e9c804 not found: ID does not exist"
Sep 18 19:49:25.685733 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.685670    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v" podStartSLOduration=1.685658032 podStartE2EDuration="1.685658032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:25.683658581 +0000 UTC m=+601.442466567" watchObservedRunningTime="2026-09-18 19:49:25.685658032 +0000 UTC m=+601.444466017"
Sep 18 19:49:25.686025 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.686004    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.688106 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.688085    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.690127 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.690108    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.692345 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.692322    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.889791 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.889754    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"]
Sep 18 19:49:25.892932 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.892912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:25.895332 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.895302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb621e7-0df2-4354-a7fd-3b58417ee48e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mwv2k\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:25.895447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.895379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb2mr\" (UniqueName: \"kubernetes.io/projected/4fb621e7-0df2-4354-a7fd-3b58417ee48e-kube-api-access-xb2mr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mwv2k\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:25.896645 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.896618    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:25.898975 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:25.898938    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:25.908236 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.908216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"]
Sep 18 19:49:25.996099 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.996011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb2mr\" (UniqueName: \"kubernetes.io/projected/4fb621e7-0df2-4354-a7fd-3b58417ee48e-kube-api-access-xb2mr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mwv2k\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:25.996237 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.996103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb621e7-0df2-4354-a7fd-3b58417ee48e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mwv2k\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:25.996454 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:25.996438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb621e7-0df2-4354-a7fd-3b58417ee48e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mwv2k\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:26.009413 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.009391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb2mr\" (UniqueName: \"kubernetes.io/projected/4fb621e7-0df2-4354-a7fd-3b58417ee48e-kube-api-access-xb2mr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mwv2k\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:26.203012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.202985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:26.371702 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.371604    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:49:26.395537 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.372006    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:49:26.395537 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.376479    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:49:26.395537 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.376656    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:49:26.438664 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:26.438627    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-8sxpp\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-8sxpp"
Sep 18 19:49:26.440105 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.440084    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" path="/var/lib/kubelet/pods/7d017087-1cfb-49dc-be7b-355bee47276d/volumes"
Sep 18 19:49:26.440439 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.440427    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c1efcd-4794-4033-bdc9-7977c9fd31ca" path="/var/lib/kubelet/pods/f0c1efcd-4794-4033-bdc9-7977c9fd31ca/volumes"
Sep 18 19:49:26.440853 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:26.440833    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-zxs45\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="7d017087-1cfb-49dc-be7b-355bee47276d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zxs45"
Sep 18 19:49:26.486555 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.486532    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"]
Sep 18 19:49:26.669744 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.669707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" event={"ID":"4fb621e7-0df2-4354-a7fd-3b58417ee48e","Type":"ContainerStarted","Data":"f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"}
Sep 18 19:49:26.669953 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.669765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" event={"ID":"4fb621e7-0df2-4354-a7fd-3b58417ee48e","Type":"ContainerStarted","Data":"c6544938d2b4d8dc7bde54f9f74b58a46afec78cfe7b8105325ef623d0347b24"}
Sep 18 19:49:26.669953 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.669950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:26.692232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:26.692185    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" podStartSLOduration=1.692171039 podStartE2EDuration="1.692171039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:26.691229982 +0000 UTC m=+602.450037967" watchObservedRunningTime="2026-09-18 19:49:26.692171039 +0000 UTC m=+602.450979024"
Sep 18 19:49:30.911511 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.911477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b65476695-zgh79"]
Sep 18 19:49:30.917513 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.917487    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.920295 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.920277    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 19:49:30.921444 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.921424    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 19:49:30.921578 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.921553    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 19:49:30.921709 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.921511    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 19:49:30.921709 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.921515    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 19:49:30.921826 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.921561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 19:49:30.921826 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.921435    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbqz6\""
Sep 18 19:49:30.922062 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.922040    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 19:49:30.927775 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.927758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 19:49:30.928237 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.928221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65476695-zgh79"]
Sep 18 19:49:30.938714 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-trusted-ca-bundle\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.938831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-config\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.938831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbff\" (UniqueName: \"kubernetes.io/projected/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-kube-api-access-lkbff\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.938831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-serving-cert\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.939009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-service-ca\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.939009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-oauth-serving-cert\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:30.939009 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:30.938948    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-oauth-config\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039679 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-trusted-ca-bundle\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-config\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbff\" (UniqueName: \"kubernetes.io/projected/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-kube-api-access-lkbff\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-serving-cert\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-service-ca\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-oauth-serving-cert\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.039862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.039796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-oauth-config\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.040906 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.040852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-config\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.041017 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.040915    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-oauth-serving-cert\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.041079 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.041056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-service-ca\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.041214 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.041191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-trusted-ca-bundle\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.042575 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.042549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-serving-cert\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.042652 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.042549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-console-oauth-config\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.047703 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.047680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbff\" (UniqueName: \"kubernetes.io/projected/9a485fc1-ee69-4c5d-89ea-ebec3e5e5769-kube-api-access-lkbff\") pod \"console-b65476695-zgh79\" (UID: \"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769\") " pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.229679 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.229650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:31.507471 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.507448    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65476695-zgh79"]
Sep 18 19:49:31.693276 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.693240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65476695-zgh79" event={"ID":"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769","Type":"ContainerStarted","Data":"1911e30a87656e14e15732c0b3bccc3d99df0bfa104d9698c4d84127a8b2b24b"}
Sep 18 19:49:31.693447 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.693331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65476695-zgh79" event={"ID":"9a485fc1-ee69-4c5d-89ea-ebec3e5e5769","Type":"ContainerStarted","Data":"e0c0201ae52512d7a16359a301d82bc400f1230e5c68fb9519cd01d801698bb9"}
Sep 18 19:49:31.712889 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:31.712832    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b65476695-zgh79" podStartSLOduration=1.7128159090000001 podStartE2EDuration="1.712815909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:31.710590537 +0000 UTC m=+607.469398524" watchObservedRunningTime="2026-09-18 19:49:31.712815909 +0000 UTC m=+607.471623894"
Sep 18 19:49:36.671922 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:36.671830    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:37.677114 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:37.677078    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 19:49:37.738069 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:37.738037    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"]
Sep 18 19:49:37.738304 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:37.738275    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v" podUID="11376cf5-d5c1-43b2-a3f4-8fccdb354164" containerName="manager" containerID="cri-o://ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee" gracePeriod=10
Sep 18 19:49:38.505793 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.505768    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:38.606076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.606044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvdwf\" (UniqueName: \"kubernetes.io/projected/11376cf5-d5c1-43b2-a3f4-8fccdb354164-kube-api-access-bvdwf\") pod \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") "
Sep 18 19:49:38.606261 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.606124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11376cf5-d5c1-43b2-a3f4-8fccdb354164-extensions-socket-volume\") pod \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\" (UID: \"11376cf5-d5c1-43b2-a3f4-8fccdb354164\") "
Sep 18 19:49:38.606468 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.606447    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11376cf5-d5c1-43b2-a3f4-8fccdb354164-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "11376cf5-d5c1-43b2-a3f4-8fccdb354164" (UID: "11376cf5-d5c1-43b2-a3f4-8fccdb354164"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:49:38.608282 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.608264    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11376cf5-d5c1-43b2-a3f4-8fccdb354164-kube-api-access-bvdwf" (OuterVolumeSpecName: "kube-api-access-bvdwf") pod "11376cf5-d5c1-43b2-a3f4-8fccdb354164" (UID: "11376cf5-d5c1-43b2-a3f4-8fccdb354164"). InnerVolumeSpecName "kube-api-access-bvdwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:49:38.707160 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.707124    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvdwf\" (UniqueName: \"kubernetes.io/projected/11376cf5-d5c1-43b2-a3f4-8fccdb354164-kube-api-access-bvdwf\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:49:38.707160 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.707150    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11376cf5-d5c1-43b2-a3f4-8fccdb354164-extensions-socket-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:49:38.733112 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.733077    2582 generic.go:356] "Generic (PLEG): container finished" podID="11376cf5-d5c1-43b2-a3f4-8fccdb354164" containerID="ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee" exitCode=0
Sep 18 19:49:38.733255 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.733135    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"
Sep 18 19:49:38.733255 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.733163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v" event={"ID":"11376cf5-d5c1-43b2-a3f4-8fccdb354164","Type":"ContainerDied","Data":"ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee"}
Sep 18 19:49:38.733255 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.733232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v" event={"ID":"11376cf5-d5c1-43b2-a3f4-8fccdb354164","Type":"ContainerDied","Data":"f495893257bfe44522fc07e4e5c50aa59fb57ab076e6adac1d64ab53db4a569d"}
Sep 18 19:49:38.733255 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.733254    2582 scope.go:117] "RemoveContainer" containerID="ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee"
Sep 18 19:49:38.754093 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.753914    2582 scope.go:117] "RemoveContainer" containerID="ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee"
Sep 18 19:49:38.754234 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:49:38.754216    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee\": container with ID starting with ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee not found: ID does not exist" containerID="ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee"
Sep 18 19:49:38.754279 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.754243    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee"} err="failed to get container status \"ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee\": rpc error: code = NotFound desc = could not find container \"ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee\": container with ID starting with ce4556e37d2a6c284a1af675c957d2ac8439f31fa0d591ce44f5a0730d7b7fee not found: ID does not exist"
Sep 18 19:49:38.766179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.766158    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"]
Sep 18 19:49:38.770582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:38.770561    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dk96v"]
Sep 18 19:49:40.440392 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:40.440353    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11376cf5-d5c1-43b2-a3f4-8fccdb354164" path="/var/lib/kubelet/pods/11376cf5-d5c1-43b2-a3f4-8fccdb354164/volumes"
Sep 18 19:49:41.230062 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:41.230030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:41.230236 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:41.230121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:41.234822 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:41.234799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:41.753167 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:41.753143    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b65476695-zgh79"
Sep 18 19:49:54.035137 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.035037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"]
Sep 18 19:49:54.035624 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.035479    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11376cf5-d5c1-43b2-a3f4-8fccdb354164" containerName="manager"
Sep 18 19:49:54.035624 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.035499    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="11376cf5-d5c1-43b2-a3f4-8fccdb354164" containerName="manager"
Sep 18 19:49:54.035624 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.035588    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="11376cf5-d5c1-43b2-a3f4-8fccdb354164" containerName="manager"
Sep 18 19:49:54.037790 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.037768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.040767 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.040748    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 19:49:54.040870 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.040805    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pvj2s\""
Sep 18 19:49:54.049618 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.049590    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"]
Sep 18 19:49:54.137915 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.137858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.137922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.137955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.137985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.138062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.138111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.138158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dzq\" (UniqueName: \"kubernetes.io/projected/e36cb668-95dc-42e7-9682-1adc97a8ba0f-kube-api-access-47dzq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138333 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.138212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.138333 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.138263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239335 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239729 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239729 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239729 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47dzq\" (UniqueName: \"kubernetes.io/projected/e36cb668-95dc-42e7-9682-1adc97a8ba0f-kube-api-access-47dzq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239935 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239935 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.239935 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.239867    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.240054 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.240024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.240214 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.240196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.242005 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.241988    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.242065 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.242049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.247632 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.247610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e36cb668-95dc-42e7-9682-1adc97a8ba0f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.248004 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.247983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dzq\" (UniqueName: \"kubernetes.io/projected/e36cb668-95dc-42e7-9682-1adc97a8ba0f-kube-api-access-47dzq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-lzj5s\" (UID: \"e36cb668-95dc-42e7-9682-1adc97a8ba0f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.348357 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.348293    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:54.620463 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.620416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"]
Sep 18 19:49:54.622609 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:54.622582    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36cb668_95dc_42e7_9682_1adc97a8ba0f.slice/crio-fbe4ef362f55dd2a288f78d83db1e164a2a84b7a10b34ef951c6bfd6bf31082b WatchSource:0}: Error finding container fbe4ef362f55dd2a288f78d83db1e164a2a84b7a10b34ef951c6bfd6bf31082b: Status 404 returned error can't find the container with id fbe4ef362f55dd2a288f78d83db1e164a2a84b7a10b34ef951c6bfd6bf31082b
Sep 18 19:49:54.624684 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.624670    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:49:54.808234 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:54.808201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" event={"ID":"e36cb668-95dc-42e7-9682-1adc97a8ba0f","Type":"ContainerStarted","Data":"fbe4ef362f55dd2a288f78d83db1e164a2a84b7a10b34ef951c6bfd6bf31082b"}
Sep 18 19:49:57.135833 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:57.135804    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:49:57.136119 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:57.135894    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:49:57.136119 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:57.135923    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:49:57.826493 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:57.826461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" event={"ID":"e36cb668-95dc-42e7-9682-1adc97a8ba0f","Type":"ContainerStarted","Data":"0cbec7dc06db1cb388b74d99c4e448170db7b8ab0b1b319387bdb5a27ce281af"}
Sep 18 19:49:57.851977 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:57.851930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" podStartSLOduration=1.34115647 podStartE2EDuration="3.851915161s" totalImagesPullingTime="2.510758691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:49:57.851347744 +0000 UTC m=+633.610155732" watchObservedRunningTime="2026-09-18 19:49:57.851915161 +0000 UTC m=+633.610723143"
Sep 18 19:49:58.348950 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.348917    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:58.354083 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.354063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:58.831805 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.831772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:58.832749 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.832728    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:49:58.860025 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.859997    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:49:58.862740 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.862723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:58.865669 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.865648    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 19:49:58.878771 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.878743    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:49:58.963124 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.963085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:49:58.980290 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.980259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6pbr\" (UniqueName: \"kubernetes.io/projected/8049b98c-fca1-4717-b943-27dd3d2150fd-kube-api-access-v6pbr\") pod \"limitador-limitador-8588749977-5g59x\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") " pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:58.980482 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:58.980463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8049b98c-fca1-4717-b943-27dd3d2150fd-config-file\") pod \"limitador-limitador-8588749977-5g59x\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") " pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:59.081002 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.080969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8049b98c-fca1-4717-b943-27dd3d2150fd-config-file\") pod \"limitador-limitador-8588749977-5g59x\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") " pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:59.081194 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.081044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6pbr\" (UniqueName: \"kubernetes.io/projected/8049b98c-fca1-4717-b943-27dd3d2150fd-kube-api-access-v6pbr\") pod \"limitador-limitador-8588749977-5g59x\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") " pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:59.081913 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.081810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8049b98c-fca1-4717-b943-27dd3d2150fd-config-file\") pod \"limitador-limitador-8588749977-5g59x\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") " pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:59.089383 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.089360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6pbr\" (UniqueName: \"kubernetes.io/projected/8049b98c-fca1-4717-b943-27dd3d2150fd-kube-api-access-v6pbr\") pod \"limitador-limitador-8588749977-5g59x\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") " pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:59.173391 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.173359    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:49:59.447102 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.447076    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:49:59.448729 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:49:59.448701    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8049b98c_fca1_4717_b943_27dd3d2150fd.slice/crio-a9650f4a2c09dfca06235e8b6c004fcc3bf97b1319044cdf7d777da4effffb89 WatchSource:0}: Error finding container a9650f4a2c09dfca06235e8b6c004fcc3bf97b1319044cdf7d777da4effffb89: Status 404 returned error can't find the container with id a9650f4a2c09dfca06235e8b6c004fcc3bf97b1319044cdf7d777da4effffb89
Sep 18 19:49:59.676076 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.676040    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zk97s"]
Sep 18 19:49:59.679135 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.679082    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:49:59.681653 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.681631    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fssg2\""
Sep 18 19:49:59.688400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.688380    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zk97s"]
Sep 18 19:49:59.788024 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.787948    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgrw\" (UniqueName: \"kubernetes.io/projected/4b14a9d9-4001-46b1-9df1-73e0b15e6c83-kube-api-access-hkgrw\") pod \"authorino-7bcfd8f9cd-zk97s\" (UID: \"4b14a9d9-4001-46b1-9df1-73e0b15e6c83\") " pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:49:59.837201 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.837165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5g59x" event={"ID":"8049b98c-fca1-4717-b943-27dd3d2150fd","Type":"ContainerStarted","Data":"a9650f4a2c09dfca06235e8b6c004fcc3bf97b1319044cdf7d777da4effffb89"}
Sep 18 19:49:59.888770 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.888739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgrw\" (UniqueName: \"kubernetes.io/projected/4b14a9d9-4001-46b1-9df1-73e0b15e6c83-kube-api-access-hkgrw\") pod \"authorino-7bcfd8f9cd-zk97s\" (UID: \"4b14a9d9-4001-46b1-9df1-73e0b15e6c83\") " pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:49:59.897720 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.897690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgrw\" (UniqueName: \"kubernetes.io/projected/4b14a9d9-4001-46b1-9df1-73e0b15e6c83-kube-api-access-hkgrw\") pod \"authorino-7bcfd8f9cd-zk97s\" (UID: \"4b14a9d9-4001-46b1-9df1-73e0b15e6c83\") " pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:49:59.989858 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:49:59.989826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:50:00.256213 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:00.256163    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zk97s"]
Sep 18 19:50:00.259556 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:50:00.259518    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b14a9d9_4001_46b1_9df1_73e0b15e6c83.slice/crio-7c5781b0a46248703cee41619fc95f7a90123a6ca30b6f191da5c9ef12dff4b4 WatchSource:0}: Error finding container 7c5781b0a46248703cee41619fc95f7a90123a6ca30b6f191da5c9ef12dff4b4: Status 404 returned error can't find the container with id 7c5781b0a46248703cee41619fc95f7a90123a6ca30b6f191da5c9ef12dff4b4
Sep 18 19:50:00.843862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:00.843825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5g59x" event={"ID":"8049b98c-fca1-4717-b943-27dd3d2150fd","Type":"ContainerStarted","Data":"9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d"}
Sep 18 19:50:00.844308 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:00.843912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:50:00.844993 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:00.844971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s" event={"ID":"4b14a9d9-4001-46b1-9df1-73e0b15e6c83","Type":"ContainerStarted","Data":"7c5781b0a46248703cee41619fc95f7a90123a6ca30b6f191da5c9ef12dff4b4"}
Sep 18 19:50:00.861846 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:00.861750    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5g59x" podStartSLOduration=1.7094249769999998 podStartE2EDuration="2.861735104s" totalImagesPullingTime="1.152310127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:50:00.860996782 +0000 UTC m=+636.619804768" watchObservedRunningTime="2026-09-18 19:50:00.861735104 +0000 UTC m=+636.620543088"
Sep 18 19:50:02.857681 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:02.857648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s" event={"ID":"4b14a9d9-4001-46b1-9df1-73e0b15e6c83","Type":"ContainerStarted","Data":"5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7"}
Sep 18 19:50:02.872734 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:02.872688    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s" podStartSLOduration=1.967508587 podStartE2EDuration="3.872675696s" totalImagesPullingTime="1.905167109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:50:02.872146893 +0000 UTC m=+638.630954882" watchObservedRunningTime="2026-09-18 19:50:02.872675696 +0000 UTC m=+638.631483681"
Sep 18 19:50:03.178557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:03.178526    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zk97s"]
Sep 18 19:50:04.866832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:04.866747    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s" podUID="4b14a9d9-4001-46b1-9df1-73e0b15e6c83" containerName="authorino" containerID="cri-o://5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7" gracePeriod=30
Sep 18 19:50:05.105838 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.105813    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:50:05.240442 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.240419    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkgrw\" (UniqueName: \"kubernetes.io/projected/4b14a9d9-4001-46b1-9df1-73e0b15e6c83-kube-api-access-hkgrw\") pod \"4b14a9d9-4001-46b1-9df1-73e0b15e6c83\" (UID: \"4b14a9d9-4001-46b1-9df1-73e0b15e6c83\") "
Sep 18 19:50:05.242497 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.242478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b14a9d9-4001-46b1-9df1-73e0b15e6c83-kube-api-access-hkgrw" (OuterVolumeSpecName: "kube-api-access-hkgrw") pod "4b14a9d9-4001-46b1-9df1-73e0b15e6c83" (UID: "4b14a9d9-4001-46b1-9df1-73e0b15e6c83"). InnerVolumeSpecName "kube-api-access-hkgrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:50:05.340939 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.340919    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkgrw\" (UniqueName: \"kubernetes.io/projected/4b14a9d9-4001-46b1-9df1-73e0b15e6c83-kube-api-access-hkgrw\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:05.872832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.872791    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b14a9d9-4001-46b1-9df1-73e0b15e6c83" containerID="5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7" exitCode=0
Sep 18 19:50:05.872832 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.872836    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s"
Sep 18 19:50:05.873367 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.872843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s" event={"ID":"4b14a9d9-4001-46b1-9df1-73e0b15e6c83","Type":"ContainerDied","Data":"5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7"}
Sep 18 19:50:05.873367 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.872908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-zk97s" event={"ID":"4b14a9d9-4001-46b1-9df1-73e0b15e6c83","Type":"ContainerDied","Data":"7c5781b0a46248703cee41619fc95f7a90123a6ca30b6f191da5c9ef12dff4b4"}
Sep 18 19:50:05.873367 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.872932    2582 scope.go:117] "RemoveContainer" containerID="5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7"
Sep 18 19:50:05.881497 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.881481    2582 scope.go:117] "RemoveContainer" containerID="5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7"
Sep 18 19:50:05.881780 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:50:05.881762    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7\": container with ID starting with 5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7 not found: ID does not exist" containerID="5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7"
Sep 18 19:50:05.881854 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.881787    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7"} err="failed to get container status \"5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7\": rpc error: code = NotFound desc = could not find container \"5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7\": container with ID starting with 5992cfcd6388665941b03ee0ef21c3fbd6dd6ca6c376bb1f5d4b28e5d99377e7 not found: ID does not exist"
Sep 18 19:50:05.892555 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.892532    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zk97s"]
Sep 18 19:50:05.896363 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:05.896344    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-zk97s"]
Sep 18 19:50:06.440027 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:06.439994    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b14a9d9-4001-46b1-9df1-73e0b15e6c83" path="/var/lib/kubelet/pods/4b14a9d9-4001-46b1-9df1-73e0b15e6c83/volumes"
Sep 18 19:50:11.852641 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:11.852606    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:50:13.182959 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.182924    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:50:13.183412 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.183099    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5g59x" podUID="8049b98c-fca1-4717-b943-27dd3d2150fd" containerName="limitador" containerID="cri-o://9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d" gracePeriod=30
Sep 18 19:50:13.733769 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.733745    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:50:13.819217 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.819143    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6pbr\" (UniqueName: \"kubernetes.io/projected/8049b98c-fca1-4717-b943-27dd3d2150fd-kube-api-access-v6pbr\") pod \"8049b98c-fca1-4717-b943-27dd3d2150fd\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") "
Sep 18 19:50:13.819217 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.819197    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8049b98c-fca1-4717-b943-27dd3d2150fd-config-file\") pod \"8049b98c-fca1-4717-b943-27dd3d2150fd\" (UID: \"8049b98c-fca1-4717-b943-27dd3d2150fd\") "
Sep 18 19:50:13.819573 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.819551    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8049b98c-fca1-4717-b943-27dd3d2150fd-config-file" (OuterVolumeSpecName: "config-file") pod "8049b98c-fca1-4717-b943-27dd3d2150fd" (UID: "8049b98c-fca1-4717-b943-27dd3d2150fd"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:50:13.821495 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.821467    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8049b98c-fca1-4717-b943-27dd3d2150fd-kube-api-access-v6pbr" (OuterVolumeSpecName: "kube-api-access-v6pbr") pod "8049b98c-fca1-4717-b943-27dd3d2150fd" (UID: "8049b98c-fca1-4717-b943-27dd3d2150fd"). InnerVolumeSpecName "kube-api-access-v6pbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:50:13.912510 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.912480    2582 generic.go:356] "Generic (PLEG): container finished" podID="8049b98c-fca1-4717-b943-27dd3d2150fd" containerID="9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d" exitCode=0
Sep 18 19:50:13.912676 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.912524    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5g59x"
Sep 18 19:50:13.912676 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.912565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5g59x" event={"ID":"8049b98c-fca1-4717-b943-27dd3d2150fd","Type":"ContainerDied","Data":"9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d"}
Sep 18 19:50:13.912676 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.912615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5g59x" event={"ID":"8049b98c-fca1-4717-b943-27dd3d2150fd","Type":"ContainerDied","Data":"a9650f4a2c09dfca06235e8b6c004fcc3bf97b1319044cdf7d777da4effffb89"}
Sep 18 19:50:13.912676 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.912637    2582 scope.go:117] "RemoveContainer" containerID="9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d"
Sep 18 19:50:13.919894 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.919828    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8049b98c-fca1-4717-b943-27dd3d2150fd-config-file\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:13.919894 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.919845    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6pbr\" (UniqueName: \"kubernetes.io/projected/8049b98c-fca1-4717-b943-27dd3d2150fd-kube-api-access-v6pbr\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:13.921400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.921384    2582 scope.go:117] "RemoveContainer" containerID="9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d"
Sep 18 19:50:13.921669 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:50:13.921651    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d\": container with ID starting with 9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d not found: ID does not exist" containerID="9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d"
Sep 18 19:50:13.921728 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.921677    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d"} err="failed to get container status \"9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d\": rpc error: code = NotFound desc = could not find container \"9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d\": container with ID starting with 9c1cc10889279bc58f4946185314d0578b015fa1763ecbb08f56cad91ec9e52d not found: ID does not exist"
Sep 18 19:50:13.934031 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.933990    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:50:13.936278 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:13.936261    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5g59x"]
Sep 18 19:50:14.440260 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:14.440224    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8049b98c-fca1-4717-b943-27dd3d2150fd" path="/var/lib/kubelet/pods/8049b98c-fca1-4717-b943-27dd3d2150fd/volumes"
Sep 18 19:50:15.393813 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.393780    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"]
Sep 18 19:50:15.394171 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.394155    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8049b98c-fca1-4717-b943-27dd3d2150fd" containerName="limitador"
Sep 18 19:50:15.394171 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.394170    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8049b98c-fca1-4717-b943-27dd3d2150fd" containerName="limitador"
Sep 18 19:50:15.394379 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.394230    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b14a9d9-4001-46b1-9df1-73e0b15e6c83" containerName="authorino"
Sep 18 19:50:15.394379 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.394253    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b14a9d9-4001-46b1-9df1-73e0b15e6c83" containerName="authorino"
Sep 18 19:50:15.394379 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.394349    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8049b98c-fca1-4717-b943-27dd3d2150fd" containerName="limitador"
Sep 18 19:50:15.394379 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.394362    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b14a9d9-4001-46b1-9df1-73e0b15e6c83" containerName="authorino"
Sep 18 19:50:15.397420 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.397399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.400318 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.400288    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:50:15.400424 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.400317    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 19:50:15.401188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.401171    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 19:50:15.401289 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.401206    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wflld\""
Sep 18 19:50:15.407983 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.407964    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"]
Sep 18 19:50:15.430069 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.430049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23193709-da73-4a41-971a-62f9ce5b5e12-data\") pod \"postgres-69fb4594cf-dbk4p\" (UID: \"23193709-da73-4a41-971a-62f9ce5b5e12\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.430163 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.430107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87x5\" (UniqueName: \"kubernetes.io/projected/23193709-da73-4a41-971a-62f9ce5b5e12-kube-api-access-r87x5\") pod \"postgres-69fb4594cf-dbk4p\" (UID: \"23193709-da73-4a41-971a-62f9ce5b5e12\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.530969 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.530934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87x5\" (UniqueName: \"kubernetes.io/projected/23193709-da73-4a41-971a-62f9ce5b5e12-kube-api-access-r87x5\") pod \"postgres-69fb4594cf-dbk4p\" (UID: \"23193709-da73-4a41-971a-62f9ce5b5e12\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.531360 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.531155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23193709-da73-4a41-971a-62f9ce5b5e12-data\") pod \"postgres-69fb4594cf-dbk4p\" (UID: \"23193709-da73-4a41-971a-62f9ce5b5e12\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.531506 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.531484    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23193709-da73-4a41-971a-62f9ce5b5e12-data\") pod \"postgres-69fb4594cf-dbk4p\" (UID: \"23193709-da73-4a41-971a-62f9ce5b5e12\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.548144 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.548119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87x5\" (UniqueName: \"kubernetes.io/projected/23193709-da73-4a41-971a-62f9ce5b5e12-kube-api-access-r87x5\") pod \"postgres-69fb4594cf-dbk4p\" (UID: \"23193709-da73-4a41-971a-62f9ce5b5e12\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.708337 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.708304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:15.982149 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:15.979002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"]
Sep 18 19:50:15.986145 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:50:15.986104    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23193709_da73_4a41_971a_62f9ce5b5e12.slice/crio-ddd0449fccb7dcad87c93254326da71177c5718f9e5343d5dbe233793cafe9de WatchSource:0}: Error finding container ddd0449fccb7dcad87c93254326da71177c5718f9e5343d5dbe233793cafe9de: Status 404 returned error can't find the container with id ddd0449fccb7dcad87c93254326da71177c5718f9e5343d5dbe233793cafe9de
Sep 18 19:50:16.931974 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:16.931868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p" event={"ID":"23193709-da73-4a41-971a-62f9ce5b5e12","Type":"ContainerStarted","Data":"ddd0449fccb7dcad87c93254326da71177c5718f9e5343d5dbe233793cafe9de"}
Sep 18 19:50:20.954762 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:20.954726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p" event={"ID":"23193709-da73-4a41-971a-62f9ce5b5e12","Type":"ContainerStarted","Data":"d272324e5ff69457c2dc638e4c097f5f78ed92bcd67eb7fa14389ae8c630a009"}
Sep 18 19:50:20.955202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:20.954789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:20.976111 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:20.971357    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p" podStartSLOduration=1.115617588 podStartE2EDuration="5.971334406s" totalImagesPullingTime="4.855716818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:50:20.968762283 +0000 UTC m=+656.727570270" watchObservedRunningTime="2026-09-18 19:50:20.971334406 +0000 UTC m=+656.730142392"
Sep 18 19:50:26.990029 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:26.989996    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dbk4p"
Sep 18 19:50:27.775310 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.775271    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d9745d59d-bg6hv"]
Sep 18 19:50:27.781919 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.781866    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:27.783312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.783273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9745d59d-bg6hv"]
Sep 18 19:50:27.784365 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.784346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fssg2\""
Sep 18 19:50:27.807036 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.807010    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d9745d59d-bg6hv"]
Sep 18 19:50:27.807273 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:50:27.807255    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zn5h5], unattached volumes=[], failed to process volumes=[kube-api-access-zn5h5]: context canceled" pod="kuadrant-system/authorino-d9745d59d-bg6hv" podUID="4e53c780-55fe-4fe5-b2ad-6f81567b409b"
Sep 18 19:50:27.842978 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.842951    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn5h5\" (UniqueName: \"kubernetes.io/projected/4e53c780-55fe-4fe5-b2ad-6f81567b409b-kube-api-access-zn5h5\") pod \"authorino-d9745d59d-bg6hv\" (UID: \"4e53c780-55fe-4fe5-b2ad-6f81567b409b\") " pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:27.943450 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.943416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn5h5\" (UniqueName: \"kubernetes.io/projected/4e53c780-55fe-4fe5-b2ad-6f81567b409b-kube-api-access-zn5h5\") pod \"authorino-d9745d59d-bg6hv\" (UID: \"4e53c780-55fe-4fe5-b2ad-6f81567b409b\") " pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:27.951985 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.951964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn5h5\" (UniqueName: \"kubernetes.io/projected/4e53c780-55fe-4fe5-b2ad-6f81567b409b-kube-api-access-zn5h5\") pod \"authorino-d9745d59d-bg6hv\" (UID: \"4e53c780-55fe-4fe5-b2ad-6f81567b409b\") " pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:27.990609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.990584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:27.998749 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:27.998726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:28.044209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:28.044152    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn5h5\" (UniqueName: \"kubernetes.io/projected/4e53c780-55fe-4fe5-b2ad-6f81567b409b-kube-api-access-zn5h5\") pod \"4e53c780-55fe-4fe5-b2ad-6f81567b409b\" (UID: \"4e53c780-55fe-4fe5-b2ad-6f81567b409b\") "
Sep 18 19:50:28.046180 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:28.046154    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e53c780-55fe-4fe5-b2ad-6f81567b409b-kube-api-access-zn5h5" (OuterVolumeSpecName: "kube-api-access-zn5h5") pod "4e53c780-55fe-4fe5-b2ad-6f81567b409b" (UID: "4e53c780-55fe-4fe5-b2ad-6f81567b409b"). InnerVolumeSpecName "kube-api-access-zn5h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:50:28.145412 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:28.145383    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn5h5\" (UniqueName: \"kubernetes.io/projected/4e53c780-55fe-4fe5-b2ad-6f81567b409b-kube-api-access-zn5h5\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:28.995625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:28.995594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9745d59d-bg6hv"
Sep 18 19:50:29.023493 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:29.023466    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d9745d59d-bg6hv"]
Sep 18 19:50:29.028772 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:29.028748    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d9745d59d-bg6hv"]
Sep 18 19:50:30.440215 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:30.440185    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e53c780-55fe-4fe5-b2ad-6f81567b409b" path="/var/lib/kubelet/pods/4e53c780-55fe-4fe5-b2ad-6f81567b409b/volumes"
Sep 18 19:50:34.174592 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.174550    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d7d65c8bd-k6xwj"]
Sep 18 19:50:34.392267 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.392234    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7d65c8bd-k6xwj"]
Sep 18 19:50:34.392267 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.392270    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5746666cfc-p2ntv"]
Sep 18 19:50:34.392507 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.392362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.395305 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.395286    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 19:50:34.395455 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.395345    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 19:50:34.395512 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.395487    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-64hrz\""
Sep 18 19:50:34.396451 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.396431    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 19:50:34.405577 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.405552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5746666cfc-p2ntv"]
Sep 18 19:50:34.405662 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.405630    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.504236 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.504172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-webhook-cert\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.504236 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.504206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-webhook-cert\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.504400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.504279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-metrics-certs\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.504400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.504304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-metrics-certs\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.504400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.504340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnmg\" (UniqueName: \"kubernetes.io/projected/23ba2e0b-8435-426f-920a-526b2a1f3884-kube-api-access-kjnmg\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.504400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.504393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdvt\" (UniqueName: \"kubernetes.io/projected/80f64b4c-2b32-42ca-9784-7a74da6cace4-kube-api-access-qxdvt\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.605798 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.605771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-metrics-certs\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.605936 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.605803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnmg\" (UniqueName: \"kubernetes.io/projected/23ba2e0b-8435-426f-920a-526b2a1f3884-kube-api-access-kjnmg\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.605936 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.605842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdvt\" (UniqueName: \"kubernetes.io/projected/80f64b4c-2b32-42ca-9784-7a74da6cace4-kube-api-access-qxdvt\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.605936 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.605915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-webhook-cert\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.606042 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.605957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-webhook-cert\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.606086 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.606042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-metrics-certs\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.608495 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.608474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-webhook-cert\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.608607 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.608499    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-metrics-certs\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.608607 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.608537    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-webhook-cert\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.608607 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.608568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-metrics-certs\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.614346 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.614326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdvt\" (UniqueName: \"kubernetes.io/projected/80f64b4c-2b32-42ca-9784-7a74da6cace4-kube-api-access-qxdvt\") pod \"maas-controller-5746666cfc-p2ntv\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") " pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:34.614552 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.614534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnmg\" (UniqueName: \"kubernetes.io/projected/23ba2e0b-8435-426f-920a-526b2a1f3884-kube-api-access-kjnmg\") pod \"maas-controller-6d7d65c8bd-k6xwj\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") " pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.702534 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.702505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:34.714810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:34.714783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:35.002146 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:35.002121    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7d65c8bd-k6xwj"]
Sep 18 19:50:35.003576 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:50:35.003539    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ba2e0b_8435_426f_920a_526b2a1f3884.slice/crio-2619f916fe44268ae3032cbd218d8d863febfb77fb2ea16d9f89e815df45d213 WatchSource:0}: Error finding container 2619f916fe44268ae3032cbd218d8d863febfb77fb2ea16d9f89e815df45d213: Status 404 returned error can't find the container with id 2619f916fe44268ae3032cbd218d8d863febfb77fb2ea16d9f89e815df45d213
Sep 18 19:50:35.025809 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:35.025754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj" event={"ID":"23ba2e0b-8435-426f-920a-526b2a1f3884","Type":"ContainerStarted","Data":"2619f916fe44268ae3032cbd218d8d863febfb77fb2ea16d9f89e815df45d213"}
Sep 18 19:50:35.039209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:35.039124    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5746666cfc-p2ntv"]
Sep 18 19:50:35.041727 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:50:35.041694    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f64b4c_2b32_42ca_9784_7a74da6cace4.slice/crio-2c9089aa792ccfb866c625982f20face5ac1711cedca70e78924a2f0cf5e2dd3 WatchSource:0}: Error finding container 2c9089aa792ccfb866c625982f20face5ac1711cedca70e78924a2f0cf5e2dd3: Status 404 returned error can't find the container with id 2c9089aa792ccfb866c625982f20face5ac1711cedca70e78924a2f0cf5e2dd3
Sep 18 19:50:36.035361 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:36.035320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-p2ntv" event={"ID":"80f64b4c-2b32-42ca-9784-7a74da6cace4","Type":"ContainerStarted","Data":"2c9089aa792ccfb866c625982f20face5ac1711cedca70e78924a2f0cf5e2dd3"}
Sep 18 19:50:38.046794 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:38.046753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj" event={"ID":"23ba2e0b-8435-426f-920a-526b2a1f3884","Type":"ContainerStarted","Data":"9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f"}
Sep 18 19:50:38.047230 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:38.046841    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:38.048350 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:38.048328    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-p2ntv" event={"ID":"80f64b4c-2b32-42ca-9784-7a74da6cace4","Type":"ContainerStarted","Data":"aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8"}
Sep 18 19:50:38.048463 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:38.048452    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:38.065337 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:38.065296    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj" podStartSLOduration=1.577503567 podStartE2EDuration="4.065283798s" totalImagesPullingTime="2.487780231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:50:38.063892734 +0000 UTC m=+673.822700713" watchObservedRunningTime="2026-09-18 19:50:38.065283798 +0000 UTC m=+673.824091782"
Sep 18 19:50:38.087633 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:38.087595    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5746666cfc-p2ntv" podStartSLOduration=1.629650673 podStartE2EDuration="4.087583145s" totalImagesPullingTime="2.457932472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:50:38.08548164 +0000 UTC m=+673.844289639" watchObservedRunningTime="2026-09-18 19:50:38.087583145 +0000 UTC m=+673.846391146"
Sep 18 19:50:49.055313 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.055281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:49.055817 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.055359    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 19:50:49.123400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.123372    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d7d65c8bd-k6xwj"]
Sep 18 19:50:49.123606 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.123578    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj" podUID="23ba2e0b-8435-426f-920a-526b2a1f3884" containerName="manager" containerID="cri-o://9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f" gracePeriod=30
Sep 18 19:50:49.370254 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.370227    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:49.535557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.535519    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-webhook-cert\") pod \"23ba2e0b-8435-426f-920a-526b2a1f3884\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") "
Sep 18 19:50:49.535731 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.535607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-metrics-certs\") pod \"23ba2e0b-8435-426f-920a-526b2a1f3884\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") "
Sep 18 19:50:49.535731 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.535649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjnmg\" (UniqueName: \"kubernetes.io/projected/23ba2e0b-8435-426f-920a-526b2a1f3884-kube-api-access-kjnmg\") pod \"23ba2e0b-8435-426f-920a-526b2a1f3884\" (UID: \"23ba2e0b-8435-426f-920a-526b2a1f3884\") "
Sep 18 19:50:49.538096 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.538067    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23ba2e0b-8435-426f-920a-526b2a1f3884" (UID: "23ba2e0b-8435-426f-920a-526b2a1f3884"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:50:49.538222 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.538105    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23ba2e0b-8435-426f-920a-526b2a1f3884" (UID: "23ba2e0b-8435-426f-920a-526b2a1f3884"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:50:49.538222 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.538198    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ba2e0b-8435-426f-920a-526b2a1f3884-kube-api-access-kjnmg" (OuterVolumeSpecName: "kube-api-access-kjnmg") pod "23ba2e0b-8435-426f-920a-526b2a1f3884" (UID: "23ba2e0b-8435-426f-920a-526b2a1f3884"). InnerVolumeSpecName "kube-api-access-kjnmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:50:49.637626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.637551    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:49.637626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.637587    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjnmg\" (UniqueName: \"kubernetes.io/projected/23ba2e0b-8435-426f-920a-526b2a1f3884-kube-api-access-kjnmg\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:49.637626 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:49.637599    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ba2e0b-8435-426f-920a-526b2a1f3884-webhook-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:50:50.106229 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.106195    2582 generic.go:356] "Generic (PLEG): container finished" podID="23ba2e0b-8435-426f-920a-526b2a1f3884" containerID="9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f" exitCode=0
Sep 18 19:50:50.106660 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.106247    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj"
Sep 18 19:50:50.106660 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.106267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj" event={"ID":"23ba2e0b-8435-426f-920a-526b2a1f3884","Type":"ContainerDied","Data":"9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f"}
Sep 18 19:50:50.106660 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.106319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d65c8bd-k6xwj" event={"ID":"23ba2e0b-8435-426f-920a-526b2a1f3884","Type":"ContainerDied","Data":"2619f916fe44268ae3032cbd218d8d863febfb77fb2ea16d9f89e815df45d213"}
Sep 18 19:50:50.106660 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.106348    2582 scope.go:117] "RemoveContainer" containerID="9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f"
Sep 18 19:50:50.115591 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.115570    2582 scope.go:117] "RemoveContainer" containerID="9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f"
Sep 18 19:50:50.115888 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:50:50.115856    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f\": container with ID starting with 9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f not found: ID does not exist" containerID="9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f"
Sep 18 19:50:50.115944 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.115899    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f"} err="failed to get container status \"9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f\": rpc error: code = NotFound desc = could not find container \"9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f\": container with ID starting with 9f4400659be90111c1ea045df53586247de2526d11530cd03aca0f09d363061f not found: ID does not exist"
Sep 18 19:50:50.128562 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.128505    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d7d65c8bd-k6xwj"]
Sep 18 19:50:50.130406 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.130387    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d7d65c8bd-k6xwj"]
Sep 18 19:50:50.439889 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:50:50.439850    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ba2e0b-8435-426f-920a-526b2a1f3884" path="/var/lib/kubelet/pods/23ba2e0b-8435-426f-920a-526b2a1f3884/volumes"
Sep 18 19:51:10.928229 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.928148    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"]
Sep 18 19:51:10.928589 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.928540    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ba2e0b-8435-426f-920a-526b2a1f3884" containerName="manager"
Sep 18 19:51:10.928589 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.928553    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ba2e0b-8435-426f-920a-526b2a1f3884" containerName="manager"
Sep 18 19:51:10.928666 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.928614    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ba2e0b-8435-426f-920a-526b2a1f3884" containerName="manager"
Sep 18 19:51:10.932752 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.932737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:10.935221 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.935197    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 19:51:10.935357 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.935241    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 19:51:10.935500 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.935485    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jqjhf\""
Sep 18 19:51:10.941647 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:10.941589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"]
Sep 18 19:51:11.013253 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.013223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9d79fd-92ec-4c18-8b59-621829a2c266-openshift-service-ca\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.013405 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.013263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7dk\" (UniqueName: \"kubernetes.io/projected/dc9d79fd-92ec-4c18-8b59-621829a2c266-kube-api-access-mv7dk\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.013405 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.013330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.013405 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.013395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-metrics-certs\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.114259 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.114229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9d79fd-92ec-4c18-8b59-621829a2c266-openshift-service-ca\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.114259 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.114260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7dk\" (UniqueName: \"kubernetes.io/projected/dc9d79fd-92ec-4c18-8b59-621829a2c266-kube-api-access-mv7dk\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.114452 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.114286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.114452 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.114317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-metrics-certs\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.114540 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:51:11.114460    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 18 19:51:11.114540 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:51:11.114534    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls podName:dc9d79fd-92ec-4c18-8b59-621829a2c266 nodeName:}" failed. No retries permitted until 2026-09-18 19:51:11.614516944 +0000 UTC m=+707.373324907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls") pod "maas-api-5f6dd68d9c-5vxh4" (UID: "dc9d79fd-92ec-4c18-8b59-621829a2c266") : secret "maas-api-serving-cert" not found
Sep 18 19:51:11.114938 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.114917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9d79fd-92ec-4c18-8b59-621829a2c266-openshift-service-ca\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.116909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.116867    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-metrics-certs\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.125130 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.125098    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7dk\" (UniqueName: \"kubernetes.io/projected/dc9d79fd-92ec-4c18-8b59-621829a2c266-kube-api-access-mv7dk\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.436952 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.436918    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"]
Sep 18 19:51:11.442680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.442661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.445256 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.445238    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 19:51:11.445318 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.445242    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fgb9m\""
Sep 18 19:51:11.453730 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.453707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"]
Sep 18 19:51:11.456445 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.456424    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"]
Sep 18 19:51:11.459451 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.459430    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.478843 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.478816    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"]
Sep 18 19:51:11.518801 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.518775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0e6999-3f1d-46c7-b2be-7bdccf514a51-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pw62n\" (UID: \"ad0e6999-3f1d-46c7-b2be-7bdccf514a51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.518960 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.518941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz76m\" (UniqueName: \"kubernetes.io/projected/ad0e6999-3f1d-46c7-b2be-7bdccf514a51-kube-api-access-wz76m\") pod \"payload-pre-processing-59fbc47bf8-pw62n\" (UID: \"ad0e6999-3f1d-46c7-b2be-7bdccf514a51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.519168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.519142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47754a28-350a-46e5-ab22-84d9a12a7800-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-q2vlj\" (UID: \"47754a28-350a-46e5-ab22-84d9a12a7800\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.519291 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.519178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj2js\" (UniqueName: \"kubernetes.io/projected/47754a28-350a-46e5-ab22-84d9a12a7800-kube-api-access-fj2js\") pod \"payload-processing-5b54b7fbb7-q2vlj\" (UID: \"47754a28-350a-46e5-ab22-84d9a12a7800\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.619723 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.619688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47754a28-350a-46e5-ab22-84d9a12a7800-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-q2vlj\" (UID: \"47754a28-350a-46e5-ab22-84d9a12a7800\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.619897 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.619736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj2js\" (UniqueName: \"kubernetes.io/projected/47754a28-350a-46e5-ab22-84d9a12a7800-kube-api-access-fj2js\") pod \"payload-processing-5b54b7fbb7-q2vlj\" (UID: \"47754a28-350a-46e5-ab22-84d9a12a7800\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.619897 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.619781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0e6999-3f1d-46c7-b2be-7bdccf514a51-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pw62n\" (UID: \"ad0e6999-3f1d-46c7-b2be-7bdccf514a51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.619897 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.619836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.620061 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.619895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz76m\" (UniqueName: \"kubernetes.io/projected/ad0e6999-3f1d-46c7-b2be-7bdccf514a51-kube-api-access-wz76m\") pod \"payload-pre-processing-59fbc47bf8-pw62n\" (UID: \"ad0e6999-3f1d-46c7-b2be-7bdccf514a51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.620569 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.620545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47754a28-350a-46e5-ab22-84d9a12a7800-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-q2vlj\" (UID: \"47754a28-350a-46e5-ab22-84d9a12a7800\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.620569 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.620556    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad0e6999-3f1d-46c7-b2be-7bdccf514a51-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pw62n\" (UID: \"ad0e6999-3f1d-46c7-b2be-7bdccf514a51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.622756 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.622739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls\") pod \"maas-api-5f6dd68d9c-5vxh4\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") " pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:11.631641 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.631617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj2js\" (UniqueName: \"kubernetes.io/projected/47754a28-350a-46e5-ab22-84d9a12a7800-kube-api-access-fj2js\") pod \"payload-processing-5b54b7fbb7-q2vlj\" (UID: \"47754a28-350a-46e5-ab22-84d9a12a7800\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.631757 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.631617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz76m\" (UniqueName: \"kubernetes.io/projected/ad0e6999-3f1d-46c7-b2be-7bdccf514a51-kube-api-access-wz76m\") pod \"payload-pre-processing-59fbc47bf8-pw62n\" (UID: \"ad0e6999-3f1d-46c7-b2be-7bdccf514a51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.753735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.753647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:11.769627 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.769591    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:11.845128 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:11.845043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:12.026785 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:12.026761    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"]
Sep 18 19:51:12.028357 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:51:12.028332    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0e6999_3f1d_46c7_b2be_7bdccf514a51.slice/crio-bb62662677559cb7fef404c4234aecb520dcac0f2246864fe9d5a2b339ba23e7 WatchSource:0}: Error finding container bb62662677559cb7fef404c4234aecb520dcac0f2246864fe9d5a2b339ba23e7: Status 404 returned error can't find the container with id bb62662677559cb7fef404c4234aecb520dcac0f2246864fe9d5a2b339ba23e7
Sep 18 19:51:12.050920 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:12.050866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"]
Sep 18 19:51:12.052715 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:51:12.052685    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47754a28_350a_46e5_ab22_84d9a12a7800.slice/crio-67d5b5bfe2401517deff851e6306092ff7350976e03a15f54bbd60a236506a63 WatchSource:0}: Error finding container 67d5b5bfe2401517deff851e6306092ff7350976e03a15f54bbd60a236506a63: Status 404 returned error can't find the container with id 67d5b5bfe2401517deff851e6306092ff7350976e03a15f54bbd60a236506a63
Sep 18 19:51:12.131586 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:12.131554    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"]
Sep 18 19:51:12.133432 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:51:12.133405    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9d79fd_92ec_4c18_8b59_621829a2c266.slice/crio-af7f732d07a13f1638b6cf66f11e0ba4a75a60e25e64517eec73d57791dc34de WatchSource:0}: Error finding container af7f732d07a13f1638b6cf66f11e0ba4a75a60e25e64517eec73d57791dc34de: Status 404 returned error can't find the container with id af7f732d07a13f1638b6cf66f11e0ba4a75a60e25e64517eec73d57791dc34de
Sep 18 19:51:12.212988 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:12.212860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n" event={"ID":"ad0e6999-3f1d-46c7-b2be-7bdccf514a51","Type":"ContainerStarted","Data":"bb62662677559cb7fef404c4234aecb520dcac0f2246864fe9d5a2b339ba23e7"}
Sep 18 19:51:12.214438 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:12.214402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4" event={"ID":"dc9d79fd-92ec-4c18-8b59-621829a2c266","Type":"ContainerStarted","Data":"af7f732d07a13f1638b6cf66f11e0ba4a75a60e25e64517eec73d57791dc34de"}
Sep 18 19:51:12.215835 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:12.215811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj" event={"ID":"47754a28-350a-46e5-ab22-84d9a12a7800","Type":"ContainerStarted","Data":"67d5b5bfe2401517deff851e6306092ff7350976e03a15f54bbd60a236506a63"}
Sep 18 19:51:15.258404 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.258368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj" event={"ID":"47754a28-350a-46e5-ab22-84d9a12a7800","Type":"ContainerStarted","Data":"f26ef059bc68b3bda6f6a0cab4ad1bee89fdd7ad11efa01d5380aef3fc0fb2b5"}
Sep 18 19:51:15.258853 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.258524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:15.260090 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.260065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n" event={"ID":"ad0e6999-3f1d-46c7-b2be-7bdccf514a51","Type":"ContainerStarted","Data":"a4babc8e23e5eb3b3d5c617dd619ad3e932f922b521cf099631a9ffb5fcece64"}
Sep 18 19:51:15.260203 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.260130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:15.261675 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.261652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4" event={"ID":"dc9d79fd-92ec-4c18-8b59-621829a2c266","Type":"ContainerStarted","Data":"21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043"}
Sep 18 19:51:15.261770 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.261719    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:15.275964 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.275923    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj" podStartSLOduration=2.033646974 podStartE2EDuration="4.275910949s" totalImagesPullingTime="2.242263975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:51:15.274594547 +0000 UTC m=+711.033402540" watchObservedRunningTime="2026-09-18 19:51:15.275910949 +0000 UTC m=+711.034718930"
Sep 18 19:51:15.290282 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.290243    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n" podStartSLOduration=2.020421633 podStartE2EDuration="4.290230633s" totalImagesPullingTime="2.269809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:51:15.289353989 +0000 UTC m=+711.048161974" watchObservedRunningTime="2026-09-18 19:51:15.290230633 +0000 UTC m=+711.049038621"
Sep 18 19:51:15.307430 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:15.307385    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4" podStartSLOduration=3.144981048 podStartE2EDuration="5.30737616s" totalImagesPullingTime="2.162395112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:51:15.305250207 +0000 UTC m=+711.064058195" watchObservedRunningTime="2026-09-18 19:51:15.30737616 +0000 UTC m=+711.066184145"
Sep 18 19:51:21.271404 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.271378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 19:51:21.292749 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.292720    2582 generic.go:356] "Generic (PLEG): container finished" podID="e36cb668-95dc-42e7-9682-1adc97a8ba0f" containerID="0cbec7dc06db1cb388b74d99c4e448170db7b8ab0b1b319387bdb5a27ce281af" exitCode=0
Sep 18 19:51:21.292915 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.292800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" event={"ID":"e36cb668-95dc-42e7-9682-1adc97a8ba0f","Type":"ContainerDied","Data":"0cbec7dc06db1cb388b74d99c4e448170db7b8ab0b1b319387bdb5a27ce281af"}
Sep 18 19:51:21.293220 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.293205    2582 scope.go:117] "RemoveContainer" containerID="0cbec7dc06db1cb388b74d99c4e448170db7b8ab0b1b319387bdb5a27ce281af"
Sep 18 19:51:21.294297 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.294269    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:51:21.294363 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.294331    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:51:21.294399 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:21.294367    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:51:22.301670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:22.301636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" event={"ID":"e36cb668-95dc-42e7-9682-1adc97a8ba0f","Type":"ContainerStarted","Data":"21523a10649a6bc4ac405f7582ff93386bcd3e06f70ece60cac0c56da0deb20b"}
Sep 18 19:51:22.349354 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:22.349314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:51:22.349557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:22.349537    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzj5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 19:51:22.349604 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:22.349585    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" podUID="e36cb668-95dc-42e7-9682-1adc97a8ba0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 19:51:23.348642 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:23.348612    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzj5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 19:51:23.349032 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:23.348662    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" podUID="e36cb668-95dc-42e7-9682-1adc97a8ba0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 19:51:24.349248 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:24.349214    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzj5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 19:51:24.349661 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:24.349267    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" podUID="e36cb668-95dc-42e7-9682-1adc97a8ba0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 19:51:25.349119 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:25.349085    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzj5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 19:51:25.349295 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:25.349154    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" podUID="e36cb668-95dc-42e7-9682-1adc97a8ba0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 19:51:26.269096 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:26.269064    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n"
Sep 18 19:51:26.269367 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:26.269346    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-q2vlj"
Sep 18 19:51:26.349013 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:26.348976    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-lzj5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 18 19:51:26.349210 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:26.349040    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s" podUID="e36cb668-95dc-42e7-9682-1adc97a8ba0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 18 19:51:27.352594 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:27.352566    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:51:27.353095 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:27.353075    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:51:27.353848 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:27.353829    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s"
Sep 18 19:51:36.668255 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.668222    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"]
Sep 18 19:51:36.671558 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.671534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.675152 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.675129    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2md6r\""
Sep 18 19:51:36.675280 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.675132    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 18 19:51:36.675280 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.675136    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 19:51:36.675280 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.675174    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 19:51:36.680302 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.680280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"]
Sep 18 19:51:36.759086 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.759052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.759086 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.759090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.759311 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.759105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.759311 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.759127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8kz\" (UniqueName: \"kubernetes.io/projected/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-kube-api-access-9v8kz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.759311 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.759201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.759311 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.759254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860157 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8kz\" (UniqueName: \"kubernetes.io/projected/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-kube-api-access-9v8kz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860297 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860297 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860297 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860413 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860413 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860673 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860713 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.860752 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.860708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.862724 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.862704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.862862 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.862846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.868928 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.868906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8kz\" (UniqueName: \"kubernetes.io/projected/b5e93412-16c1-4fdf-a5e2-f90fca4ad807-kube-api-access-9v8kz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vcdcw\" (UID: \"b5e93412-16c1-4fdf-a5e2-f90fca4ad807\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:36.982865 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:36.982826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:37.253990 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:37.253911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"]
Sep 18 19:51:37.256808 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:51:37.256778    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e93412_16c1_4fdf_a5e2_f90fca4ad807.slice/crio-aecc729c30db13fcc05577249473da689e75f093e51af7c61b751523163ad981 WatchSource:0}: Error finding container aecc729c30db13fcc05577249473da689e75f093e51af7c61b751523163ad981: Status 404 returned error can't find the container with id aecc729c30db13fcc05577249473da689e75f093e51af7c61b751523163ad981
Sep 18 19:51:37.409051 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:37.409011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw" event={"ID":"b5e93412-16c1-4fdf-a5e2-f90fca4ad807","Type":"ContainerStarted","Data":"aecc729c30db13fcc05577249473da689e75f093e51af7c61b751523163ad981"}
Sep 18 19:51:38.416663 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:38.416624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw" event={"ID":"b5e93412-16c1-4fdf-a5e2-f90fca4ad807","Type":"ContainerStarted","Data":"4932dd16c606ea99e42a0092bc0ccc110dbe1f371c9478b2b1963bac960eddc4"}
Sep 18 19:51:38.434678 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:38.434633    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw" podStartSLOduration=1.435808707 podStartE2EDuration="2.434617684s" totalImagesPullingTime="998.808977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:51:38.432987873 +0000 UTC m=+734.191795858" watchObservedRunningTime="2026-09-18 19:51:38.434617684 +0000 UTC m=+734.193425668"
Sep 18 19:51:46.983918 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:46.983861    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:46.984269 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:46.983979    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:46.996939 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:46.996912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:51:47.472034 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:51:47.472006    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vcdcw"
Sep 18 19:52:24.568856 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.568798    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"]
Sep 18 19:52:24.572780 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.572742    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.575275 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.575255    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 18 19:52:24.583097 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.583074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"]
Sep 18 19:52:24.702014 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.701982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.702014 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.702013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.702225 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.702124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.702225 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.702161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.702225 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.702177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5dtj\" (UniqueName: \"kubernetes.io/projected/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-kube-api-access-r5dtj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.702344 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.702225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.803746 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.803703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.803746 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.803756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.803980 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.803865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dtj\" (UniqueName: \"kubernetes.io/projected/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-kube-api-access-r5dtj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.803980 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.803930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.804049 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.803988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.804049 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.804008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.804180 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.804162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.804240 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.804221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.804276 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.804242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.806409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.806387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.806595 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.806579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.813034 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.813008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dtj\" (UniqueName: \"kubernetes.io/projected/e9e6ddf5-2d35-4cfe-9f07-18d891b46679-kube-api-access-r5dtj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz\" (UID: \"e9e6ddf5-2d35-4cfe-9f07-18d891b46679\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:24.885084 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:24.885021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:25.157937 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:25.157919    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"]
Sep 18 19:52:25.160359 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:52:25.160335    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e6ddf5_2d35_4cfe_9f07_18d891b46679.slice/crio-97fec5ef701cd3e2f6db705d54fe4be699945eb8652c055318294922588b2e09 WatchSource:0}: Error finding container 97fec5ef701cd3e2f6db705d54fe4be699945eb8652c055318294922588b2e09: Status 404 returned error can't find the container with id 97fec5ef701cd3e2f6db705d54fe4be699945eb8652c055318294922588b2e09
Sep 18 19:52:25.642949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:25.642900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz" event={"ID":"e9e6ddf5-2d35-4cfe-9f07-18d891b46679","Type":"ContainerStarted","Data":"fbcb72aee7eaddcb8eab67013533247a95474ab49b38ca353c6f29c8c014f5a0"}
Sep 18 19:52:25.642949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:25.642956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz" event={"ID":"e9e6ddf5-2d35-4cfe-9f07-18d891b46679","Type":"ContainerStarted","Data":"97fec5ef701cd3e2f6db705d54fe4be699945eb8652c055318294922588b2e09"}
Sep 18 19:52:25.660569 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:25.660485    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz" podStartSLOduration=1.461016275 podStartE2EDuration="1.660469712s" totalImagesPullingTime="199.453437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:52:25.659189302 +0000 UTC m=+781.417997324" watchObservedRunningTime="2026-09-18 19:52:25.660469712 +0000 UTC m=+781.419277697"
Sep 18 19:52:34.885590 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:34.885559    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:34.886097 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:34.885629    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:34.898012 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:34.897991    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:52:35.705283 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:52:35.705256    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz"
Sep 18 19:53:57.710036 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.710005    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79b55fcb65-2lf7j"]
Sep 18 19:53:57.713915 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.713868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:57.717623 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.717602    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fssg2\""
Sep 18 19:53:57.717767 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.717642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 19:53:57.721462 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.721432    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79b55fcb65-2lf7j"]
Sep 18 19:53:57.863040 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.863011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1bd50238-0f4f-44d4-ba54-422671ba8fe8-tls-cert\") pod \"authorino-79b55fcb65-2lf7j\" (UID: \"1bd50238-0f4f-44d4-ba54-422671ba8fe8\") " pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:57.863210 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.863060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5sf8\" (UniqueName: \"kubernetes.io/projected/1bd50238-0f4f-44d4-ba54-422671ba8fe8-kube-api-access-k5sf8\") pod \"authorino-79b55fcb65-2lf7j\" (UID: \"1bd50238-0f4f-44d4-ba54-422671ba8fe8\") " pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:57.964267 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.964184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1bd50238-0f4f-44d4-ba54-422671ba8fe8-tls-cert\") pod \"authorino-79b55fcb65-2lf7j\" (UID: \"1bd50238-0f4f-44d4-ba54-422671ba8fe8\") " pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:57.964267 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.964241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5sf8\" (UniqueName: \"kubernetes.io/projected/1bd50238-0f4f-44d4-ba54-422671ba8fe8-kube-api-access-k5sf8\") pod \"authorino-79b55fcb65-2lf7j\" (UID: \"1bd50238-0f4f-44d4-ba54-422671ba8fe8\") " pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:57.966660 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.966642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1bd50238-0f4f-44d4-ba54-422671ba8fe8-tls-cert\") pod \"authorino-79b55fcb65-2lf7j\" (UID: \"1bd50238-0f4f-44d4-ba54-422671ba8fe8\") " pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:57.972557 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:57.972534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5sf8\" (UniqueName: \"kubernetes.io/projected/1bd50238-0f4f-44d4-ba54-422671ba8fe8-kube-api-access-k5sf8\") pod \"authorino-79b55fcb65-2lf7j\" (UID: \"1bd50238-0f4f-44d4-ba54-422671ba8fe8\") " pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:58.025355 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:58.025325    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79b55fcb65-2lf7j"
Sep 18 19:53:58.294607 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:58.294585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79b55fcb65-2lf7j"]
Sep 18 19:53:58.296697 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:53:58.296668    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bd50238_0f4f_44d4_ba54_422671ba8fe8.slice/crio-020bf2fbecb0b83a85f5e2958dcfa0c47053a2d16a07ebccbc192ae3376d47d8 WatchSource:0}: Error finding container 020bf2fbecb0b83a85f5e2958dcfa0c47053a2d16a07ebccbc192ae3376d47d8: Status 404 returned error can't find the container with id 020bf2fbecb0b83a85f5e2958dcfa0c47053a2d16a07ebccbc192ae3376d47d8
Sep 18 19:53:59.121675 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:59.121636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79b55fcb65-2lf7j" event={"ID":"1bd50238-0f4f-44d4-ba54-422671ba8fe8","Type":"ContainerStarted","Data":"7377e42423f1f4f899dcd24aa8cf000e3830f954441146e73e00344ad6c721e6"}
Sep 18 19:53:59.122147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:59.121691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79b55fcb65-2lf7j" event={"ID":"1bd50238-0f4f-44d4-ba54-422671ba8fe8","Type":"ContainerStarted","Data":"020bf2fbecb0b83a85f5e2958dcfa0c47053a2d16a07ebccbc192ae3376d47d8"}
Sep 18 19:53:59.136411 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:53:59.136352    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79b55fcb65-2lf7j" podStartSLOduration=1.483174657 podStartE2EDuration="2.136331068s" totalImagesPullingTime="653.156411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:53:59.136212921 +0000 UTC m=+874.895020907" watchObservedRunningTime="2026-09-18 19:53:59.136331068 +0000 UTC m=+874.895139054"
Sep 18 19:54:23.606465 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.606432    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"]
Sep 18 19:54:23.610754 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.610735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.613240 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.613215    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d6291d-serving-cert\""
Sep 18 19:54:23.623652 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.623630    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"]
Sep 18 19:54:23.703446 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.703413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.703446 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.703456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.703674 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.703481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-metrics-certs\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.703674 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.703592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj967\" (UniqueName: \"kubernetes.io/projected/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-kube-api-access-xj967\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.804802 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.804764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.805058 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.804815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.805058 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.804841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-metrics-certs\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.805058 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.804935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj967\" (UniqueName: \"kubernetes.io/projected/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-kube-api-access-xj967\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.805842 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.805759    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.807532 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.807512    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-metrics-certs\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.807640 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.807566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.813315 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.813292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj967\" (UniqueName: \"kubernetes.io/projected/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-kube-api-access-xj967\") pod \"maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:23.924512 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:23.924478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:24.206309 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.206279    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"]
Sep 18 19:54:24.207059 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:24.207008    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4c6aab_4780_4cfb_99b3_10d442aa89d7.slice/crio-1616ce5b62b09e3f00572085520f2dbd3552a2b654011571f13a7450d7723f45 WatchSource:0}: Error finding container 1616ce5b62b09e3f00572085520f2dbd3552a2b654011571f13a7450d7723f45: Status 404 returned error can't find the container with id 1616ce5b62b09e3f00572085520f2dbd3552a2b654011571f13a7450d7723f45
Sep 18 19:54:24.256155 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.256119    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm" event={"ID":"2b4c6aab-4780-4cfb-99b3-10d442aa89d7","Type":"ContainerStarted","Data":"1616ce5b62b09e3f00572085520f2dbd3552a2b654011571f13a7450d7723f45"}
Sep 18 19:54:24.320455 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.320421    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"]
Sep 18 19:54:24.325054 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.325033    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.327709 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.327690    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d6291d-dockercfg-nd2pp\""
Sep 18 19:54:24.327709 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.327688    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d6291d\""
Sep 18 19:54:24.332994 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.332963    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"]
Sep 18 19:54:24.410098 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.410068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc78949d-0da8-4a24-90ea-f02d6c8594bd-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.410267 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.410113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqx4\" (UniqueName: \"kubernetes.io/projected/cc78949d-0da8-4a24-90ea-f02d6c8594bd-kube-api-access-ngqx4\") pod \"payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.511395 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.511308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqx4\" (UniqueName: \"kubernetes.io/projected/cc78949d-0da8-4a24-90ea-f02d6c8594bd-kube-api-access-ngqx4\") pod \"payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.511545 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.511427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc78949d-0da8-4a24-90ea-f02d6c8594bd-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.512277 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.512239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc78949d-0da8-4a24-90ea-f02d6c8594bd-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.520038 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.520016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqx4\" (UniqueName: \"kubernetes.io/projected/cc78949d-0da8-4a24-90ea-f02d6c8594bd-kube-api-access-ngqx4\") pod \"payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") " pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.637620 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.637583    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:24.663238 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.663202    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"]
Sep 18 19:54:24.671105 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.671080    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.674429 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.674396    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-674263-serving-cert\""
Sep 18 19:54:24.676959 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.676933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"]
Sep 18 19:54:24.716378 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.716352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4tb\" (UniqueName: \"kubernetes.io/projected/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-kube-api-access-ln4tb\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.716514 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.716417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.716514 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.716481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-maas-api-tls\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.716514 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.716506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-metrics-certs\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.818531 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.818434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4tb\" (UniqueName: \"kubernetes.io/projected/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-kube-api-access-ln4tb\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.818531 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.818493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.819046 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.818544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-maas-api-tls\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.819046 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.818572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-metrics-certs\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.819602 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.819538    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.821552 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.821533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-maas-api-tls\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.821959 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.821940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-metrics-certs\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.829499 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.829473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4tb\" (UniqueName: \"kubernetes.io/projected/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-kube-api-access-ln4tb\") pod \"maas-api-e2e-worker-w4-674263-5c747d555d-tjszt\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:24.928123 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.928096    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"]
Sep 18 19:54:24.930271 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:24.930239    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc78949d_0da8_4a24_90ea_f02d6c8594bd.slice/crio-7d3e84e9ce61d2482a90c9f9c35b95d5f950dc26b10d63a564f2fb90d12c0ede WatchSource:0}: Error finding container 7d3e84e9ce61d2482a90c9f9c35b95d5f950dc26b10d63a564f2fb90d12c0ede: Status 404 returned error can't find the container with id 7d3e84e9ce61d2482a90c9f9c35b95d5f950dc26b10d63a564f2fb90d12c0ede
Sep 18 19:54:24.991997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:24.991973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:25.264945 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.264914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm" event={"ID":"2b4c6aab-4780-4cfb-99b3-10d442aa89d7","Type":"ContainerStarted","Data":"0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0"}
Sep 18 19:54:25.265140 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.265014    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:25.266550 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.266529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8" event={"ID":"cc78949d-0da8-4a24-90ea-f02d6c8594bd","Type":"ContainerStarted","Data":"f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b"}
Sep 18 19:54:25.266664 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.266571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8" event={"ID":"cc78949d-0da8-4a24-90ea-f02d6c8594bd","Type":"ContainerStarted","Data":"7d3e84e9ce61d2482a90c9f9c35b95d5f950dc26b10d63a564f2fb90d12c0ede"}
Sep 18 19:54:25.266664 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.266594    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:25.270848 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.270828    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"]
Sep 18 19:54:25.272505 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:25.272484    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf762b3e2_ec33_46cc_8add_bf90d3ad28d9.slice/crio-25de41ce6f7242156a483973b89185ed1ab718c50ab2370c54630c6888f5e7f0 WatchSource:0}: Error finding container 25de41ce6f7242156a483973b89185ed1ab718c50ab2370c54630c6888f5e7f0: Status 404 returned error can't find the container with id 25de41ce6f7242156a483973b89185ed1ab718c50ab2370c54630c6888f5e7f0
Sep 18 19:54:25.290119 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.290060    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm" podStartSLOduration=1.8676130469999999 podStartE2EDuration="2.290041057s" totalImagesPullingTime="422.42801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:25.288370821 +0000 UTC m=+901.047178807" watchObservedRunningTime="2026-09-18 19:54:25.290041057 +0000 UTC m=+901.048849044"
Sep 18 19:54:25.306997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.306949    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8" podStartSLOduration=1.306930848 podStartE2EDuration="1.306930848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:25.305232223 +0000 UTC m=+901.064040209" watchObservedRunningTime="2026-09-18 19:54:25.306930848 +0000 UTC m=+901.065738838"
Sep 18 19:54:25.772419 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.772384    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"]
Sep 18 19:54:25.777027 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.776328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.779034 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.779011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-d94b9e-serving-cert\""
Sep 18 19:54:25.789487 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.789460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"]
Sep 18 19:54:25.829280 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.829254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80e432f-d788-4d9c-86d7-3cba53c988d8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.829446 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.829311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkvhp\" (UniqueName: \"kubernetes.io/projected/b80e432f-d788-4d9c-86d7-3cba53c988d8-kube-api-access-wkvhp\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.829538 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.829438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.829538 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.829477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-metrics-certs\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.930570 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.930530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80e432f-d788-4d9c-86d7-3cba53c988d8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.930763 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.930624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkvhp\" (UniqueName: \"kubernetes.io/projected/b80e432f-d788-4d9c-86d7-3cba53c988d8-kube-api-access-wkvhp\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.930763 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.930709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.930763 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.930737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-metrics-certs\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.930960 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:54:25.930856    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-serving-cert: secret "maas-api-e2e-worker-w0-d94b9e-serving-cert" not found
Sep 18 19:54:25.931017 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:54:25.930962    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls podName:b80e432f-d788-4d9c-86d7-3cba53c988d8 nodeName:}" failed. No retries permitted until 2026-09-18 19:54:26.430939726 +0000 UTC m=+902.189747699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls") pod "maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" (UID: "b80e432f-d788-4d9c-86d7-3cba53c988d8") : secret "maas-api-e2e-worker-w0-d94b9e-serving-cert" not found
Sep 18 19:54:25.931345 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.931319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80e432f-d788-4d9c-86d7-3cba53c988d8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.933453 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.933424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-metrics-certs\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:25.939231 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:25.939211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkvhp\" (UniqueName: \"kubernetes.io/projected/b80e432f-d788-4d9c-86d7-3cba53c988d8-kube-api-access-wkvhp\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:26.274319 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.274230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt" event={"ID":"f762b3e2-ec33-46cc-8add-bf90d3ad28d9","Type":"ContainerStarted","Data":"2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7"}
Sep 18 19:54:26.274481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.274372    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:26.274481 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.274412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt" event={"ID":"f762b3e2-ec33-46cc-8add-bf90d3ad28d9","Type":"ContainerStarted","Data":"25de41ce6f7242156a483973b89185ed1ab718c50ab2370c54630c6888f5e7f0"}
Sep 18 19:54:26.295935 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.295871    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt" podStartSLOduration=1.9739214349999998 podStartE2EDuration="2.295856273s" totalImagesPullingTime="321.934838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:26.29491342 +0000 UTC m=+902.053721461" watchObservedRunningTime="2026-09-18 19:54:26.295856273 +0000 UTC m=+902.054664285"
Sep 18 19:54:26.407295 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.407268    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:54:26.408045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.408022    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:54:26.414086 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.414054    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:54:26.415400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.415379    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:54:26.435908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.435780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:26.440558 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.440527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:26.688212 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.688178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:26.973940 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:26.973916    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"]
Sep 18 19:54:26.976179 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:26.976151    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80e432f_d788_4d9c_86d7_3cba53c988d8.slice/crio-135c56329fd9746620fca888295bbfeae7d556859e8254ab3b3313b2dca24c8f WatchSource:0}: Error finding container 135c56329fd9746620fca888295bbfeae7d556859e8254ab3b3313b2dca24c8f: Status 404 returned error can't find the container with id 135c56329fd9746620fca888295bbfeae7d556859e8254ab3b3313b2dca24c8f
Sep 18 19:54:27.281628 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:27.281547    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" event={"ID":"b80e432f-d788-4d9c-86d7-3cba53c988d8","Type":"ContainerStarted","Data":"135c56329fd9746620fca888295bbfeae7d556859e8254ab3b3313b2dca24c8f"}
Sep 18 19:54:28.288062 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:28.288017    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" event={"ID":"b80e432f-d788-4d9c-86d7-3cba53c988d8","Type":"ContainerStarted","Data":"7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3"}
Sep 18 19:54:28.288440 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:28.288148    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:28.311576 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:28.311522    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" podStartSLOduration=2.945032966 podStartE2EDuration="3.311509118s" totalImagesPullingTime="366.476152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:28.31094602 +0000 UTC m=+904.069754007" watchObservedRunningTime="2026-09-18 19:54:28.311509118 +0000 UTC m=+904.070317151"
Sep 18 19:54:31.279803 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:31.279774    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 19:54:32.287121 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.287090    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 19:54:32.500597 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.500566    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"]
Sep 18 19:54:32.504609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.504587    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.508907 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.508869    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-1d073e-serving-cert\""
Sep 18 19:54:32.519551 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.519517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"]
Sep 18 19:54:32.599869 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.599789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94prx\" (UniqueName: \"kubernetes.io/projected/24b8b667-496d-4aa8-93e8-7f1dab69fb16-kube-api-access-94prx\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.599869 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.599829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-metrics-certs\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.600071 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.599920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b8b667-496d-4aa8-93e8-7f1dab69fb16-openshift-service-ca\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.600071 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.599943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.701326 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.701292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b8b667-496d-4aa8-93e8-7f1dab69fb16-openshift-service-ca\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.701326 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.701330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.701582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.701383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94prx\" (UniqueName: \"kubernetes.io/projected/24b8b667-496d-4aa8-93e8-7f1dab69fb16-kube-api-access-94prx\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.701582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.701408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-metrics-certs\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.701582 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:54:32.701521    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-serving-cert: secret "maas-api-e2e-autores-1d073e-serving-cert" not found
Sep 18 19:54:32.701746 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:54:32.701591    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls podName:24b8b667-496d-4aa8-93e8-7f1dab69fb16 nodeName:}" failed. No retries permitted until 2026-09-18 19:54:33.201572611 +0000 UTC m=+908.960380595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls") pod "maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" (UID: "24b8b667-496d-4aa8-93e8-7f1dab69fb16") : secret "maas-api-e2e-autores-1d073e-serving-cert" not found
Sep 18 19:54:32.702140 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.702118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b8b667-496d-4aa8-93e8-7f1dab69fb16-openshift-service-ca\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.704036 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.704015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-metrics-certs\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:32.710359 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:32.710337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94prx\" (UniqueName: \"kubernetes.io/projected/24b8b667-496d-4aa8-93e8-7f1dab69fb16-kube-api-access-94prx\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:33.207523 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:33.207489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:33.210251 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:33.210221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls\") pod \"maas-api-e2e-autores-1d073e-8c5785f65-4wxzn\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:33.415846 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:33.415687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:33.696596 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:33.696572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"]
Sep 18 19:54:33.698707 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:33.698682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b8b667_496d_4aa8_93e8_7f1dab69fb16.slice/crio-59109eee1346edf02f5a7aa2bf89a60dff40011e83117d6dfc89f5f8365611cf WatchSource:0}: Error finding container 59109eee1346edf02f5a7aa2bf89a60dff40011e83117d6dfc89f5f8365611cf: Status 404 returned error can't find the container with id 59109eee1346edf02f5a7aa2bf89a60dff40011e83117d6dfc89f5f8365611cf
Sep 18 19:54:34.301250 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.301224    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 19:54:34.339820 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.339724    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" event={"ID":"24b8b667-496d-4aa8-93e8-7f1dab69fb16","Type":"ContainerStarted","Data":"a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126"}
Sep 18 19:54:34.339820 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.339800    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:34.340088 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.339825    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" event={"ID":"24b8b667-496d-4aa8-93e8-7f1dab69fb16","Type":"ContainerStarted","Data":"59109eee1346edf02f5a7aa2bf89a60dff40011e83117d6dfc89f5f8365611cf"}
Sep 18 19:54:34.357156 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.357113    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" podStartSLOduration=1.976768409 podStartE2EDuration="2.357097825s" totalImagesPullingTime="380.329416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:34.356516133 +0000 UTC m=+910.115324119" watchObservedRunningTime="2026-09-18 19:54:34.357097825 +0000 UTC m=+910.115905810"
Sep 18 19:54:34.481815 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.481785    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"]
Sep 18 19:54:34.485753 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.485724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.488676 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.488649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6c083038-serving-cert\""
Sep 18 19:54:34.498387 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.498363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"]
Sep 18 19:54:34.624226 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.624135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-maas-api-tls\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.624226 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.624169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9febe5b1-cca4-4393-920e-dc036c2e8a78-openshift-service-ca\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.624226 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.624189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-metrics-certs\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.624507 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.624320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p22p\" (UniqueName: \"kubernetes.io/projected/9febe5b1-cca4-4393-920e-dc036c2e8a78-kube-api-access-8p22p\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.725401 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.725370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-maas-api-tls\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.725401 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.725404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9febe5b1-cca4-4393-920e-dc036c2e8a78-openshift-service-ca\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.725658 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.725425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-metrics-certs\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.725658 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.725475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p22p\" (UniqueName: \"kubernetes.io/projected/9febe5b1-cca4-4393-920e-dc036c2e8a78-kube-api-access-8p22p\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.726261 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.726169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9febe5b1-cca4-4393-920e-dc036c2e8a78-openshift-service-ca\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.728188 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.728165    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-metrics-certs\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.728287 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.728196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-maas-api-tls\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.733792 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.733768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p22p\" (UniqueName: \"kubernetes.io/projected/9febe5b1-cca4-4393-920e-dc036c2e8a78-kube-api-access-8p22p\") pod \"maas-api-e2e-ait-6c083038-85f676f769-2lhbm\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:34.798645 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:34.798620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:35.076180 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:35.076155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"]
Sep 18 19:54:35.078817 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:35.078789    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9febe5b1_cca4_4393_920e_dc036c2e8a78.slice/crio-f68ee42bf61f972489b0474bbc0c3028083466177a46e29d2ce4aa9bf5463089 WatchSource:0}: Error finding container f68ee42bf61f972489b0474bbc0c3028083466177a46e29d2ce4aa9bf5463089: Status 404 returned error can't find the container with id f68ee42bf61f972489b0474bbc0c3028083466177a46e29d2ce4aa9bf5463089
Sep 18 19:54:35.347095 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:35.347009    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm" event={"ID":"9febe5b1-cca4-4393-920e-dc036c2e8a78","Type":"ContainerStarted","Data":"f68ee42bf61f972489b0474bbc0c3028083466177a46e29d2ce4aa9bf5463089"}
Sep 18 19:54:36.276577 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:36.276548    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 19:54:36.356536 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:36.356504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm" event={"ID":"9febe5b1-cca4-4393-920e-dc036c2e8a78","Type":"ContainerStarted","Data":"888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04"}
Sep 18 19:54:36.356733 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:36.356641    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:36.375429 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:36.375381    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm" podStartSLOduration=1.983043305 podStartE2EDuration="2.375366273s" totalImagesPullingTime="392.322968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:36.373274511 +0000 UTC m=+912.132082497" watchObservedRunningTime="2026-09-18 19:54:36.375366273 +0000 UTC m=+912.134174257"
Sep 18 19:54:40.352714 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:40.352683    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:54:42.367624 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:42.367588    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:54:44.873582 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:44.873549    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"]
Sep 18 19:54:44.878324 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:44.878303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:44.880964 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:44.880938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d5f7da-serving-cert\""
Sep 18 19:54:44.888019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:44.887802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"]
Sep 18 19:54:45.033632 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.033593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-metrics-certs\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.033928 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.033725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.033928 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.033759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae23202-1dc8-496f-8c81-fec00aded250-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.034176 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.033917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskqw\" (UniqueName: \"kubernetes.io/projected/bae23202-1dc8-496f-8c81-fec00aded250-kube-api-access-cskqw\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.134735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.134665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-metrics-certs\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.134735 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.134727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.134961 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.134758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae23202-1dc8-496f-8c81-fec00aded250-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.134961 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.134825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cskqw\" (UniqueName: \"kubernetes.io/projected/bae23202-1dc8-496f-8c81-fec00aded250-kube-api-access-cskqw\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.134961 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:54:45.134869    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-serving-cert: secret "maas-api-e2e-inf-b-d5f7da-serving-cert" not found
Sep 18 19:54:45.134961 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:54:45.134955    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls podName:bae23202-1dc8-496f-8c81-fec00aded250 nodeName:}" failed. No retries permitted until 2026-09-18 19:54:45.634934441 +0000 UTC m=+921.393742404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls") pod "maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" (UID: "bae23202-1dc8-496f-8c81-fec00aded250") : secret "maas-api-e2e-inf-b-d5f7da-serving-cert" not found
Sep 18 19:54:45.135493 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.135471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae23202-1dc8-496f-8c81-fec00aded250-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.137284 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.137268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-metrics-certs\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.152457 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.152432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskqw\" (UniqueName: \"kubernetes.io/projected/bae23202-1dc8-496f-8c81-fec00aded250-kube-api-access-cskqw\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.640590 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.640544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.643334 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.643298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls\") pod \"maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:45.793827 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:45.793794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:46.070848 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:46.070820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"]
Sep 18 19:54:46.073524 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:54:46.073501    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae23202_1dc8_496f_8c81_fec00aded250.slice/crio-d2e23b4d668f759813db9b92778358b1f78a29d1f02909087576ec69fb5536c5 WatchSource:0}: Error finding container d2e23b4d668f759813db9b92778358b1f78a29d1f02909087576ec69fb5536c5: Status 404 returned error can't find the container with id d2e23b4d668f759813db9b92778358b1f78a29d1f02909087576ec69fb5536c5
Sep 18 19:54:46.414961 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:46.414834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" event={"ID":"bae23202-1dc8-496f-8c81-fec00aded250","Type":"ContainerStarted","Data":"d2e23b4d668f759813db9b92778358b1f78a29d1f02909087576ec69fb5536c5"}
Sep 18 19:54:47.421969 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:47.421936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" event={"ID":"bae23202-1dc8-496f-8c81-fec00aded250","Type":"ContainerStarted","Data":"87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d"}
Sep 18 19:54:47.422362 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:47.422140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:54:47.442207 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:47.442164    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" podStartSLOduration=2.972334541 podStartE2EDuration="3.442147587s" totalImagesPullingTime="469.813046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:47.440413256 +0000 UTC m=+923.199221252" watchObservedRunningTime="2026-09-18 19:54:47.442147587 +0000 UTC m=+923.200955573"
Sep 18 19:54:53.433019 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:54:53.432990    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 19:55:11.238766 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.238732    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"]
Sep 18 19:55:11.239322 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.239029    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm" podUID="9febe5b1-cca4-4393-920e-dc036c2e8a78" containerName="maas-api" containerID="cri-o://888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04" gracePeriod=30
Sep 18 19:55:11.495221 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.495160    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:55:11.553905 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.553842    2582 generic.go:356] "Generic (PLEG): container finished" podID="9febe5b1-cca4-4393-920e-dc036c2e8a78" containerID="888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04" exitCode=0
Sep 18 19:55:11.554074 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.553911    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"
Sep 18 19:55:11.554074 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.553936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm" event={"ID":"9febe5b1-cca4-4393-920e-dc036c2e8a78","Type":"ContainerDied","Data":"888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04"}
Sep 18 19:55:11.554074 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.554011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm" event={"ID":"9febe5b1-cca4-4393-920e-dc036c2e8a78","Type":"ContainerDied","Data":"f68ee42bf61f972489b0474bbc0c3028083466177a46e29d2ce4aa9bf5463089"}
Sep 18 19:55:11.554074 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.554045    2582 scope.go:117] "RemoveContainer" containerID="888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04"
Sep 18 19:55:11.565210 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.565189    2582 scope.go:117] "RemoveContainer" containerID="888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04"
Sep 18 19:55:11.565636 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:55:11.565619    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04\": container with ID starting with 888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04 not found: ID does not exist" containerID="888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04"
Sep 18 19:55:11.565716 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.565647    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04"} err="failed to get container status \"888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04\": rpc error: code = NotFound desc = could not find container \"888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04\": container with ID starting with 888009dccee4148247ded34fe74db9f222e64484d620b84f4c5c078832335d04 not found: ID does not exist"
Sep 18 19:55:11.584041 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.584018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-maas-api-tls\") pod \"9febe5b1-cca4-4393-920e-dc036c2e8a78\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") "
Sep 18 19:55:11.584185 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.584133    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p22p\" (UniqueName: \"kubernetes.io/projected/9febe5b1-cca4-4393-920e-dc036c2e8a78-kube-api-access-8p22p\") pod \"9febe5b1-cca4-4393-920e-dc036c2e8a78\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") "
Sep 18 19:55:11.584185 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.584165    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9febe5b1-cca4-4393-920e-dc036c2e8a78-openshift-service-ca\") pod \"9febe5b1-cca4-4393-920e-dc036c2e8a78\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") "
Sep 18 19:55:11.584302 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.584213    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-metrics-certs\") pod \"9febe5b1-cca4-4393-920e-dc036c2e8a78\" (UID: \"9febe5b1-cca4-4393-920e-dc036c2e8a78\") "
Sep 18 19:55:11.585075 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.585049    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9febe5b1-cca4-4393-920e-dc036c2e8a78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9febe5b1-cca4-4393-920e-dc036c2e8a78" (UID: "9febe5b1-cca4-4393-920e-dc036c2e8a78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:55:11.587367 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.587338    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9febe5b1-cca4-4393-920e-dc036c2e8a78" (UID: "9febe5b1-cca4-4393-920e-dc036c2e8a78"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:55:11.587658 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.587636    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9febe5b1-cca4-4393-920e-dc036c2e8a78" (UID: "9febe5b1-cca4-4393-920e-dc036c2e8a78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:55:11.588276 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.588246    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9febe5b1-cca4-4393-920e-dc036c2e8a78-kube-api-access-8p22p" (OuterVolumeSpecName: "kube-api-access-8p22p") pod "9febe5b1-cca4-4393-920e-dc036c2e8a78" (UID: "9febe5b1-cca4-4393-920e-dc036c2e8a78"). InnerVolumeSpecName "kube-api-access-8p22p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:55:11.685695 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.685665    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:55:11.685695 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.685694    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p22p\" (UniqueName: \"kubernetes.io/projected/9febe5b1-cca4-4393-920e-dc036c2e8a78-kube-api-access-8p22p\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:55:11.685958 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.685708    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9febe5b1-cca4-4393-920e-dc036c2e8a78-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:55:11.685958 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.685722    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9febe5b1-cca4-4393-920e-dc036c2e8a78-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:55:11.877045 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.877007    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"]
Sep 18 19:55:11.881448 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:11.881422    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6c083038-85f676f769-2lhbm"]
Sep 18 19:55:12.441996 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.441964    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9febe5b1-cca4-4393-920e-dc036c2e8a78" path="/var/lib/kubelet/pods/9febe5b1-cca4-4393-920e-dc036c2e8a78/volumes"
Sep 18 19:55:12.692393 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.692312    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"]
Sep 18 19:55:12.692819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.692806    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9febe5b1-cca4-4393-920e-dc036c2e8a78" containerName="maas-api"
Sep 18 19:55:12.692890 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.692821    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9febe5b1-cca4-4393-920e-dc036c2e8a78" containerName="maas-api"
Sep 18 19:55:12.692933 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.692899    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9febe5b1-cca4-4393-920e-dc036c2e8a78" containerName="maas-api"
Sep 18 19:55:12.697220 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.697200    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.701144 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.701113    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-64cc2d85-gw-openshift-default-dockercfg-tprw8\""
Sep 18 19:55:12.730795 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.730142    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"]
Sep 18 19:55:12.798327 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjq2\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-kube-api-access-5xjq2\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798327 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-certs\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798547 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-token\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798547 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c1be81f-a491-4e23-a85e-1528ac9c225e-istiod-ca-cert\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798547 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-podinfo\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798547 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-envoy\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798547 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-socket\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798749 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-data\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.798749 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.798636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-credential-socket\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900079 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c1be81f-a491-4e23-a85e-1528ac9c225e-istiod-ca-cert\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900079 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-podinfo\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900286 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-envoy\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900286 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-socket\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900286 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-data\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900286 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-credential-socket\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900477 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjq2\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-kube-api-access-5xjq2\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900477 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-certs\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900598 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-token\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900653 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-data\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-socket\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.900972 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.900952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-credential-socket\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.901088 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.901074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-certs\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.901131 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.901082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c1be81f-a491-4e23-a85e-1528ac9c225e-istiod-ca-cert\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.902956 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.902937    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-podinfo\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.903068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.902972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-envoy\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.927997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.927966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-token\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:12.940005 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:12.939979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjq2\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-kube-api-access-5xjq2\") pod \"e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") " pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:13.008139 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.008063    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:13.287809 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.287780    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"]
Sep 18 19:55:13.289353 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:55:13.289328    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1be81f_a491_4e23_a85e_1528ac9c225e.slice/crio-5460213546d6e5681484058d74f183f1526b81af7c258780d0aa5bebb6314380 WatchSource:0}: Error finding container 5460213546d6e5681484058d74f183f1526b81af7c258780d0aa5bebb6314380: Status 404 returned error can't find the container with id 5460213546d6e5681484058d74f183f1526b81af7c258780d0aa5bebb6314380
Sep 18 19:55:13.291632 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.291599    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:55:13.291725 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.291664    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:55:13.291725 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.291690    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:55:13.570589 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.570495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" event={"ID":"8c1be81f-a491-4e23-a85e-1528ac9c225e","Type":"ContainerStarted","Data":"5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"}
Sep 18 19:55:13.570589 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.570557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" event={"ID":"8c1be81f-a491-4e23-a85e-1528ac9c225e","Type":"ContainerStarted","Data":"5460213546d6e5681484058d74f183f1526b81af7c258780d0aa5bebb6314380"}
Sep 18 19:55:13.590411 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:13.590353    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podStartSLOduration=1.590333813 podStartE2EDuration="1.590333813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:55:13.58990979 +0000 UTC m=+949.348717776" watchObservedRunningTime="2026-09-18 19:55:13.590333813 +0000 UTC m=+949.349141797"
Sep 18 19:55:14.008896 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:14.008857    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:14.014387 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:14.014359    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:14.576627 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:14.576598    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:14.577745 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:14.577726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:35.694428 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:35.694395    2582 generic.go:356] "Generic (PLEG): container finished" podID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerID="5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1" exitCode=0
Sep 18 19:55:35.694917 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:35.694466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" event={"ID":"8c1be81f-a491-4e23-a85e-1528ac9c225e","Type":"ContainerDied","Data":"5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"}
Sep 18 19:55:35.694970 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:35.694909    2582 scope.go:117] "RemoveContainer" containerID="5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"
Sep 18 19:55:35.696257 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:35.696227    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:55:35.696364 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:35.696299    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:55:35.696364 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:35.696329    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:55:36.701938 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:36.701840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" event={"ID":"8c1be81f-a491-4e23-a85e-1528ac9c225e","Type":"ContainerStarted","Data":"89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478"}
Sep 18 19:55:37.008678 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:37.008604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:37.008811 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:37.008765    2582 patch_prober.go:28] interesting pod/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 19:55:37.008854 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:37.008803    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 19:55:38.009279 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:38.009239    2582 patch_prober.go:28] interesting pod/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 19:55:38.009766 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:38.009307    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 19:55:39.009348 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:39.009320    2582 patch_prober.go:28] interesting pod/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 19:55:39.009737 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:39.009369    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 19:55:40.008966 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:40.008933    2582 patch_prober.go:28] interesting pod/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 19:55:40.009147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:40.008987    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 19:55:41.009178 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:41.009143    2582 patch_prober.go:28] interesting pod/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 18 19:55:41.009546 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:41.009212    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 18 19:55:42.014507 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:42.014467    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:42.015176 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:42.015143    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:42.016215 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:42.016190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:55:57.211068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:57.211032    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"]
Sep 18 19:55:57.211512 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:55:57.211304    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy" containerID="cri-o://89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478" gracePeriod=30
Sep 18 19:56:02.475753 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.475724    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:56:02.614490 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-podinfo\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614490 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-token\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614490 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-socket\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614559    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xjq2\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-kube-api-access-5xjq2\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-credential-socket\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614622    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-envoy\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614643    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-certs\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c1be81f-a491-4e23-a85e-1528ac9c225e-istiod-ca-cert\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.614782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.614773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-data\") pod \"8c1be81f-a491-4e23-a85e-1528ac9c225e\" (UID: \"8c1be81f-a491-4e23-a85e-1528ac9c225e\") "
Sep 18 19:56:02.615321 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.615144    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:02.615415 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.615360    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:02.615415 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.615372    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:02.616025 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.615730    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c1be81f-a491-4e23-a85e-1528ac9c225e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:02.616231 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.616183    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:02.617311 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.617274    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:56:02.618287 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.618261    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:56:02.618402 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.618388    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:02.618517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.618493    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-kube-api-access-5xjq2" (OuterVolumeSpecName: "kube-api-access-5xjq2") pod "8c1be81f-a491-4e23-a85e-1528ac9c225e" (UID: "8c1be81f-a491-4e23-a85e-1528ac9c225e"). InnerVolumeSpecName "kube-api-access-5xjq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:56:02.716586 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716551    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716586 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716582    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716586 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716593    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xjq2\" (UniqueName: \"kubernetes.io/projected/8c1be81f-a491-4e23-a85e-1528ac9c225e-kube-api-access-5xjq2\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716603    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716611    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716619    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716626    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c1be81f-a491-4e23-a85e-1528ac9c225e-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716633    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.716819 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.716640    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c1be81f-a491-4e23-a85e-1528ac9c225e-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:56:02.855733 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.855700    2582 generic.go:356] "Generic (PLEG): container finished" podID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerID="89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478" exitCode=0
Sep 18 19:56:02.855916 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.855755    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"
Sep 18 19:56:02.855916 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.855787    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" event={"ID":"8c1be81f-a491-4e23-a85e-1528ac9c225e","Type":"ContainerDied","Data":"89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478"}
Sep 18 19:56:02.855916 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.855866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n" event={"ID":"8c1be81f-a491-4e23-a85e-1528ac9c225e","Type":"ContainerDied","Data":"5460213546d6e5681484058d74f183f1526b81af7c258780d0aa5bebb6314380"}
Sep 18 19:56:02.855916 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.855912    2582 scope.go:117] "RemoveContainer" containerID="89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478"
Sep 18 19:56:02.866473 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.866413    2582 scope.go:117] "RemoveContainer" containerID="5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"
Sep 18 19:56:02.875296 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.875277    2582 scope.go:117] "RemoveContainer" containerID="89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478"
Sep 18 19:56:02.875556 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:56:02.875539    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478\": container with ID starting with 89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478 not found: ID does not exist" containerID="89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478"
Sep 18 19:56:02.875604 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.875565    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478"} err="failed to get container status \"89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478\": rpc error: code = NotFound desc = could not find container \"89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478\": container with ID starting with 89259e84a18b03f0f749036bc27f5429f66400fa04ccbb2677e1cae4497f9478 not found: ID does not exist"
Sep 18 19:56:02.875604 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.875581    2582 scope.go:117] "RemoveContainer" containerID="5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"
Sep 18 19:56:02.875835 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:56:02.875821    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1\": container with ID starting with 5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1 not found: ID does not exist" containerID="5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"
Sep 18 19:56:02.875923 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.875838    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1"} err="failed to get container status \"5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1\": rpc error: code = NotFound desc = could not find container \"5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1\": container with ID starting with 5ccf498c6e518f21da1123ec548d344845da9787b339b23d4d5e008ea0f8d3f1 not found: ID does not exist"
Sep 18 19:56:02.887060 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.887038    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"]
Sep 18 19:56:02.892245 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:02.892222    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n"]
Sep 18 19:56:04.440704 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:04.440674    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" path="/var/lib/kubelet/pods/8c1be81f-a491-4e23-a85e-1528ac9c225e/volumes"
Sep 18 19:56:33.834469 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.834433    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"]
Sep 18 19:56:33.835014 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.834998    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy"
Sep 18 19:56:33.835068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.835017    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy"
Sep 18 19:56:33.835068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.835036    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy"
Sep 18 19:56:33.835068 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.835042    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy"
Sep 18 19:56:33.835163 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.835116    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy"
Sep 18 19:56:33.835163 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.835126    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c1be81f-a491-4e23-a85e-1528ac9c225e" containerName="istio-proxy"
Sep 18 19:56:33.839934 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.839905    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.842953 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.842925    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2c301e6b-openshift-default-dockercfg-lg6hk\""
Sep 18 19:56:33.852312 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.852288    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"]
Sep 18 19:56:33.929415 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-certs\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6fv\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-kube-api-access-gb6fv\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-credential-socket\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-istio-token\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78219bd-482e-468c-a05d-5020e5167183-istio-podinfo\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78219bd-482e-468c-a05d-5020e5167183-istiod-ca-cert\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929609 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-envoy\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929966 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-data\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:33.929966 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:33.929673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-socket\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-istio-token\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78219bd-482e-468c-a05d-5020e5167183-istio-podinfo\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78219bd-482e-468c-a05d-5020e5167183-istiod-ca-cert\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-envoy\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-data\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-socket\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-certs\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6fv\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-kube-api-access-gb6fv\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.033908 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.033480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-credential-socket\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.034532 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.034035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-data\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.035038 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.034625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-credential-socket\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.035038 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.034915    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-socket\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.035226 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.035113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-certs\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.035334 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.035311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78219bd-482e-468c-a05d-5020e5167183-istiod-ca-cert\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.037540 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.037511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-envoy\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.037782 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.037751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78219bd-482e-468c-a05d-5020e5167183-istio-podinfo\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.042549 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.042525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-istio-token\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.042960 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.042939    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6fv\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-kube-api-access-gb6fv\") pod \"e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") " pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.151455 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.151367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:34.431811 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.431784    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"]
Sep 18 19:56:34.434089 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:56:34.434058    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78219bd_482e_468c_a05d_5020e5167183.slice/crio-b55d1e56e07db0151872de2fcc67e2972bff6f543b6dcc7bc0e95b289a9b91bf WatchSource:0}: Error finding container b55d1e56e07db0151872de2fcc67e2972bff6f543b6dcc7bc0e95b289a9b91bf: Status 404 returned error can't find the container with id b55d1e56e07db0151872de2fcc67e2972bff6f543b6dcc7bc0e95b289a9b91bf
Sep 18 19:56:34.436938 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.436869    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:56:34.437030 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.436989    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:56:34.437030 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:34.437018    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:56:35.043124 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:35.043087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" event={"ID":"f78219bd-482e-468c-a05d-5020e5167183","Type":"ContainerStarted","Data":"a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"}
Sep 18 19:56:35.043540 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:35.043153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" event={"ID":"f78219bd-482e-468c-a05d-5020e5167183","Type":"ContainerStarted","Data":"b55d1e56e07db0151872de2fcc67e2972bff6f543b6dcc7bc0e95b289a9b91bf"}
Sep 18 19:56:35.063359 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:35.063306    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" podStartSLOduration=2.063286987 podStartE2EDuration="2.063286987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:35.06260836 +0000 UTC m=+1030.821416368" watchObservedRunningTime="2026-09-18 19:56:35.063286987 +0000 UTC m=+1030.822094977"
Sep 18 19:56:35.151723 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:35.151694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:35.157171 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:35.157142    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:36.048613 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:36.048588    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:36.049608 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:36.049590    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:56:40.366640 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.366603    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"]
Sep 18 19:56:40.371173 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.371154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.373976 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.373951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2c301e6b-serving-cert\""
Sep 18 19:56:40.383311 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.383225    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"]
Sep 18 19:56:40.502812 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.502777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-metrics-certs\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.502997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.502837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lthxn\" (UniqueName: \"kubernetes.io/projected/7f71145b-9d4b-4f46-8451-42239d798621-kube-api-access-lthxn\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.502997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.502908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f71145b-9d4b-4f46-8451-42239d798621-openshift-service-ca\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.502997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.502944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.603917 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.603870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lthxn\" (UniqueName: \"kubernetes.io/projected/7f71145b-9d4b-4f46-8451-42239d798621-kube-api-access-lthxn\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.604110 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.603939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f71145b-9d4b-4f46-8451-42239d798621-openshift-service-ca\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.604110 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.603968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.604110 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.604050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-metrics-certs\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.604308 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:56:40.604211    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-serving-cert: secret "maas-api-e2e-derive-2c301e6b-serving-cert" not found
Sep 18 19:56:40.604308 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:56:40.604287    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls podName:7f71145b-9d4b-4f46-8451-42239d798621 nodeName:}" failed. No retries permitted until 2026-09-18 19:56:41.10426633 +0000 UTC m=+1036.863074296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls") pod "maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" (UID: "7f71145b-9d4b-4f46-8451-42239d798621") : secret "maas-api-e2e-derive-2c301e6b-serving-cert" not found
Sep 18 19:56:40.604642 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.604616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f71145b-9d4b-4f46-8451-42239d798621-openshift-service-ca\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.606750 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.606733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-metrics-certs\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:40.613558 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:40.613532    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lthxn\" (UniqueName: \"kubernetes.io/projected/7f71145b-9d4b-4f46-8451-42239d798621-kube-api-access-lthxn\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:41.109454 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:41.109415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:41.112046 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:41.112015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls\") pod \"maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:41.284923 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:41.284869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:41.559995 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:41.559972    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"]
Sep 18 19:56:41.561423 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:56:41.561397    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f71145b_9d4b_4f46_8451_42239d798621.slice/crio-04243f8c0b1695b1a00de9e61690d84a75257d3758b06607f416199d3adad17d WatchSource:0}: Error finding container 04243f8c0b1695b1a00de9e61690d84a75257d3758b06607f416199d3adad17d: Status 404 returned error can't find the container with id 04243f8c0b1695b1a00de9e61690d84a75257d3758b06607f416199d3adad17d
Sep 18 19:56:41.562861 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:41.562842    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:56:42.080389 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:42.080349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" event={"ID":"7f71145b-9d4b-4f46-8451-42239d798621","Type":"ContainerStarted","Data":"ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0"}
Sep 18 19:56:42.080561 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:42.080423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" event={"ID":"7f71145b-9d4b-4f46-8451-42239d798621","Type":"ContainerStarted","Data":"04243f8c0b1695b1a00de9e61690d84a75257d3758b06607f416199d3adad17d"}
Sep 18 19:56:42.080561 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:42.080545    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:56:42.096786 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:42.096723    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" podStartSLOduration=1.706087825 podStartE2EDuration="2.096708945s" totalImagesPullingTime="390.62112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:42.095667733 +0000 UTC m=+1037.854475717" watchObservedRunningTime="2026-09-18 19:56:42.096708945 +0000 UTC m=+1037.855516929"
Sep 18 19:56:48.091642 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:56:48.091612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:57:01.240942 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.240901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"]
Sep 18 19:57:01.241387 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.241166    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" podUID="24b8b667-496d-4aa8-93e8-7f1dab69fb16" containerName="maas-api" containerID="cri-o://a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126" gracePeriod=30
Sep 18 19:57:01.523242 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.523156    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:57:01.623909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.622693    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls\") pod \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") "
Sep 18 19:57:01.623909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.622763    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94prx\" (UniqueName: \"kubernetes.io/projected/24b8b667-496d-4aa8-93e8-7f1dab69fb16-kube-api-access-94prx\") pod \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") "
Sep 18 19:57:01.623909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.622804    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-metrics-certs\") pod \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") "
Sep 18 19:57:01.623909 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.622895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b8b667-496d-4aa8-93e8-7f1dab69fb16-openshift-service-ca\") pod \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\" (UID: \"24b8b667-496d-4aa8-93e8-7f1dab69fb16\") "
Sep 18 19:57:01.625037 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.624982    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b8b667-496d-4aa8-93e8-7f1dab69fb16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24b8b667-496d-4aa8-93e8-7f1dab69fb16" (UID: "24b8b667-496d-4aa8-93e8-7f1dab69fb16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:01.630573 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.630531    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "24b8b667-496d-4aa8-93e8-7f1dab69fb16" (UID: "24b8b667-496d-4aa8-93e8-7f1dab69fb16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:57:01.631090 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.631058    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b8b667-496d-4aa8-93e8-7f1dab69fb16-kube-api-access-94prx" (OuterVolumeSpecName: "kube-api-access-94prx") pod "24b8b667-496d-4aa8-93e8-7f1dab69fb16" (UID: "24b8b667-496d-4aa8-93e8-7f1dab69fb16"). InnerVolumeSpecName "kube-api-access-94prx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:01.631290 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.631264    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24b8b667-496d-4aa8-93e8-7f1dab69fb16" (UID: "24b8b667-496d-4aa8-93e8-7f1dab69fb16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:57:01.724595 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.724561    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b8b667-496d-4aa8-93e8-7f1dab69fb16-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:01.724595 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.724599    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:01.724810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.724612    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94prx\" (UniqueName: \"kubernetes.io/projected/24b8b667-496d-4aa8-93e8-7f1dab69fb16-kube-api-access-94prx\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:01.724810 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:01.724623    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24b8b667-496d-4aa8-93e8-7f1dab69fb16-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:02.195277 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.195242    2582 generic.go:356] "Generic (PLEG): container finished" podID="24b8b667-496d-4aa8-93e8-7f1dab69fb16" containerID="a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126" exitCode=0
Sep 18 19:57:02.195453 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.195300    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"
Sep 18 19:57:02.195453 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.195301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" event={"ID":"24b8b667-496d-4aa8-93e8-7f1dab69fb16","Type":"ContainerDied","Data":"a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126"}
Sep 18 19:57:02.195453 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.195440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn" event={"ID":"24b8b667-496d-4aa8-93e8-7f1dab69fb16","Type":"ContainerDied","Data":"59109eee1346edf02f5a7aa2bf89a60dff40011e83117d6dfc89f5f8365611cf"}
Sep 18 19:57:02.195627 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.195462    2582 scope.go:117] "RemoveContainer" containerID="a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126"
Sep 18 19:57:02.206680 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.206658    2582 scope.go:117] "RemoveContainer" containerID="a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126"
Sep 18 19:57:02.207043 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:57:02.207020    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126\": container with ID starting with a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126 not found: ID does not exist" containerID="a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126"
Sep 18 19:57:02.207152 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.207049    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126"} err="failed to get container status \"a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126\": rpc error: code = NotFound desc = could not find container \"a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126\": container with ID starting with a95a3df841a3b57f083fdbdc79db392e17cacbb97f65f621917ece5c2e5f7126 not found: ID does not exist"
Sep 18 19:57:02.218380 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.218353    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"]
Sep 18 19:57:02.221999 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.221974    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-1d073e-8c5785f65-4wxzn"]
Sep 18 19:57:02.441893 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:02.441836    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24b8b667-496d-4aa8-93e8-7f1dab69fb16" path="/var/lib/kubelet/pods/24b8b667-496d-4aa8-93e8-7f1dab69fb16/volumes"
Sep 18 19:57:04.208071 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:04.207989    2582 generic.go:356] "Generic (PLEG): container finished" podID="f78219bd-482e-468c-a05d-5020e5167183" containerID="a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad" exitCode=0
Sep 18 19:57:04.208071 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:04.208059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" event={"ID":"f78219bd-482e-468c-a05d-5020e5167183","Type":"ContainerDied","Data":"a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"}
Sep 18 19:57:04.208519 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:04.208503    2582 scope.go:117] "RemoveContainer" containerID="a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"
Sep 18 19:57:04.209771 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:04.209744    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:57:04.209836 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:04.209826    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:57:04.209897 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:04.209860    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:57:05.218424 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:05.218378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" event={"ID":"f78219bd-482e-468c-a05d-5020e5167183","Type":"ContainerStarted","Data":"9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1"}
Sep 18 19:57:06.049271 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:06.049237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:57:06.152490 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:06.152455    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:57:06.153699 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:06.153674    2582 patch_prober.go:28] interesting pod/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:57:06.153831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:06.153721    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 18 19:57:07.151789 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.151747    2582 patch_prober.go:28] interesting pod/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:57:07.152305 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.151814    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 18 19:57:07.205217 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.205177    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"]
Sep 18 19:57:07.205426 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.205398    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" podUID="7f71145b-9d4b-4f46-8451-42239d798621" containerName="maas-api" containerID="cri-o://ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0" gracePeriod=30
Sep 18 19:57:07.536213 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.535891    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:57:07.588106 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.588078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls\") pod \"7f71145b-9d4b-4f46-8451-42239d798621\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") "
Sep 18 19:57:07.588450 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.588430    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f71145b-9d4b-4f46-8451-42239d798621-openshift-service-ca\") pod \"7f71145b-9d4b-4f46-8451-42239d798621\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") "
Sep 18 19:57:07.588670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.588653    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-metrics-certs\") pod \"7f71145b-9d4b-4f46-8451-42239d798621\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") "
Sep 18 19:57:07.589018 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.588753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f71145b-9d4b-4f46-8451-42239d798621-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f71145b-9d4b-4f46-8451-42239d798621" (UID: "7f71145b-9d4b-4f46-8451-42239d798621"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:07.589018 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.588783    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lthxn\" (UniqueName: \"kubernetes.io/projected/7f71145b-9d4b-4f46-8451-42239d798621-kube-api-access-lthxn\") pod \"7f71145b-9d4b-4f46-8451-42239d798621\" (UID: \"7f71145b-9d4b-4f46-8451-42239d798621\") "
Sep 18 19:57:07.589233 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.589212    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f71145b-9d4b-4f46-8451-42239d798621-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.590980 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.590944    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f71145b-9d4b-4f46-8451-42239d798621" (UID: "7f71145b-9d4b-4f46-8451-42239d798621"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:57:07.591499 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.591453    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7f71145b-9d4b-4f46-8451-42239d798621" (UID: "7f71145b-9d4b-4f46-8451-42239d798621"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:57:07.595541 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.595479    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f71145b-9d4b-4f46-8451-42239d798621-kube-api-access-lthxn" (OuterVolumeSpecName: "kube-api-access-lthxn") pod "7f71145b-9d4b-4f46-8451-42239d798621" (UID: "7f71145b-9d4b-4f46-8451-42239d798621"). InnerVolumeSpecName "kube-api-access-lthxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:07.607925 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.607808    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"]
Sep 18 19:57:07.690693 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.690663    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.690693 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.690693    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f71145b-9d4b-4f46-8451-42239d798621-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.690949 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:07.690707    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lthxn\" (UniqueName: \"kubernetes.io/projected/7f71145b-9d4b-4f46-8451-42239d798621-kube-api-access-lthxn\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:08.152211 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.152124    2582 patch_prober.go:28] interesting pod/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:57:08.152211 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.152181    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 18 19:57:08.266182 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.266150    2582 generic.go:356] "Generic (PLEG): container finished" podID="7f71145b-9d4b-4f46-8451-42239d798621" containerID="ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0" exitCode=0
Sep 18 19:57:08.266341 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.266213    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"
Sep 18 19:57:08.266341 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.266227    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" event={"ID":"7f71145b-9d4b-4f46-8451-42239d798621","Type":"ContainerDied","Data":"ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0"}
Sep 18 19:57:08.266341 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.266282    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf" event={"ID":"7f71145b-9d4b-4f46-8451-42239d798621","Type":"ContainerDied","Data":"04243f8c0b1695b1a00de9e61690d84a75257d3758b06607f416199d3adad17d"}
Sep 18 19:57:08.266341 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.266296    2582 scope.go:117] "RemoveContainer" containerID="ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0"
Sep 18 19:57:08.266966 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.266866    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy" containerID="cri-o://9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1" gracePeriod=30
Sep 18 19:57:08.278728 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.278708    2582 scope.go:117] "RemoveContainer" containerID="ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0"
Sep 18 19:57:08.279067 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:57:08.279041    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0\": container with ID starting with ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0 not found: ID does not exist" containerID="ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0"
Sep 18 19:57:08.279150 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.279080    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0"} err="failed to get container status \"ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0\": rpc error: code = NotFound desc = could not find container \"ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0\": container with ID starting with ae36d3a65a2270cdf1eb1c8dfecbb2fe39ffc98efb14f6dab3110c1489f258e0 not found: ID does not exist"
Sep 18 19:57:08.317906 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.314215    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"]
Sep 18 19:57:08.319644 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.319610    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2c301e6b-7474bbf785-ck6nf"]
Sep 18 19:57:08.445000 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:08.444965    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f71145b-9d4b-4f46-8451-42239d798621" path="/var/lib/kubelet/pods/7f71145b-9d4b-4f46-8451-42239d798621/volumes"
Sep 18 19:57:16.044427 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.044401    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:57:16.180432 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180399    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78219bd-482e-468c-a05d-5020e5167183-istio-podinfo\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180597 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-credential-socket\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180597 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78219bd-482e-468c-a05d-5020e5167183-istiod-ca-cert\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180597 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180491    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-data\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180597 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180528    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb6fv\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-kube-api-access-gb6fv\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180798 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180614    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-certs\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180798 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180645    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-socket\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180798 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180670    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-istio-token\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180798 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180717    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-envoy\") pod \"f78219bd-482e-468c-a05d-5020e5167183\" (UID: \"f78219bd-482e-468c-a05d-5020e5167183\") "
Sep 18 19:57:16.180798 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180733    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:16.181106 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180936    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:16.181106 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-data" (OuterVolumeSpecName: "istio-data") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:16.181106 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.180970    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f78219bd-482e-468c-a05d-5020e5167183-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:16.181106 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.181044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:16.181304 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.181147    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.181304 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.181164    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.181304 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.181178    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.181304 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.181190    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f78219bd-482e-468c-a05d-5020e5167183-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.181304 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.181203    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.182982 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.182953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-kube-api-access-gb6fv" (OuterVolumeSpecName: "kube-api-access-gb6fv") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "kube-api-access-gb6fv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:16.183105 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.182952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f78219bd-482e-468c-a05d-5020e5167183-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:57:16.183162 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.183134    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:16.183162 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.183146    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-istio-token" (OuterVolumeSpecName: "istio-token") pod "f78219bd-482e-468c-a05d-5020e5167183" (UID: "f78219bd-482e-468c-a05d-5020e5167183"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:16.282484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.282455    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.282484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.282480    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f78219bd-482e-468c-a05d-5020e5167183-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.282484 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.282489    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f78219bd-482e-468c-a05d-5020e5167183-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.282705 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.282498    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb6fv\" (UniqueName: \"kubernetes.io/projected/f78219bd-482e-468c-a05d-5020e5167183-kube-api-access-gb6fv\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:57:16.313259 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.313228    2582 generic.go:356] "Generic (PLEG): container finished" podID="f78219bd-482e-468c-a05d-5020e5167183" containerID="9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1" exitCode=0
Sep 18 19:57:16.313434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.313281    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"
Sep 18 19:57:16.313434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.313296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" event={"ID":"f78219bd-482e-468c-a05d-5020e5167183","Type":"ContainerDied","Data":"9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1"}
Sep 18 19:57:16.313434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.313352    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m" event={"ID":"f78219bd-482e-468c-a05d-5020e5167183","Type":"ContainerDied","Data":"b55d1e56e07db0151872de2fcc67e2972bff6f543b6dcc7bc0e95b289a9b91bf"}
Sep 18 19:57:16.313434 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.313383    2582 scope.go:117] "RemoveContainer" containerID="9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1"
Sep 18 19:57:16.324463 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.324446    2582 scope.go:117] "RemoveContainer" containerID="a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"
Sep 18 19:57:16.332837 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.332819    2582 scope.go:117] "RemoveContainer" containerID="9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1"
Sep 18 19:57:16.333108 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:57:16.333091    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1\": container with ID starting with 9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1 not found: ID does not exist" containerID="9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1"
Sep 18 19:57:16.333166 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.333116    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1"} err="failed to get container status \"9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1\": rpc error: code = NotFound desc = could not find container \"9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1\": container with ID starting with 9a51842a1baad3e0ecb30da3af81c8c7f9733df8761ad17f1debdd4721d56eb1 not found: ID does not exist"
Sep 18 19:57:16.333166 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.333132    2582 scope.go:117] "RemoveContainer" containerID="a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"
Sep 18 19:57:16.333360 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:57:16.333340    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad\": container with ID starting with a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad not found: ID does not exist" containerID="a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"
Sep 18 19:57:16.333409 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.333370    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad"} err="failed to get container status \"a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad\": rpc error: code = NotFound desc = could not find container \"a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad\": container with ID starting with a75fac9c22c3b0ccb85c9f7c8f158863caf211f58683b74c947dfe89e27e42ad not found: ID does not exist"
Sep 18 19:57:16.338805 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.338783    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"]
Sep 18 19:57:16.348993 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.348968    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m"]
Sep 18 19:57:16.441682 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:16.441609    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f78219bd-482e-468c-a05d-5020e5167183" path="/var/lib/kubelet/pods/f78219bd-482e-468c-a05d-5020e5167183/volumes"
Sep 18 19:57:45.117329 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117295    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"]
Sep 18 19:57:45.117738 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117724    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy"
Sep 18 19:57:45.117779 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117740    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy"
Sep 18 19:57:45.117779 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117758    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f71145b-9d4b-4f46-8451-42239d798621" containerName="maas-api"
Sep 18 19:57:45.117779 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117764    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f71145b-9d4b-4f46-8451-42239d798621" containerName="maas-api"
Sep 18 19:57:45.117895 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117780    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b8b667-496d-4aa8-93e8-7f1dab69fb16" containerName="maas-api"
Sep 18 19:57:45.117895 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117785    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b8b667-496d-4aa8-93e8-7f1dab69fb16" containerName="maas-api"
Sep 18 19:57:45.117895 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117850    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b8b667-496d-4aa8-93e8-7f1dab69fb16" containerName="maas-api"
Sep 18 19:57:45.117895 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117855    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy"
Sep 18 19:57:45.117895 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.117862    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f71145b-9d4b-4f46-8451-42239d798621" containerName="maas-api"
Sep 18 19:57:45.121122 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.121101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.127506 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.127485    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-be2171-openshift-default-dockercfg-4pnl8\""
Sep 18 19:57:45.142863 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.142839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-socket\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.142997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.142912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-token\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.142997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.142942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istiod-ca-cert\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.142997 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.142967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-credential-socket\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.143163 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.143070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-envoy\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.143163 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.143116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrrt9\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-kube-api-access-lrrt9\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.143163 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.143147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-certs\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.143323 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.143185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-data\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.143323 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.143278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-podinfo\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.146342 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.146320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"]
Sep 18 19:57:45.244042 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-credential-socket\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-envoy\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrrt9\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-kube-api-access-lrrt9\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244232 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-certs\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244410 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-data\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244410 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-podinfo\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-socket\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-credential-socket\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244517 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-token\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istiod-ca-cert\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-certs\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244670 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-data\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.244829 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.244749    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-socket\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.245202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.245181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istiod-ca-cert\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.246516 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.246497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-envoy\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.247065 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.247047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-podinfo\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.252590 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.252569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-token\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.252687 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.252640    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrrt9\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-kube-api-access-lrrt9\") pod \"e2e-explicit-be2171-openshift-default-c98f567c6-6d2md\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") " pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.432203 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.432169    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:45.709465 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.709435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"]
Sep 18 19:57:45.711095 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:57:45.711071    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59a0e69_dce9_476c_a5e4_e1da06971ca7.slice/crio-03b8acced0e2793ae22dd2673d98e2239d8374be331482a596f57cae2cb66bd1 WatchSource:0}: Error finding container 03b8acced0e2793ae22dd2673d98e2239d8374be331482a596f57cae2cb66bd1: Status 404 returned error can't find the container with id 03b8acced0e2793ae22dd2673d98e2239d8374be331482a596f57cae2cb66bd1
Sep 18 19:57:45.713797 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.713758    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:57:45.713962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.713845    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:57:45.713962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:45.713904    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:57:46.481088 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:46.481058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" event={"ID":"e59a0e69-dce9-476c-a5e4-e1da06971ca7","Type":"ContainerStarted","Data":"1f9a7452e1e7c74c4dbd260473c27ecc7eb7b8c014ce4f19187dff9e50cd7bed"}
Sep 18 19:57:46.481472 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:46.481116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" event={"ID":"e59a0e69-dce9-476c-a5e4-e1da06971ca7","Type":"ContainerStarted","Data":"03b8acced0e2793ae22dd2673d98e2239d8374be331482a596f57cae2cb66bd1"}
Sep 18 19:57:46.503415 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:46.503362    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podStartSLOduration=1.5033468380000001 podStartE2EDuration="1.503346838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:57:46.502689623 +0000 UTC m=+1102.261497609" watchObservedRunningTime="2026-09-18 19:57:46.503346838 +0000 UTC m=+1102.262154822"
Sep 18 19:57:47.432342 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:47.432317    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:47.437665 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:47.437640    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:47.486319 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:47.486296    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:47.487273 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:47.487258    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:57:51.568971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.568939    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"]
Sep 18 19:57:51.569431 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.569415    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy"
Sep 18 19:57:51.569496 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.569431    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy"
Sep 18 19:57:51.569553 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.569501    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78219bd-482e-468c-a05d-5020e5167183" containerName="istio-proxy"
Sep 18 19:57:51.572954 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.572928    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.576688 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.576668    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-be2171-serving-cert\""
Sep 18 19:57:51.585869 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.585848    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"]
Sep 18 19:57:51.710727 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.710699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-metrics-certs\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.710962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.710733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-maas-api-tls\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.710962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.710763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k49v\" (UniqueName: \"kubernetes.io/projected/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-kube-api-access-9k49v\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.710962 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.710851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-openshift-service-ca\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.812057 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.812018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-openshift-service-ca\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.812275 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.812188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-metrics-certs\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.812275 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.812225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-maas-api-tls\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.812275 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.812261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k49v\" (UniqueName: \"kubernetes.io/projected/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-kube-api-access-9k49v\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.812856 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.812828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-openshift-service-ca\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.815001 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.814972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-metrics-certs\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.815128 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.815114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-maas-api-tls\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.822171 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.822117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k49v\" (UniqueName: \"kubernetes.io/projected/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-kube-api-access-9k49v\") pod \"maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:51.886014 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:51.885980    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:52.167869 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:52.167840    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"]
Sep 18 19:57:52.169091 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:57:52.169064    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2325df_8fe9_4dff_8515_6b19ec6f0bd5.slice/crio-28b274489ae0154fad1e4897dccbb207c1611eb0670e7e12c67efa5d5deb9834 WatchSource:0}: Error finding container 28b274489ae0154fad1e4897dccbb207c1611eb0670e7e12c67efa5d5deb9834: Status 404 returned error can't find the container with id 28b274489ae0154fad1e4897dccbb207c1611eb0670e7e12c67efa5d5deb9834
Sep 18 19:57:52.511924 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:52.511867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" event={"ID":"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5","Type":"ContainerStarted","Data":"28b274489ae0154fad1e4897dccbb207c1611eb0670e7e12c67efa5d5deb9834"}
Sep 18 19:57:53.520646 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:53.520611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" event={"ID":"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5","Type":"ContainerStarted","Data":"ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07"}
Sep 18 19:57:53.521363 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:53.520675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:57:53.541179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:53.541086    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" podStartSLOduration=2.12984291 podStartE2EDuration="2.541063651s" totalImagesPullingTime="411.220741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:57:53.53830061 +0000 UTC m=+1109.297108594" watchObservedRunningTime="2026-09-18 19:57:53.541063651 +0000 UTC m=+1109.299871637"
Sep 18 19:57:59.532980 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:57:59.532946    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:58:16.663362 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:16.663271    2582 generic.go:356] "Generic (PLEG): container finished" podID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerID="1f9a7452e1e7c74c4dbd260473c27ecc7eb7b8c014ce4f19187dff9e50cd7bed" exitCode=0
Sep 18 19:58:16.663362 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:16.663346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" event={"ID":"e59a0e69-dce9-476c-a5e4-e1da06971ca7","Type":"ContainerDied","Data":"1f9a7452e1e7c74c4dbd260473c27ecc7eb7b8c014ce4f19187dff9e50cd7bed"}
Sep 18 19:58:16.663841 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:16.663826    2582 scope.go:117] "RemoveContainer" containerID="1f9a7452e1e7c74c4dbd260473c27ecc7eb7b8c014ce4f19187dff9e50cd7bed"
Sep 18 19:58:16.664990 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:16.664965    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:58:16.665052 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:16.665028    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:58:16.665088 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:16.665059    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 19:58:17.487095 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:17.487061    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:58:17.671051 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:17.671018    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" event={"ID":"e59a0e69-dce9-476c-a5e4-e1da06971ca7","Type":"ContainerStarted","Data":"d983bdfd44798494a92d417594e5648451b8935b284f1168a27d8042426d8354"}
Sep 18 19:58:18.433209 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:18.433133    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:58:18.442478 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:18.442021    2582 patch_prober.go:28] interesting pod/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 18 19:58:18.442478 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:18.442080    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 18 19:58:19.433315 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:19.433269    2582 patch_prober.go:28] interesting pod/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 18 19:58:19.433809 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:19.433354    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 18 19:58:20.433059 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:20.433020    2582 patch_prober.go:28] interesting pod/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 18 19:58:20.433368 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:20.433334    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 18 19:58:21.433040 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:21.433003    2582 patch_prober.go:28] interesting pod/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 18 19:58:21.433344 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:21.433313    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 18 19:58:22.433541 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:22.433500    2582 patch_prober.go:28] interesting pod/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 18 19:58:22.434724 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:22.434214    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 18 19:58:23.436811 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:23.436784    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:58:23.437201 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:23.437068    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:58:23.437865 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:23.437844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:58:54.394846 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.394807    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"]
Sep 18 19:58:54.398130 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.398109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.401109 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.401089    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-870f71c0-serving-cert\""
Sep 18 19:58:54.416700 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.416677    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"]
Sep 18 19:58:54.446377 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.446332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b03af98-00df-498b-b2ef-95644d2a6614-openshift-service-ca\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.446541 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.446477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7d5f\" (UniqueName: \"kubernetes.io/projected/4b03af98-00df-498b-b2ef-95644d2a6614-kube-api-access-p7d5f\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.446605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.446539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-metrics-certs\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.446693 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.446658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.547971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.547938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.548147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.548035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b03af98-00df-498b-b2ef-95644d2a6614-openshift-service-ca\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.548147 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.548112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7d5f\" (UniqueName: \"kubernetes.io/projected/4b03af98-00df-498b-b2ef-95644d2a6614-kube-api-access-p7d5f\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.548147 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:58:54.548134    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-serving-cert: secret "maas-api-e2e-mt-870f71c0-serving-cert" not found
Sep 18 19:58:54.548347 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.548165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-metrics-certs\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.548347 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:58:54.548224    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls podName:4b03af98-00df-498b-b2ef-95644d2a6614 nodeName:}" failed. No retries permitted until 2026-09-18 19:58:55.048200615 +0000 UTC m=+1170.807008596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls") pod "maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" (UID: "4b03af98-00df-498b-b2ef-95644d2a6614") : secret "maas-api-e2e-mt-870f71c0-serving-cert" not found
Sep 18 19:58:54.548752 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.548729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b03af98-00df-498b-b2ef-95644d2a6614-openshift-service-ca\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.550837 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.550810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-metrics-certs\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:54.559195 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:54.559170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7d5f\" (UniqueName: \"kubernetes.io/projected/4b03af98-00df-498b-b2ef-95644d2a6614-kube-api-access-p7d5f\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:55.052282 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:55.052252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:55.054747 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:55.054725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls\") pod \"maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:55.308605 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:55.308524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:55.590013 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:55.589988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"]
Sep 18 19:58:55.592303 ip-10-0-143-228 kubenswrapper[2582]: W0918 19:58:55.592274    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b03af98_00df_498b_b2ef_95644d2a6614.slice/crio-a26fbd3602133dcf047b6080598960a87781bbeeab299108775edaf510b3dc7c WatchSource:0}: Error finding container a26fbd3602133dcf047b6080598960a87781bbeeab299108775edaf510b3dc7c: Status 404 returned error can't find the container with id a26fbd3602133dcf047b6080598960a87781bbeeab299108775edaf510b3dc7c
Sep 18 19:58:55.883981 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:55.883898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" event={"ID":"4b03af98-00df-498b-b2ef-95644d2a6614","Type":"ContainerStarted","Data":"a26fbd3602133dcf047b6080598960a87781bbeeab299108775edaf510b3dc7c"}
Sep 18 19:58:56.891840 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:56.891797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" event={"ID":"4b03af98-00df-498b-b2ef-95644d2a6614","Type":"ContainerStarted","Data":"a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e"}
Sep 18 19:58:56.892242 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:56.891868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:58:56.911134 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:58:56.911087    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" podStartSLOduration=2.30693525 podStartE2EDuration="2.911071127s" totalImagesPullingTime="604.135877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:58:56.90944761 +0000 UTC m=+1172.668255598" watchObservedRunningTime="2026-09-18 19:58:56.911071127 +0000 UTC m=+1172.669879112"
Sep 18 19:59:02.904531 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:02.904505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:59:26.463770 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:26.463738    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:59:26.464381 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:26.464362    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 19:59:26.468761 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:26.468743    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:59:26.469322 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:26.469297    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 19:59:34.409737 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.409706    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"]
Sep 18 19:59:34.410305 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.410262    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" podUID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" containerName="maas-api" containerID="cri-o://ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07" gracePeriod=30
Sep 18 19:59:34.527100 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.526952    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" podUID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.57:8443/health\": dial tcp 10.134.0.57:8443: connect: connection refused"
Sep 18 19:59:34.668501 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.668444    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:59:34.757497 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.757467    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-openshift-service-ca\") pod \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") "
Sep 18 19:59:34.757696 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.757595    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k49v\" (UniqueName: \"kubernetes.io/projected/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-kube-api-access-9k49v\") pod \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") "
Sep 18 19:59:34.757696 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.757649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-maas-api-tls\") pod \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") "
Sep 18 19:59:34.757696 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.757691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-metrics-certs\") pod \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\" (UID: \"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5\") "
Sep 18 19:59:34.757912 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.757842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" (UID: "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:34.758185 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.758162    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:34.759933 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.759849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" (UID: "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:59:34.759933 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.759866    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-kube-api-access-9k49v" (OuterVolumeSpecName: "kube-api-access-9k49v") pod "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" (UID: "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5"). InnerVolumeSpecName "kube-api-access-9k49v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:34.760240 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.760222    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" (UID: "8f2325df-8fe9-4dff-8515-6b19ec6f0bd5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:59:34.859672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.859629    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k49v\" (UniqueName: \"kubernetes.io/projected/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-kube-api-access-9k49v\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:34.859672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.859657    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:34.859672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:34.859670    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:35.118633 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.118599    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" containerID="ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07" exitCode=0
Sep 18 19:59:35.118831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.118657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" event={"ID":"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5","Type":"ContainerDied","Data":"ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07"}
Sep 18 19:59:35.118831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.118663    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"
Sep 18 19:59:35.118831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.118726    2582 scope.go:117] "RemoveContainer" containerID="ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07"
Sep 18 19:59:35.118831 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.118713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt" event={"ID":"8f2325df-8fe9-4dff-8515-6b19ec6f0bd5","Type":"ContainerDied","Data":"28b274489ae0154fad1e4897dccbb207c1611eb0670e7e12c67efa5d5deb9834"}
Sep 18 19:59:35.129470 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.129429    2582 scope.go:117] "RemoveContainer" containerID="ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07"
Sep 18 19:59:35.129775 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:59:35.129750    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07\": container with ID starting with ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07 not found: ID does not exist" containerID="ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07"
Sep 18 19:59:35.129871 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.129782    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07"} err="failed to get container status \"ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07\": rpc error: code = NotFound desc = could not find container \"ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07\": container with ID starting with ac6a7310875269e9b9d2b44ed521f24a8ce60794bdb834a786e772d071622e07 not found: ID does not exist"
Sep 18 19:59:35.143168 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.143147    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"]
Sep 18 19:59:35.148400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:35.148379    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-be2171-5c86c9d55b-vxrkt"]
Sep 18 19:59:36.441125 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:36.441084    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" path="/var/lib/kubelet/pods/8f2325df-8fe9-4dff-8515-6b19ec6f0bd5/volumes"
Sep 18 19:59:39.364342 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.364308    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"]
Sep 18 19:59:39.364718 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.364568    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" podUID="4b03af98-00df-498b-b2ef-95644d2a6614" containerName="maas-api" containerID="cri-o://a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e" gracePeriod=30
Sep 18 19:59:39.629202 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.629139    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:59:39.714457 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.714418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls\") pod \"4b03af98-00df-498b-b2ef-95644d2a6614\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") "
Sep 18 19:59:39.715238 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.715215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b03af98-00df-498b-b2ef-95644d2a6614-openshift-service-ca\") pod \"4b03af98-00df-498b-b2ef-95644d2a6614\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") "
Sep 18 19:59:39.715850 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.715833    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7d5f\" (UniqueName: \"kubernetes.io/projected/4b03af98-00df-498b-b2ef-95644d2a6614-kube-api-access-p7d5f\") pod \"4b03af98-00df-498b-b2ef-95644d2a6614\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") "
Sep 18 19:59:39.716016 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.716002    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-metrics-certs\") pod \"4b03af98-00df-498b-b2ef-95644d2a6614\" (UID: \"4b03af98-00df-498b-b2ef-95644d2a6614\") "
Sep 18 19:59:39.716964 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.715732    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b03af98-00df-498b-b2ef-95644d2a6614-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b03af98-00df-498b-b2ef-95644d2a6614" (UID: "4b03af98-00df-498b-b2ef-95644d2a6614"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:39.720065 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.720021    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b03af98-00df-498b-b2ef-95644d2a6614" (UID: "4b03af98-00df-498b-b2ef-95644d2a6614"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:59:39.720065 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.720041    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b03af98-00df-498b-b2ef-95644d2a6614-kube-api-access-p7d5f" (OuterVolumeSpecName: "kube-api-access-p7d5f") pod "4b03af98-00df-498b-b2ef-95644d2a6614" (UID: "4b03af98-00df-498b-b2ef-95644d2a6614"). InnerVolumeSpecName "kube-api-access-p7d5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:39.722971 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.722945    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b03af98-00df-498b-b2ef-95644d2a6614" (UID: "4b03af98-00df-498b-b2ef-95644d2a6614"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:59:39.817179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.817141    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7d5f\" (UniqueName: \"kubernetes.io/projected/4b03af98-00df-498b-b2ef-95644d2a6614-kube-api-access-p7d5f\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:39.817179 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.817177    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:39.817430 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.817191    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b03af98-00df-498b-b2ef-95644d2a6614-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:39.817430 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:39.817203    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b03af98-00df-498b-b2ef-95644d2a6614-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:40.149479 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.149446    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b03af98-00df-498b-b2ef-95644d2a6614" containerID="a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e" exitCode=0
Sep 18 19:59:40.149656 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.149496    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"
Sep 18 19:59:40.149656 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.149525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" event={"ID":"4b03af98-00df-498b-b2ef-95644d2a6614","Type":"ContainerDied","Data":"a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e"}
Sep 18 19:59:40.149656 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.149575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln" event={"ID":"4b03af98-00df-498b-b2ef-95644d2a6614","Type":"ContainerDied","Data":"a26fbd3602133dcf047b6080598960a87781bbeeab299108775edaf510b3dc7c"}
Sep 18 19:59:40.149656 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.149596    2582 scope.go:117] "RemoveContainer" containerID="a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e"
Sep 18 19:59:40.159604 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.159589    2582 scope.go:117] "RemoveContainer" containerID="a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e"
Sep 18 19:59:40.159901 ip-10-0-143-228 kubenswrapper[2582]: E0918 19:59:40.159853    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e\": container with ID starting with a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e not found: ID does not exist" containerID="a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e"
Sep 18 19:59:40.159957 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.159904    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e"} err="failed to get container status \"a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e\": rpc error: code = NotFound desc = could not find container \"a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e\": container with ID starting with a45bd8abf047600873913e359f0ed86f11cb6fe73079acf8b55f5acdf74f312e not found: ID does not exist"
Sep 18 19:59:40.173290 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.173258    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"]
Sep 18 19:59:40.176983 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.176962    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-870f71c0-854657bd5c-4g6ln"]
Sep 18 19:59:40.441479 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:40.441452    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b03af98-00df-498b-b2ef-95644d2a6614" path="/var/lib/kubelet/pods/4b03af98-00df-498b-b2ef-95644d2a6614/volumes"
Sep 18 19:59:42.057995 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:42.057959    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"]
Sep 18 19:59:42.058446 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:42.058227    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy" containerID="cri-o://d983bdfd44798494a92d417594e5648451b8935b284f1168a27d8042426d8354" gracePeriod=30
Sep 18 19:59:47.191672 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.191642    2582 generic.go:356] "Generic (PLEG): container finished" podID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerID="d983bdfd44798494a92d417594e5648451b8935b284f1168a27d8042426d8354" exitCode=0
Sep 18 19:59:47.192099 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.191719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" event={"ID":"e59a0e69-dce9-476c-a5e4-e1da06971ca7","Type":"ContainerDied","Data":"d983bdfd44798494a92d417594e5648451b8935b284f1168a27d8042426d8354"}
Sep 18 19:59:47.192099 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.191801    2582 scope.go:117] "RemoveContainer" containerID="1f9a7452e1e7c74c4dbd260473c27ecc7eb7b8c014ce4f19187dff9e50cd7bed"
Sep 18 19:59:47.328513 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.328439    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:59:47.497422 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrrt9\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-kube-api-access-lrrt9\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.497625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497430    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-certs\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.497625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497488    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-credential-socket\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.497625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497505    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-token\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.497625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497540    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istiod-ca-cert\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.497625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-envoy\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.497625 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-socket\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.498029 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-data\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.498029 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497680    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-podinfo\") pod \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\" (UID: \"e59a0e69-dce9-476c-a5e4-e1da06971ca7\") "
Sep 18 19:59:47.498029 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.497792    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:47.498795 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.498519    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:47.498933 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.498794    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:47.499001 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.498965    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.499056 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.498996    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:47.500343 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.499127    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:47.506698 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.506447    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-kube-api-access-lrrt9" (OuterVolumeSpecName: "kube-api-access-lrrt9") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "kube-api-access-lrrt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:47.509233 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.509208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:47.510795 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.510763    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:59:47.511008 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.510980    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e59a0e69-dce9-476c-a5e4-e1da06971ca7" (UID: "e59a0e69-dce9-476c-a5e4-e1da06971ca7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600431    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600470    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600485    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrrt9\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-kube-api-access-lrrt9\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600500    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600514    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600528    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600535 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600541    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:47.600929 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:47.600555    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59a0e69-dce9-476c-a5e4-e1da06971ca7-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 19:59:48.200123 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:48.200085    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"
Sep 18 19:59:48.200123 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:48.200109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md" event={"ID":"e59a0e69-dce9-476c-a5e4-e1da06971ca7","Type":"ContainerDied","Data":"03b8acced0e2793ae22dd2673d98e2239d8374be331482a596f57cae2cb66bd1"}
Sep 18 19:59:48.200634 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:48.200206    2582 scope.go:117] "RemoveContainer" containerID="d983bdfd44798494a92d417594e5648451b8935b284f1168a27d8042426d8354"
Sep 18 19:59:48.224400 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:48.224371    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"]
Sep 18 19:59:48.227818 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:48.227794    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md"]
Sep 18 19:59:48.441374 ip-10-0-143-228 kubenswrapper[2582]: I0918 19:59:48.441337    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" path="/var/lib/kubelet/pods/e59a0e69-dce9-476c-a5e4-e1da06971ca7/volumes"
Sep 18 20:00:00.593843 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.593809    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"]
Sep 18 20:00:00.594496 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594475    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594500    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594527    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594535    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b03af98-00df-498b-b2ef-95644d2a6614" containerName="maas-api"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594552    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b03af98-00df-498b-b2ef-95644d2a6614" containerName="maas-api"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594570    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" containerName="maas-api"
Sep 18 20:00:00.594585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594578    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" containerName="maas-api"
Sep 18 20:00:00.594954 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594683    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2325df-8fe9-4dff-8515-6b19ec6f0bd5" containerName="maas-api"
Sep 18 20:00:00.594954 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594697    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy"
Sep 18 20:00:00.594954 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594708    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b03af98-00df-498b-b2ef-95644d2a6614" containerName="maas-api"
Sep 18 20:00:00.594954 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.594719    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59a0e69-dce9-476c-a5e4-e1da06971ca7" containerName="istio-proxy"
Sep 18 20:00:00.599934 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.599911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.602628 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.602604    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-047bea-openshift-default-dockercfg-wlrqh\""
Sep 18 20:00:00.611176 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.611149    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"]
Sep 18 20:00:00.627539 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-socket\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.627686 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/369dc456-dba4-41c1-9766-845af390e37b-istiod-ca-cert\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.627686 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-data\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.627816 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5z9\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-kube-api-access-2r5z9\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.627816 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/369dc456-dba4-41c1-9766-845af390e37b-istio-podinfo\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.627920 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-certs\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.627965 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-credential-socket\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.628017 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.627961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-envoy\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.628017 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.628005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-istio-token\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.728989 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.728950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5z9\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-kube-api-access-2r5z9\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.728989 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/369dc456-dba4-41c1-9766-845af390e37b-istio-podinfo\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729256 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-certs\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729256 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-credential-socket\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729256 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-envoy\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729256 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-istio-token\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729256 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-socket\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/369dc456-dba4-41c1-9766-845af390e37b-istiod-ca-cert\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-data\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729627 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729514    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-certs\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729627 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-data\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729806 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-credential-socket\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.729921 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.729807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-socket\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.730315 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.730291    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/369dc456-dba4-41c1-9766-845af390e37b-istiod-ca-cert\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.731888 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.731855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/369dc456-dba4-41c1-9766-845af390e37b-istio-podinfo\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.732057 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.732040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-envoy\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.738333 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.738307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5z9\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-kube-api-access-2r5z9\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.738487 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.738467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-istio-token\") pod \"e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") " pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:00.911423 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:00.911341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:01.192801 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.192775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"]
Sep 18 20:00:01.194446 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:00:01.194416    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369dc456_dba4_41c1_9766_845af390e37b.slice/crio-5f3609ad5e60958b3c04962b761874a9fc46eb6d2152a64254838ca1850389d5 WatchSource:0}: Error finding container 5f3609ad5e60958b3c04962b761874a9fc46eb6d2152a64254838ca1850389d5: Status 404 returned error can't find the container with id 5f3609ad5e60958b3c04962b761874a9fc46eb6d2152a64254838ca1850389d5
Sep 18 20:00:01.196856 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.196823    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:00:01.196976 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.196946    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:00:01.197041 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.196993    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:00:01.281514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.281481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" event={"ID":"369dc456-dba4-41c1-9766-845af390e37b","Type":"ContainerStarted","Data":"cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"}
Sep 18 20:00:01.281681 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.281543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" event={"ID":"369dc456-dba4-41c1-9766-845af390e37b","Type":"ContainerStarted","Data":"5f3609ad5e60958b3c04962b761874a9fc46eb6d2152a64254838ca1850389d5"}
Sep 18 20:00:01.319156 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.319094    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podStartSLOduration=1.319071207 podStartE2EDuration="1.319071207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:01.31675333 +0000 UTC m=+1237.075561315" watchObservedRunningTime="2026-09-18 20:00:01.319071207 +0000 UTC m=+1237.077879194"
Sep 18 20:00:01.911606 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:01.911572    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:02.918514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:02.918484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:03.293583 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:03.293551    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:03.294490 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:03.294471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:06.696574 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.696496    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"]
Sep 18 20:00:06.700917 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.700894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.705275 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.705250    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-047bea-serving-cert\""
Sep 18 20:00:06.724357 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.724329    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"]
Sep 18 20:00:06.790895 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.790845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.791090 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.790939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.791090 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.790974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.791090 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.791030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tkvn\" (UniqueName: \"kubernetes.io/projected/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-kube-api-access-9tkvn\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.892171 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.892139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.892366 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.892195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.892366 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.892247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkvn\" (UniqueName: \"kubernetes.io/projected/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-kube-api-access-9tkvn\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.892488 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.892449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.892905 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.892848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.894818 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.894801    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.894982 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.894962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:06.900852 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:06.900826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkvn\" (UniqueName: \"kubernetes.io/projected/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-kube-api-access-9tkvn\") pod \"maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:07.012490 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:07.012407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:07.305800 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:07.305767    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"]
Sep 18 20:00:07.307758 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:00:07.307731    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f0637a_ab1e_45f9_b15c_fa967a725a1e.slice/crio-c14855adc5f848c419309845cb333bfdd40caf9bb82bf348614da8b00e0560cf WatchSource:0}: Error finding container c14855adc5f848c419309845cb333bfdd40caf9bb82bf348614da8b00e0560cf: Status 404 returned error can't find the container with id c14855adc5f848c419309845cb333bfdd40caf9bb82bf348614da8b00e0560cf
Sep 18 20:00:07.319794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:07.319761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d" event={"ID":"d1f0637a-ab1e-45f9-b15c-fa967a725a1e","Type":"ContainerStarted","Data":"c14855adc5f848c419309845cb333bfdd40caf9bb82bf348614da8b00e0560cf"}
Sep 18 20:00:08.326864 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:08.326832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d" event={"ID":"d1f0637a-ab1e-45f9-b15c-fa967a725a1e","Type":"ContainerStarted","Data":"16cb72d2fe7f1ee91f74f6dd5b031e3aa88bb13e78fa132ce378e484af625d2e"}
Sep 18 20:00:08.327272 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:08.326922    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:08.355123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:08.355070    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d" podStartSLOduration=2.009484219 podStartE2EDuration="2.3550567s" totalImagesPullingTime="345.572481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:08.35335726 +0000 UTC m=+1244.112165248" watchObservedRunningTime="2026-09-18 20:00:08.3550567 +0000 UTC m=+1244.113864684"
Sep 18 20:00:14.340331 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:14.340302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:00:26.442179 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:26.442149    2582 generic.go:356] "Generic (PLEG): container finished" podID="369dc456-dba4-41c1-9766-845af390e37b" containerID="cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc" exitCode=0
Sep 18 20:00:26.442714 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:26.442225    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" event={"ID":"369dc456-dba4-41c1-9766-845af390e37b","Type":"ContainerDied","Data":"cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"}
Sep 18 20:00:26.442785 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:26.442731    2582 scope.go:117] "RemoveContainer" containerID="cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"
Sep 18 20:00:26.444037 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:26.444008    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:00:26.444135 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:26.444074    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:00:26.444135 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:26.444105    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:00:27.450618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:27.450579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" event={"ID":"369dc456-dba4-41c1-9766-845af390e37b","Type":"ContainerStarted","Data":"4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb"}
Sep 18 20:00:27.911855 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:27.911768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:27.912082 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:27.912054    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 20:00:27.912152 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:27.912108    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 20:00:28.911815 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:28.911782    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 20:00:28.912295 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:28.911840    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 20:00:29.912414 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:29.912361    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 20:00:29.912958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:29.912454    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 20:00:30.912068 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:30.912033    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 20:00:30.912402 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:30.912375    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 20:00:31.912051 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:31.912013    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 20:00:31.912650 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:31.912094    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 20:00:32.912432 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:32.912385    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 18 20:00:32.912974 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:32.912456    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 18 20:00:33.294200 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:33.294165    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:33.919482 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:33.919447    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:33.921524 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:33.921498    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:00:41.404009 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.403974    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"]
Sep 18 20:00:41.407018 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.407000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.410102 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.410075    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-9838c2-serving-cert\""
Sep 18 20:00:41.422177 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.422151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"]
Sep 18 20:00:41.458001 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.457966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.458172 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.458005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b958t\" (UniqueName: \"kubernetes.io/projected/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-kube-api-access-b958t\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.458172 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.458094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.458290 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.458202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.559083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.559050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.559083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.559085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b958t\" (UniqueName: \"kubernetes.io/projected/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-kube-api-access-b958t\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.559369 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.559130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.559369 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.559190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.559369 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:00:41.559269    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-serving-cert: secret "maas-api-e2e-shared-b-w2-9838c2-serving-cert" not found
Sep 18 20:00:41.559369 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:00:41.559341    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls podName:c6e26e13-f1a0-41d9-95f9-b85bd94f2421 nodeName:}" failed. No retries permitted until 2026-09-18 20:00:42.059326232 +0000 UTC m=+1277.818134194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls") pod "maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" (UID: "c6e26e13-f1a0-41d9-95f9-b85bd94f2421") : secret "maas-api-e2e-shared-b-w2-9838c2-serving-cert" not found
Sep 18 20:00:41.559978 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.559955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.561687 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.561663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:41.568125 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:41.568105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b958t\" (UniqueName: \"kubernetes.io/projected/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-kube-api-access-b958t\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:42.063787 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:42.063754    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:42.066322 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:42.066304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:42.319809 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:42.319727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:42.594568 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:42.594541    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"]
Sep 18 20:00:42.596175 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:00:42.596143    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e26e13_f1a0_41d9_95f9_b85bd94f2421.slice/crio-a779be58dd78842bd7ce2f5731931a4d8e12494f623dbe944d0101533f285802 WatchSource:0}: Error finding container a779be58dd78842bd7ce2f5731931a4d8e12494f623dbe944d0101533f285802: Status 404 returned error can't find the container with id a779be58dd78842bd7ce2f5731931a4d8e12494f623dbe944d0101533f285802
Sep 18 20:00:43.547499 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:43.547461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" event={"ID":"c6e26e13-f1a0-41d9-95f9-b85bd94f2421","Type":"ContainerStarted","Data":"42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17"}
Sep 18 20:00:43.547691 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:43.547539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:43.547691 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:43.547562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" event={"ID":"c6e26e13-f1a0-41d9-95f9-b85bd94f2421","Type":"ContainerStarted","Data":"a779be58dd78842bd7ce2f5731931a4d8e12494f623dbe944d0101533f285802"}
Sep 18 20:00:43.574801 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:43.574761    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" podStartSLOduration=2.214313558 podStartE2EDuration="2.574744798s" totalImagesPullingTime="360.43124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:43.573336089 +0000 UTC m=+1279.332144077" watchObservedRunningTime="2026-09-18 20:00:43.574744798 +0000 UTC m=+1279.333552824"
Sep 18 20:00:49.558648 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:49.558619    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:00:58.079333 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.079301    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7522-861b91"]
Sep 18 20:00:58.082262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.082245    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:00:58.085596 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.085573    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ls85n\""
Sep 18 20:00:58.090041 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.089913    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-861b91"]
Sep 18 20:00:58.236809 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.236770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcbg\" (UniqueName: \"kubernetes.io/projected/da60b974-6c6d-4d29-b1a4-ddaef5c85054-kube-api-access-gqcbg\") pod \"test-curl-7522-861b91\" (UID: \"da60b974-6c6d-4d29-b1a4-ddaef5c85054\") " pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:00:58.337858 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.337780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcbg\" (UniqueName: \"kubernetes.io/projected/da60b974-6c6d-4d29-b1a4-ddaef5c85054-kube-api-access-gqcbg\") pod \"test-curl-7522-861b91\" (UID: \"da60b974-6c6d-4d29-b1a4-ddaef5c85054\") " pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:00:58.351134 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.351106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcbg\" (UniqueName: \"kubernetes.io/projected/da60b974-6c6d-4d29-b1a4-ddaef5c85054-kube-api-access-gqcbg\") pod \"test-curl-7522-861b91\" (UID: \"da60b974-6c6d-4d29-b1a4-ddaef5c85054\") " pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:00:58.392965 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.392936    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:00:58.670845 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:58.670803    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-861b91"]
Sep 18 20:00:58.673172 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:00:58.673149    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda60b974_6c6d_4d29_b1a4_ddaef5c85054.slice/crio-678551ac2eb85db93bf6cf255436d678b55301e930d1cca5a3b1b7afd0c9fff9 WatchSource:0}: Error finding container 678551ac2eb85db93bf6cf255436d678b55301e930d1cca5a3b1b7afd0c9fff9: Status 404 returned error can't find the container with id 678551ac2eb85db93bf6cf255436d678b55301e930d1cca5a3b1b7afd0c9fff9
Sep 18 20:00:59.537239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.537195    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"]
Sep 18 20:00:59.537741 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.537559    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm" podUID="2b4c6aab-4780-4cfb-99b3-10d442aa89d7" containerName="maas-api" containerID="cri-o://0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0" gracePeriod=30
Sep 18 20:00:59.608258 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.608224    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"]
Sep 18 20:00:59.608641 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.608490    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8" podUID="cc78949d-0da8-4a24-90ea-f02d6c8594bd" containerName="payload-processing" containerID="cri-o://f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b" gracePeriod=30
Sep 18 20:00:59.668005 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.665334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-861b91" event={"ID":"da60b974-6c6d-4d29-b1a4-ddaef5c85054","Type":"ContainerStarted","Data":"1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3"}
Sep 18 20:00:59.668005 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.665386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-861b91" event={"ID":"da60b974-6c6d-4d29-b1a4-ddaef5c85054","Type":"ContainerStarted","Data":"678551ac2eb85db93bf6cf255436d678b55301e930d1cca5a3b1b7afd0c9fff9"}
Sep 18 20:00:59.687099 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.686567    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7522-861b91" podStartSLOduration=0.991646702 podStartE2EDuration="1.6865452s" totalImagesPullingTime="694.898498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:59.685973576 +0000 UTC m=+1295.444781562" watchObservedRunningTime="2026-09-18 20:00:59.6865452 +0000 UTC m=+1295.445353185"
Sep 18 20:00:59.892492 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.892475    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 20:00:59.896773 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:00:59.896753    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 20:01:00.054812 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.054777    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngqx4\" (UniqueName: \"kubernetes.io/projected/cc78949d-0da8-4a24-90ea-f02d6c8594bd-kube-api-access-ngqx4\") pod \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") "
Sep 18 20:01:00.055000 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.054905    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-openshift-service-ca\") pod \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") "
Sep 18 20:01:00.055000 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.054989    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj967\" (UniqueName: \"kubernetes.io/projected/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-kube-api-access-xj967\") pod \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") "
Sep 18 20:01:00.055091 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055045    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc78949d-0da8-4a24-90ea-f02d6c8594bd-plugins-config-volume\") pod \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\" (UID: \"cc78949d-0da8-4a24-90ea-f02d6c8594bd\") "
Sep 18 20:01:00.055138 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055108    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-metrics-certs\") pod \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") "
Sep 18 20:01:00.055201 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-maas-api-tls\") pod \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\" (UID: \"2b4c6aab-4780-4cfb-99b3-10d442aa89d7\") "
Sep 18 20:01:00.055201 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055181    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b4c6aab-4780-4cfb-99b3-10d442aa89d7" (UID: "2b4c6aab-4780-4cfb-99b3-10d442aa89d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:01:00.055438 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055410    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc78949d-0da8-4a24-90ea-f02d6c8594bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc78949d-0da8-4a24-90ea-f02d6c8594bd" (UID: "cc78949d-0da8-4a24-90ea-f02d6c8594bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:01:00.055615 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055591    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc78949d-0da8-4a24-90ea-f02d6c8594bd-plugins-config-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.055696 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.055623    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.057261 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.057232    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc78949d-0da8-4a24-90ea-f02d6c8594bd-kube-api-access-ngqx4" (OuterVolumeSpecName: "kube-api-access-ngqx4") pod "cc78949d-0da8-4a24-90ea-f02d6c8594bd" (UID: "cc78949d-0da8-4a24-90ea-f02d6c8594bd"). InnerVolumeSpecName "kube-api-access-ngqx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:00.057547 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.057519    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b4c6aab-4780-4cfb-99b3-10d442aa89d7" (UID: "2b4c6aab-4780-4cfb-99b3-10d442aa89d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:01:00.057547 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.057533    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-kube-api-access-xj967" (OuterVolumeSpecName: "kube-api-access-xj967") pod "2b4c6aab-4780-4cfb-99b3-10d442aa89d7" (UID: "2b4c6aab-4780-4cfb-99b3-10d442aa89d7"). InnerVolumeSpecName "kube-api-access-xj967". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:00.057789 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.057768    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b4c6aab-4780-4cfb-99b3-10d442aa89d7" (UID: "2b4c6aab-4780-4cfb-99b3-10d442aa89d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:01:00.156545 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.156467    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj967\" (UniqueName: \"kubernetes.io/projected/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-kube-api-access-xj967\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.156545 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.156503    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.156545 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.156517    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b4c6aab-4780-4cfb-99b3-10d442aa89d7-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.156545 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.156530    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngqx4\" (UniqueName: \"kubernetes.io/projected/cc78949d-0da8-4a24-90ea-f02d6c8594bd-kube-api-access-ngqx4\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.332055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.332021    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7522-861b91"]
Sep 18 20:01:00.337922 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.337897    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7522-861b91"]
Sep 18 20:01:00.456344 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456322    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7522-efa3d9"]
Sep 18 20:01:00.456741 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456730    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4c6aab-4780-4cfb-99b3-10d442aa89d7" containerName="maas-api"
Sep 18 20:01:00.456794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456743    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4c6aab-4780-4cfb-99b3-10d442aa89d7" containerName="maas-api"
Sep 18 20:01:00.456794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456771    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc78949d-0da8-4a24-90ea-f02d6c8594bd" containerName="payload-processing"
Sep 18 20:01:00.456794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456776    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc78949d-0da8-4a24-90ea-f02d6c8594bd" containerName="payload-processing"
Sep 18 20:01:00.456794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456786    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da60b974-6c6d-4d29-b1a4-ddaef5c85054" containerName="test-curl-7522-861b91"
Sep 18 20:01:00.456794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456791    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da60b974-6c6d-4d29-b1a4-ddaef5c85054" containerName="test-curl-7522-861b91"
Sep 18 20:01:00.456973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456856    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4c6aab-4780-4cfb-99b3-10d442aa89d7" containerName="maas-api"
Sep 18 20:01:00.456973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456863    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc78949d-0da8-4a24-90ea-f02d6c8594bd" containerName="payload-processing"
Sep 18 20:01:00.456973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.456889    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da60b974-6c6d-4d29-b1a4-ddaef5c85054" containerName="test-curl-7522-861b91"
Sep 18 20:01:00.459972 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.459953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:00.475622 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.475592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-efa3d9"]
Sep 18 20:01:00.562042 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.562009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnmdc\" (UniqueName: \"kubernetes.io/projected/586c4802-97d0-44ec-9b35-90021042857a-kube-api-access-pnmdc\") pod \"test-curl-7522-efa3d9\" (UID: \"586c4802-97d0-44ec-9b35-90021042857a\") " pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:00.663083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.663048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnmdc\" (UniqueName: \"kubernetes.io/projected/586c4802-97d0-44ec-9b35-90021042857a-kube-api-access-pnmdc\") pod \"test-curl-7522-efa3d9\" (UID: \"586c4802-97d0-44ec-9b35-90021042857a\") " pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:00.672164 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.672134    2582 generic.go:356] "Generic (PLEG): container finished" podID="cc78949d-0da8-4a24-90ea-f02d6c8594bd" containerID="f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b" exitCode=0
Sep 18 20:01:00.672285 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.672196    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"
Sep 18 20:01:00.672285 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.672224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8" event={"ID":"cc78949d-0da8-4a24-90ea-f02d6c8594bd","Type":"ContainerDied","Data":"f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b"}
Sep 18 20:01:00.672417 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.672309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8" event={"ID":"cc78949d-0da8-4a24-90ea-f02d6c8594bd","Type":"ContainerDied","Data":"7d3e84e9ce61d2482a90c9f9c35b95d5f950dc26b10d63a564f2fb90d12c0ede"}
Sep 18 20:01:00.672417 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.672338    2582 scope.go:117] "RemoveContainer" containerID="f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b"
Sep 18 20:01:00.673659 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.673638    2582 generic.go:356] "Generic (PLEG): container finished" podID="2b4c6aab-4780-4cfb-99b3-10d442aa89d7" containerID="0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0" exitCode=0
Sep 18 20:01:00.673719 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.673689    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"
Sep 18 20:01:00.673774 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.673723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm" event={"ID":"2b4c6aab-4780-4cfb-99b3-10d442aa89d7","Type":"ContainerDied","Data":"0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0"}
Sep 18 20:01:00.673774 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.673771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm" event={"ID":"2b4c6aab-4780-4cfb-99b3-10d442aa89d7","Type":"ContainerDied","Data":"1616ce5b62b09e3f00572085520f2dbd3552a2b654011571f13a7450d7723f45"}
Sep 18 20:01:00.674070 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:00.674039    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7522-861b91" container="test-curl-7522-861b91"
Sep 18 20:01:00.678567 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.678545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnmdc\" (UniqueName: \"kubernetes.io/projected/586c4802-97d0-44ec-9b35-90021042857a-kube-api-access-pnmdc\") pod \"test-curl-7522-efa3d9\" (UID: \"586c4802-97d0-44ec-9b35-90021042857a\") " pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:00.681923 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.681872    2582 scope.go:117] "RemoveContainer" containerID="f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b"
Sep 18 20:01:00.682220 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:00.682203    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b\": container with ID starting with f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b not found: ID does not exist" containerID="f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b"
Sep 18 20:01:00.682309 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.682231    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b"} err="failed to get container status \"f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b\": rpc error: code = NotFound desc = could not find container \"f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b\": container with ID starting with f035d42cbc5b85abaa2d85b98a30bf314150290ca5c3c440aea236da29919c1b not found: ID does not exist"
Sep 18 20:01:00.682309 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.682252    2582 scope.go:117] "RemoveContainer" containerID="0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0"
Sep 18 20:01:00.691434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.691420    2582 scope.go:117] "RemoveContainer" containerID="0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0"
Sep 18 20:01:00.691714 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:00.691697    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0\": container with ID starting with 0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0 not found: ID does not exist" containerID="0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0"
Sep 18 20:01:00.691781 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.691723    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0"} err="failed to get container status \"0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0\": rpc error: code = NotFound desc = could not find container \"0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0\": container with ID starting with 0d014dbe6fd88d6cfbaab412eab5f83ab8728254712d5b489e0181f78652b4d0 not found: ID does not exist"
Sep 18 20:01:00.710864 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.710800    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"]
Sep 18 20:01:00.731794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.731769    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8"]
Sep 18 20:01:00.759441 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.759415    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"]
Sep 18 20:01:00.772421 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.772393    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d6291d-5b96d4b4d9-5hxfm"]
Sep 18 20:01:00.776207 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:00.776192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:01.054717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:01.054695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-efa3d9"]
Sep 18 20:01:01.056827 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:01:01.056798    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod586c4802_97d0_44ec_9b35_90021042857a.slice/crio-4a0a39d0e63a10f436f8c9706338c01e3bf4e57592e7d47a57218614934b7e77 WatchSource:0}: Error finding container 4a0a39d0e63a10f436f8c9706338c01e3bf4e57592e7d47a57218614934b7e77: Status 404 returned error can't find the container with id 4a0a39d0e63a10f436f8c9706338c01e3bf4e57592e7d47a57218614934b7e77
Sep 18 20:01:01.682484 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:01.682446    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-efa3d9" event={"ID":"586c4802-97d0-44ec-9b35-90021042857a","Type":"ContainerStarted","Data":"cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35"}
Sep 18 20:01:01.682892 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:01.682493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-efa3d9" event={"ID":"586c4802-97d0-44ec-9b35-90021042857a","Type":"ContainerStarted","Data":"4a0a39d0e63a10f436f8c9706338c01e3bf4e57592e7d47a57218614934b7e77"}
Sep 18 20:01:01.682892 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:01.682596    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7522-861b91" podUID="da60b974-6c6d-4d29-b1a4-ddaef5c85054" containerName="test-curl-7522-861b91" containerID="cri-o://1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3" gracePeriod=2
Sep 18 20:01:01.697970 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:01.697924    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7522-efa3d9" podStartSLOduration=1.6979070969999999 podStartE2EDuration="1.697907097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:01.697138674 +0000 UTC m=+1297.455946660" watchObservedRunningTime="2026-09-18 20:01:01.697907097 +0000 UTC m=+1297.456715072"
Sep 18 20:01:02.313218 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.313173    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7522-efa3d9"]
Sep 18 20:01:02.317316 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.317286    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7522-efa3d9"]
Sep 18 20:01:02.443055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.443010    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4c6aab-4780-4cfb-99b3-10d442aa89d7" path="/var/lib/kubelet/pods/2b4c6aab-4780-4cfb-99b3-10d442aa89d7/volumes"
Sep 18 20:01:02.443609 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.443587    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc78949d-0da8-4a24-90ea-f02d6c8594bd" path="/var/lib/kubelet/pods/cc78949d-0da8-4a24-90ea-f02d6c8594bd/volumes"
Sep 18 20:01:02.443976 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.443958    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7522-9bb81a"]
Sep 18 20:01:02.444452 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.444436    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586c4802-97d0-44ec-9b35-90021042857a" containerName="test-curl-7522-efa3d9"
Sep 18 20:01:02.444534 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.444456    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="586c4802-97d0-44ec-9b35-90021042857a" containerName="test-curl-7522-efa3d9"
Sep 18 20:01:02.444592 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.444585    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="586c4802-97d0-44ec-9b35-90021042857a" containerName="test-curl-7522-efa3d9"
Sep 18 20:01:02.449441 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.449422    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-9bb81a"]
Sep 18 20:01:02.449542 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.449531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:02.585449 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.585401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgfd\" (UniqueName: \"kubernetes.io/projected/a6a95182-67a8-4199-bf06-58d73dc4f6bf-kube-api-access-lpgfd\") pod \"test-curl-7522-9bb81a\" (UID: \"a6a95182-67a8-4199-bf06-58d73dc4f6bf\") " pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:02.686649 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.686609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgfd\" (UniqueName: \"kubernetes.io/projected/a6a95182-67a8-4199-bf06-58d73dc4f6bf-kube-api-access-lpgfd\") pod \"test-curl-7522-9bb81a\" (UID: \"a6a95182-67a8-4199-bf06-58d73dc4f6bf\") " pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:02.689321 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:02.689302    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7522-efa3d9" container="test-curl-7522-efa3d9"
Sep 18 20:01:02.695768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.695699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgfd\" (UniqueName: \"kubernetes.io/projected/a6a95182-67a8-4199-bf06-58d73dc4f6bf-kube-api-access-lpgfd\") pod \"test-curl-7522-9bb81a\" (UID: \"a6a95182-67a8-4199-bf06-58d73dc4f6bf\") " pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:02.760037 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:02.760006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:03.033640 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:03.033450    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-9bb81a"]
Sep 18 20:01:03.036516 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:01:03.036489    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a95182_67a8_4199_bf06_58d73dc4f6bf.slice/crio-ce8767a79c8bff32cb71d07342f1babf2c42205bee662fe9d41dd0b856381943 WatchSource:0}: Error finding container ce8767a79c8bff32cb71d07342f1babf2c42205bee662fe9d41dd0b856381943: Status 404 returned error can't find the container with id ce8767a79c8bff32cb71d07342f1babf2c42205bee662fe9d41dd0b856381943
Sep 18 20:01:03.696025 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:03.695986    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7522-efa3d9" podUID="586c4802-97d0-44ec-9b35-90021042857a" containerName="test-curl-7522-efa3d9" containerID="cri-o://cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35" gracePeriod=2
Sep 18 20:01:03.696426 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:03.696027    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-9bb81a" event={"ID":"a6a95182-67a8-4199-bf06-58d73dc4f6bf","Type":"ContainerStarted","Data":"2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0"}
Sep 18 20:01:03.696426 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:03.696069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-9bb81a" event={"ID":"a6a95182-67a8-4199-bf06-58d73dc4f6bf","Type":"ContainerStarted","Data":"ce8767a79c8bff32cb71d07342f1babf2c42205bee662fe9d41dd0b856381943"}
Sep 18 20:01:03.714836 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:03.714765    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7522-9bb81a" podStartSLOduration=1.714745806 podStartE2EDuration="1.714745806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:03.710668982 +0000 UTC m=+1299.469476966" watchObservedRunningTime="2026-09-18 20:01:03.714745806 +0000 UTC m=+1299.473553794"
Sep 18 20:01:03.881806 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:03.881784    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:01:04.000901 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.000786    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqcbg\" (UniqueName: \"kubernetes.io/projected/da60b974-6c6d-4d29-b1a4-ddaef5c85054-kube-api-access-gqcbg\") pod \"da60b974-6c6d-4d29-b1a4-ddaef5c85054\" (UID: \"da60b974-6c6d-4d29-b1a4-ddaef5c85054\") "
Sep 18 20:01:04.003029 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.003001    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da60b974-6c6d-4d29-b1a4-ddaef5c85054-kube-api-access-gqcbg" (OuterVolumeSpecName: "kube-api-access-gqcbg") pod "da60b974-6c6d-4d29-b1a4-ddaef5c85054" (UID: "da60b974-6c6d-4d29-b1a4-ddaef5c85054"). InnerVolumeSpecName "kube-api-access-gqcbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:04.101891 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.101842    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqcbg\" (UniqueName: \"kubernetes.io/projected/da60b974-6c6d-4d29-b1a4-ddaef5c85054-kube-api-access-gqcbg\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:04.350264 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.350175    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7522-9bb81a"]
Sep 18 20:01:04.353114 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.353086    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7522-9bb81a"]
Sep 18 20:01:04.442792 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.442750    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da60b974-6c6d-4d29-b1a4-ddaef5c85054" path="/var/lib/kubelet/pods/da60b974-6c6d-4d29-b1a4-ddaef5c85054/volumes"
Sep 18 20:01:04.467585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.467550    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7522-bd7e67"]
Sep 18 20:01:04.468067 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.468049    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a95182-67a8-4199-bf06-58d73dc4f6bf" containerName="test-curl-7522-9bb81a"
Sep 18 20:01:04.468126 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.468069    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a95182-67a8-4199-bf06-58d73dc4f6bf" containerName="test-curl-7522-9bb81a"
Sep 18 20:01:04.468173 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.468164    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a95182-67a8-4199-bf06-58d73dc4f6bf" containerName="test-curl-7522-9bb81a"
Sep 18 20:01:04.471409 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.471394    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:04.478907 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.478576    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-bd7e67"]
Sep 18 20:01:04.505717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.505686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zf7r\" (UniqueName: \"kubernetes.io/projected/5e700567-44cd-4639-a60c-1f3c983999f1-kube-api-access-9zf7r\") pod \"test-curl-7522-bd7e67\" (UID: \"5e700567-44cd-4639-a60c-1f3c983999f1\") " pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:04.606243 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.606154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zf7r\" (UniqueName: \"kubernetes.io/projected/5e700567-44cd-4639-a60c-1f3c983999f1-kube-api-access-9zf7r\") pod \"test-curl-7522-bd7e67\" (UID: \"5e700567-44cd-4639-a60c-1f3c983999f1\") " pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:04.619623 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.619594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zf7r\" (UniqueName: \"kubernetes.io/projected/5e700567-44cd-4639-a60c-1f3c983999f1-kube-api-access-9zf7r\") pod \"test-curl-7522-bd7e67\" (UID: \"5e700567-44cd-4639-a60c-1f3c983999f1\") " pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:04.702514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.702476    2582 generic.go:356] "Generic (PLEG): container finished" podID="da60b974-6c6d-4d29-b1a4-ddaef5c85054" containerID="1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3" exitCode=137
Sep 18 20:01:04.703000 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.702533    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-861b91"
Sep 18 20:01:04.703000 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.702567    2582 scope.go:117] "RemoveContainer" containerID="1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3"
Sep 18 20:01:04.703000 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:04.702744    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7522-9bb81a" container="test-curl-7522-9bb81a"
Sep 18 20:01:04.714126 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.714051    2582 scope.go:117] "RemoveContainer" containerID="1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3"
Sep 18 20:01:04.714498 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:04.714471    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3\": container with ID starting with 1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3 not found: ID does not exist" containerID="1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3"
Sep 18 20:01:04.714644 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.714512    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3"} err="failed to get container status \"1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3\": rpc error: code = NotFound desc = could not find container \"1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3\": container with ID starting with 1cd5887f7b890a8e52944b3ba8293b700f87b73b3623f1b86ddb09d2901373c3 not found: ID does not exist"
Sep 18 20:01:04.782193 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:04.782156    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:05.061670 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.061649    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7522-bd7e67"]
Sep 18 20:01:05.063558 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:01:05.063532    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e700567_44cd_4639_a60c_1f3c983999f1.slice/crio-0d33e371d2d1935a210e083e3d8518a51ca30c04ce85d27d02d9962f2f832a30 WatchSource:0}: Error finding container 0d33e371d2d1935a210e083e3d8518a51ca30c04ce85d27d02d9962f2f832a30: Status 404 returned error can't find the container with id 0d33e371d2d1935a210e083e3d8518a51ca30c04ce85d27d02d9962f2f832a30
Sep 18 20:01:05.711065 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.711034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-bd7e67" event={"ID":"5e700567-44cd-4639-a60c-1f3c983999f1","Type":"ContainerStarted","Data":"d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703"}
Sep 18 20:01:05.711469 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.711079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7522-bd7e67" event={"ID":"5e700567-44cd-4639-a60c-1f3c983999f1","Type":"ContainerStarted","Data":"0d33e371d2d1935a210e083e3d8518a51ca30c04ce85d27d02d9962f2f832a30"}
Sep 18 20:01:05.712299 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.712265    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7522-9bb81a" podUID="a6a95182-67a8-4199-bf06-58d73dc4f6bf" containerName="test-curl-7522-9bb81a" containerID="cri-o://2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0" gracePeriod=2
Sep 18 20:01:05.742547 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.742503    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7522-bd7e67" podStartSLOduration=1.742488715 podStartE2EDuration="1.742488715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:05.741391214 +0000 UTC m=+1301.500199201" watchObservedRunningTime="2026-09-18 20:01:05.742488715 +0000 UTC m=+1301.501296699"
Sep 18 20:01:05.884850 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.884826    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:05.918021 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.917980    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnmdc\" (UniqueName: \"kubernetes.io/projected/586c4802-97d0-44ec-9b35-90021042857a-kube-api-access-pnmdc\") pod \"586c4802-97d0-44ec-9b35-90021042857a\" (UID: \"586c4802-97d0-44ec-9b35-90021042857a\") "
Sep 18 20:01:05.920198 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:05.920174    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586c4802-97d0-44ec-9b35-90021042857a-kube-api-access-pnmdc" (OuterVolumeSpecName: "kube-api-access-pnmdc") pod "586c4802-97d0-44ec-9b35-90021042857a" (UID: "586c4802-97d0-44ec-9b35-90021042857a"). InnerVolumeSpecName "kube-api-access-pnmdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:06.019589 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.019501    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnmdc\" (UniqueName: \"kubernetes.io/projected/586c4802-97d0-44ec-9b35-90021042857a-kube-api-access-pnmdc\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:06.320610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.320518    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7522-bd7e67"]
Sep 18 20:01:06.327760 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.327733    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7522-bd7e67"]
Sep 18 20:01:06.440672 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.440642    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="586c4802-97d0-44ec-9b35-90021042857a" path="/var/lib/kubelet/pods/586c4802-97d0-44ec-9b35-90021042857a/volumes"
Sep 18 20:01:06.718718 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.718680    2582 generic.go:356] "Generic (PLEG): container finished" podID="586c4802-97d0-44ec-9b35-90021042857a" containerID="cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35" exitCode=137
Sep 18 20:01:06.719216 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.718720    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-efa3d9"
Sep 18 20:01:06.719216 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.718748    2582 scope.go:117] "RemoveContainer" containerID="cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35"
Sep 18 20:01:06.719216 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:06.719101    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7522-bd7e67" container="test-curl-7522-bd7e67"
Sep 18 20:01:06.728165 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.728139    2582 scope.go:117] "RemoveContainer" containerID="cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35"
Sep 18 20:01:06.728440 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:06.728422    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35\": container with ID starting with cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35 not found: ID does not exist" containerID="cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35"
Sep 18 20:01:06.728492 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:06.728447    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35"} err="failed to get container status \"cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35\": rpc error: code = NotFound desc = could not find container \"cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35\": container with ID starting with cd26de20c99572cb27d27bc55f8b8615b35f5954e137c4248021dfdf1461af35 not found: ID does not exist"
Sep 18 20:01:07.228162 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.228126    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"]
Sep 18 20:01:07.228787 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.228769    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e700567-44cd-4639-a60c-1f3c983999f1" containerName="test-curl-7522-bd7e67"
Sep 18 20:01:07.228787 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.228789    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e700567-44cd-4639-a60c-1f3c983999f1" containerName="test-curl-7522-bd7e67"
Sep 18 20:01:07.228927 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.228870    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e700567-44cd-4639-a60c-1f3c983999f1" containerName="test-curl-7522-bd7e67"
Sep 18 20:01:07.233446 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.233429    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.236079 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.236058    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-166dc9bb-openshift-default-dockercfg-cmsvt\""
Sep 18 20:01:07.243063 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.243034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"]
Sep 18 20:01:07.331801 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.331758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istiod-ca-cert\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.331801 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.331806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-socket\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332073 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.331919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-podinfo\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332073 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.331952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-credential-socket\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332073 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.331973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-token\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332073 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.332055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnj6d\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-kube-api-access-rnj6d\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332227 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.332099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-envoy\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332227 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.332120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-certs\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.332227 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.332166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-data\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433324 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-podinfo\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433518 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-credential-socket\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433518 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-token\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433518 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnj6d\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-kube-api-access-rnj6d\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433518 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-envoy\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433518 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-certs\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433782 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-data\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433782 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istiod-ca-cert\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433782 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-socket\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.433782 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.433748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-credential-socket\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.434098 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.434077    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-data\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.434172 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.434132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-certs\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.434399 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.434168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-socket\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.434399 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.434248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istiod-ca-cert\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.435983 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.435955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-envoy\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.436237 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.436221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-podinfo\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.442213 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.442188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-token\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.442412 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.442396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnj6d\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-kube-api-access-rnj6d\") pod \"e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") " pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.545096 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.545026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:07.726852 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.726815    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7522-bd7e67" podUID="5e700567-44cd-4639-a60c-1f3c983999f1" containerName="test-curl-7522-bd7e67" containerID="cri-o://d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703" gracePeriod=2
Sep 18 20:01:07.822542 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.822408    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"]
Sep 18 20:01:07.824911 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:01:07.824866    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ec1e1b_51c1_4e86_8a5b_1b8eed6b82cb.slice/crio-3aabc74ce28240a554ecb2803fd4eb9f5f81a461653560dfff01e65192f74add WatchSource:0}: Error finding container 3aabc74ce28240a554ecb2803fd4eb9f5f81a461653560dfff01e65192f74add: Status 404 returned error can't find the container with id 3aabc74ce28240a554ecb2803fd4eb9f5f81a461653560dfff01e65192f74add
Sep 18 20:01:07.827660 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.827618    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:01:07.827811 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.827709    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:01:07.827811 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.827745    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:01:07.895955 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.895923    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:07.938976 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.938928    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpgfd\" (UniqueName: \"kubernetes.io/projected/a6a95182-67a8-4199-bf06-58d73dc4f6bf-kube-api-access-lpgfd\") pod \"a6a95182-67a8-4199-bf06-58d73dc4f6bf\" (UID: \"a6a95182-67a8-4199-bf06-58d73dc4f6bf\") "
Sep 18 20:01:07.941006 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:07.940981    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a95182-67a8-4199-bf06-58d73dc4f6bf-kube-api-access-lpgfd" (OuterVolumeSpecName: "kube-api-access-lpgfd") pod "a6a95182-67a8-4199-bf06-58d73dc4f6bf" (UID: "a6a95182-67a8-4199-bf06-58d73dc4f6bf"). InnerVolumeSpecName "kube-api-access-lpgfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:08.040522 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.040478    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpgfd\" (UniqueName: \"kubernetes.io/projected/a6a95182-67a8-4199-bf06-58d73dc4f6bf-kube-api-access-lpgfd\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:08.449400 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.449363    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a95182-67a8-4199-bf06-58d73dc4f6bf" path="/var/lib/kubelet/pods/a6a95182-67a8-4199-bf06-58d73dc4f6bf/volumes"
Sep 18 20:01:08.733382 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.733293    2582 generic.go:356] "Generic (PLEG): container finished" podID="a6a95182-67a8-4199-bf06-58d73dc4f6bf" containerID="2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0" exitCode=137
Sep 18 20:01:08.733382 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.733357    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-9bb81a"
Sep 18 20:01:08.733911 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.733390    2582 scope.go:117] "RemoveContainer" containerID="2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0"
Sep 18 20:01:08.735385 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.735358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" event={"ID":"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb","Type":"ContainerStarted","Data":"a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"}
Sep 18 20:01:08.735664 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.735416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" event={"ID":"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb","Type":"ContainerStarted","Data":"3aabc74ce28240a554ecb2803fd4eb9f5f81a461653560dfff01e65192f74add"}
Sep 18 20:01:08.742797 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.742781    2582 scope.go:117] "RemoveContainer" containerID="2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0"
Sep 18 20:01:08.743123 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:08.743102    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0\": container with ID starting with 2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0 not found: ID does not exist" containerID="2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0"
Sep 18 20:01:08.743188 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.743134    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0"} err="failed to get container status \"2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0\": rpc error: code = NotFound desc = could not find container \"2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0\": container with ID starting with 2b05c63e116b4e91930b46b05297532ebabcbf5391c6befa0c9ae191a003c9d0 not found: ID does not exist"
Sep 18 20:01:08.758343 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:08.758305    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podStartSLOduration=1.758291593 podStartE2EDuration="1.758291593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:08.756087756 +0000 UTC m=+1304.514895741" watchObservedRunningTime="2026-09-18 20:01:08.758291593 +0000 UTC m=+1304.517099578"
Sep 18 20:01:09.545711 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.545661    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:09.557948 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.557918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:09.744624 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.744597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:09.746110 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.746088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:09.910567 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.910540    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:09.960849 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.960812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zf7r\" (UniqueName: \"kubernetes.io/projected/5e700567-44cd-4639-a60c-1f3c983999f1-kube-api-access-9zf7r\") pod \"5e700567-44cd-4639-a60c-1f3c983999f1\" (UID: \"5e700567-44cd-4639-a60c-1f3c983999f1\") "
Sep 18 20:01:09.963063 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:09.963040    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e700567-44cd-4639-a60c-1f3c983999f1-kube-api-access-9zf7r" (OuterVolumeSpecName: "kube-api-access-9zf7r") pod "5e700567-44cd-4639-a60c-1f3c983999f1" (UID: "5e700567-44cd-4639-a60c-1f3c983999f1"). InnerVolumeSpecName "kube-api-access-9zf7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:10.062011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.061967    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zf7r\" (UniqueName: \"kubernetes.io/projected/5e700567-44cd-4639-a60c-1f3c983999f1-kube-api-access-9zf7r\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:10.442326 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.442297    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e700567-44cd-4639-a60c-1f3c983999f1" path="/var/lib/kubelet/pods/5e700567-44cd-4639-a60c-1f3c983999f1/volumes"
Sep 18 20:01:10.752062 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.751972    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e700567-44cd-4639-a60c-1f3c983999f1" containerID="d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703" exitCode=137
Sep 18 20:01:10.752062 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.752022    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7522-bd7e67"
Sep 18 20:01:10.752567 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.752068    2582 scope.go:117] "RemoveContainer" containerID="d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703"
Sep 18 20:01:10.761689 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.761669    2582 scope.go:117] "RemoveContainer" containerID="d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703"
Sep 18 20:01:10.762055 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:01:10.762034    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703\": container with ID starting with d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703 not found: ID does not exist" containerID="d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703"
Sep 18 20:01:10.762131 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:10.762065    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703"} err="failed to get container status \"d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703\": rpc error: code = NotFound desc = could not find container \"d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703\": container with ID starting with d57a4717712222850293dbc0815c4c5f5b5537af06a562790a1b5480b203e703 not found: ID does not exist"
Sep 18 20:01:14.880502 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:14.880469    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"]
Sep 18 20:01:14.894405 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:14.894376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:14.895539 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:14.895505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"]
Sep 18 20:01:14.897585 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:14.897556    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-166dc9bb-serving-cert\""
Sep 18 20:01:15.015561 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.015515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-openshift-service-ca\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.015749 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.015573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5nc2\" (UniqueName: \"kubernetes.io/projected/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-kube-api-access-l5nc2\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.015749 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.015607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-maas-api-tls\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.015749 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.015719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-metrics-certs\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.116602 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.116565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-openshift-service-ca\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.116831 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.116623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5nc2\" (UniqueName: \"kubernetes.io/projected/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-kube-api-access-l5nc2\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.116831 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.116663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-maas-api-tls\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.116831 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.116749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-metrics-certs\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.117447 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.117410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-openshift-service-ca\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.119479 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.119455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-metrics-certs\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.119850 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.119828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-maas-api-tls\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.125078 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.125057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5nc2\" (UniqueName: \"kubernetes.io/projected/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-kube-api-access-l5nc2\") pod \"maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.208087 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.208054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:15.484442 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.484413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"]
Sep 18 20:01:15.485756 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:01:15.485725    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20ed6d4_f01a_4e32_ad59_d95b5a975cb7.slice/crio-1742095d465e61eb2a2418e088aa1d148fe3a22b255dcf7cb6211e3df38b3393 WatchSource:0}: Error finding container 1742095d465e61eb2a2418e088aa1d148fe3a22b255dcf7cb6211e3df38b3393: Status 404 returned error can't find the container with id 1742095d465e61eb2a2418e088aa1d148fe3a22b255dcf7cb6211e3df38b3393
Sep 18 20:01:15.783763 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:15.783672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4" event={"ID":"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7","Type":"ContainerStarted","Data":"1742095d465e61eb2a2418e088aa1d148fe3a22b255dcf7cb6211e3df38b3393"}
Sep 18 20:01:16.791518 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:16.791479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4" event={"ID":"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7","Type":"ContainerStarted","Data":"d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550"}
Sep 18 20:01:16.791934 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:16.791554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:16.810537 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:16.810491    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4" podStartSLOduration=2.291581547 podStartE2EDuration="2.810476347s" totalImagesPullingTime="518.8948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:16.808155916 +0000 UTC m=+1312.566963903" watchObservedRunningTime="2026-09-18 20:01:16.810476347 +0000 UTC m=+1312.569284331"
Sep 18 20:01:22.802745 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:22.802712    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:01:39.824311 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.823822    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": read tcp 10.134.0.2:47944->10.134.0.66:15021: read: connection reset by peer" start-of-body=
Sep 18 20:01:39.824311 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.823918    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": read tcp 10.134.0.2:47944->10.134.0.66:15021: read: connection reset by peer"
Sep 18 20:01:39.934869 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.934837    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerID="a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828" exitCode=0
Sep 18 20:01:39.935042 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.934909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" event={"ID":"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb","Type":"ContainerDied","Data":"a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"}
Sep 18 20:01:39.935328 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.935314    2582 scope.go:117] "RemoveContainer" containerID="a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"
Sep 18 20:01:39.936501 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.936472    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:01:39.936594 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.936554    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:01:39.936594 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:39.936584    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:01:40.943950 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:40.943916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" event={"ID":"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb","Type":"ContainerStarted","Data":"fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc"}
Sep 18 20:01:41.545673 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:41.545636    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:41.545906 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:41.545860    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 20:01:41.546050 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:41.545940    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 20:01:42.546135 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:42.546098    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 20:01:42.546604 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:42.546160    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 20:01:43.545813 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:43.545778    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 20:01:43.546036 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:43.545833    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 20:01:44.545622 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:44.545591    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 20:01:44.546020 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:44.545646    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 20:01:45.546211 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:45.546173    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 20:01:45.546603 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:45.546228    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 20:01:46.546069 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:46.546033    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 18 20:01:46.546262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:46.546090    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 18 20:01:47.549178 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:47.549153    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:47.549569 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:47.549418    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:47.550032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:47.550018    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:01:59.471739 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.471703    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"]
Sep 18 20:01:59.472340 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.471952    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" podUID="bae23202-1dc8-496f-8c81-fec00aded250" containerName="maas-api" containerID="cri-o://87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d" gracePeriod=30
Sep 18 20:01:59.732367 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.732308    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 20:01:59.795486 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.795451    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae23202-1dc8-496f-8c81-fec00aded250-openshift-service-ca\") pod \"bae23202-1dc8-496f-8c81-fec00aded250\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") "
Sep 18 20:01:59.795681 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.795528    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls\") pod \"bae23202-1dc8-496f-8c81-fec00aded250\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") "
Sep 18 20:01:59.795681 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.795581    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-metrics-certs\") pod \"bae23202-1dc8-496f-8c81-fec00aded250\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") "
Sep 18 20:01:59.795772 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.795729    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cskqw\" (UniqueName: \"kubernetes.io/projected/bae23202-1dc8-496f-8c81-fec00aded250-kube-api-access-cskqw\") pod \"bae23202-1dc8-496f-8c81-fec00aded250\" (UID: \"bae23202-1dc8-496f-8c81-fec00aded250\") "
Sep 18 20:01:59.795970 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.795945    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae23202-1dc8-496f-8c81-fec00aded250-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bae23202-1dc8-496f-8c81-fec00aded250" (UID: "bae23202-1dc8-496f-8c81-fec00aded250"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:01:59.796214 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.796193    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae23202-1dc8-496f-8c81-fec00aded250-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:59.798027 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.797962    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae23202-1dc8-496f-8c81-fec00aded250-kube-api-access-cskqw" (OuterVolumeSpecName: "kube-api-access-cskqw") pod "bae23202-1dc8-496f-8c81-fec00aded250" (UID: "bae23202-1dc8-496f-8c81-fec00aded250"). InnerVolumeSpecName "kube-api-access-cskqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:59.798124 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.798040    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bae23202-1dc8-496f-8c81-fec00aded250" (UID: "bae23202-1dc8-496f-8c81-fec00aded250"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:01:59.798124 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.798058    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bae23202-1dc8-496f-8c81-fec00aded250" (UID: "bae23202-1dc8-496f-8c81-fec00aded250"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:01:59.896773 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.896734    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cskqw\" (UniqueName: \"kubernetes.io/projected/bae23202-1dc8-496f-8c81-fec00aded250-kube-api-access-cskqw\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:59.896773 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.896769    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:01:59.896773 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:01:59.896779    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bae23202-1dc8-496f-8c81-fec00aded250-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:02:00.055652 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.055564    2582 generic.go:356] "Generic (PLEG): container finished" podID="bae23202-1dc8-496f-8c81-fec00aded250" containerID="87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d" exitCode=0
Sep 18 20:02:00.055652 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.055613    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"
Sep 18 20:02:00.055652 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.055621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" event={"ID":"bae23202-1dc8-496f-8c81-fec00aded250","Type":"ContainerDied","Data":"87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d"}
Sep 18 20:02:00.055935 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.055664    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57" event={"ID":"bae23202-1dc8-496f-8c81-fec00aded250","Type":"ContainerDied","Data":"d2e23b4d668f759813db9b92778358b1f78a29d1f02909087576ec69fb5536c5"}
Sep 18 20:02:00.055935 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.055686    2582 scope.go:117] "RemoveContainer" containerID="87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d"
Sep 18 20:02:00.065638 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.065620    2582 scope.go:117] "RemoveContainer" containerID="87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d"
Sep 18 20:02:00.065948 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:02:00.065926    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d\": container with ID starting with 87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d not found: ID does not exist" containerID="87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d"
Sep 18 20:02:00.066005 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.065956    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d"} err="failed to get container status \"87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d\": rpc error: code = NotFound desc = could not find container \"87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d\": container with ID starting with 87cb7fb3e2b4731e603987f0d3e65067b71550d4c33c932fdd70dc30dab1380d not found: ID does not exist"
Sep 18 20:02:00.077523 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.077497    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"]
Sep 18 20:02:00.081193 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.081168    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d5f7da-5f6484ccd7-hqp57"]
Sep 18 20:02:00.440971 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:00.440933    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae23202-1dc8-496f-8c81-fec00aded250" path="/var/lib/kubelet/pods/bae23202-1dc8-496f-8c81-fec00aded250/volumes"
Sep 18 20:02:43.683348 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.683313    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"]
Sep 18 20:02:43.683843 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.683782    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae23202-1dc8-496f-8c81-fec00aded250" containerName="maas-api"
Sep 18 20:02:43.683843 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.683793    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae23202-1dc8-496f-8c81-fec00aded250" containerName="maas-api"
Sep 18 20:02:43.684029 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.683886    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae23202-1dc8-496f-8c81-fec00aded250" containerName="maas-api"
Sep 18 20:02:43.686453 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.686432    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.689322 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.689300    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-57b6ce-openshift-default-dockercfg-tt7sk\""
Sep 18 20:02:43.701515 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.701487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"]
Sep 18 20:02:43.833770 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.833732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47g5x\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-kube-api-access-47g5x\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.833770 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.833773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-socket\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.833793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-envoy\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.833905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-certs\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.833972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-data\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.834018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-credential-socket\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.834034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf344a0-a494-486b-8ee4-24b395f64024-istio-podinfo\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834330 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.834093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-istio-token\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.834330 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.834159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf344a0-a494-486b-8ee4-24b395f64024-istiod-ca-cert\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47g5x\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-kube-api-access-47g5x\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-socket\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-envoy\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-certs\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-data\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-credential-socket\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf344a0-a494-486b-8ee4-24b395f64024-istio-podinfo\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-istio-token\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf344a0-a494-486b-8ee4-24b395f64024-istiod-ca-cert\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935862 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-socket\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935862 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-credential-socket\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-certs\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.935958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.935922    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-data\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.936133 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.936117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf344a0-a494-486b-8ee4-24b395f64024-istiod-ca-cert\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.938019 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.937992    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-envoy\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.938210 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.938192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf344a0-a494-486b-8ee4-24b395f64024-istio-podinfo\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.945985 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.945963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-istio-token\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.946153 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.946105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47g5x\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-kube-api-access-47g5x\") pod \"e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") " pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:43.998101 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:43.998073    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:44.286338 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:44.286314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"]
Sep 18 20:02:44.287952 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:02:44.287929    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf344a0_a494_486b_8ee4_24b395f64024.slice/crio-3d891f2396ad3656765a472bf2151cb24445a0e8b8e45cc4cf04fcf07178a83d WatchSource:0}: Error finding container 3d891f2396ad3656765a472bf2151cb24445a0e8b8e45cc4cf04fcf07178a83d: Status 404 returned error can't find the container with id 3d891f2396ad3656765a472bf2151cb24445a0e8b8e45cc4cf04fcf07178a83d
Sep 18 20:02:44.290308 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:44.290276    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:02:44.290407 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:44.290340    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:02:44.290407 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:44.290367    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:02:44.309214 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:44.309191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" event={"ID":"caf344a0-a494-486b-8ee4-24b395f64024","Type":"ContainerStarted","Data":"3d891f2396ad3656765a472bf2151cb24445a0e8b8e45cc4cf04fcf07178a83d"}
Sep 18 20:02:45.317227 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:45.317190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" event={"ID":"caf344a0-a494-486b-8ee4-24b395f64024","Type":"ContainerStarted","Data":"a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"}
Sep 18 20:02:45.338220 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:45.338178    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podStartSLOduration=2.338152455 podStartE2EDuration="2.338152455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:02:45.337116415 +0000 UTC m=+1401.095924421" watchObservedRunningTime="2026-09-18 20:02:45.338152455 +0000 UTC m=+1401.096960440"
Sep 18 20:02:45.998555 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:45.998521    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:46.003454 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:46.003427    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:46.325003 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:46.324913    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:46.325845 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:46.325819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:02:51.699134 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.699103    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"]
Sep 18 20:02:51.702076 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.702058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.705320 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.705297    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-57b6ce-serving-cert\""
Sep 18 20:02:51.720223 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.720196    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"]
Sep 18 20:02:51.824074 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.824043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8m7\" (UniqueName: \"kubernetes.io/projected/98a8b324-3760-4023-8f84-962427519106-kube-api-access-2w8m7\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.824281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.824104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.824281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.824138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a8b324-3760-4023-8f84-962427519106-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.824281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.824215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.924765 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.924727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.924765 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.924764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a8b324-3760-4023-8f84-962427519106-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.925025 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.924907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.925025 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.924953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8m7\" (UniqueName: \"kubernetes.io/projected/98a8b324-3760-4023-8f84-962427519106-kube-api-access-2w8m7\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.925104 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:02:51.925051    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-serving-cert: secret "maas-api-e2e-shared-a-w3-57b6ce-serving-cert" not found
Sep 18 20:02:51.925186 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:02:51.925163    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls podName:98a8b324-3760-4023-8f84-962427519106 nodeName:}" failed. No retries permitted until 2026-09-18 20:02:52.42513838 +0000 UTC m=+1408.183946357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls") pod "maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" (UID: "98a8b324-3760-4023-8f84-962427519106") : secret "maas-api-e2e-shared-a-w3-57b6ce-serving-cert" not found
Sep 18 20:02:51.925811 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.925788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a8b324-3760-4023-8f84-962427519106-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.927500 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.927483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:51.934414 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:51.934396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8m7\" (UniqueName: \"kubernetes.io/projected/98a8b324-3760-4023-8f84-962427519106-kube-api-access-2w8m7\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:52.431728 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:52.431693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:52.434281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:52.434256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:52.616979 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:52.616944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:52.892711 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:52.892685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"]
Sep 18 20:02:52.893785 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:02:52.893758    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a8b324_3760_4023_8f84_962427519106.slice/crio-afc1200ff827d4548ab11cddd6816f85c80105014e8c4b9c1ba03c3ae1ae1e31 WatchSource:0}: Error finding container afc1200ff827d4548ab11cddd6816f85c80105014e8c4b9c1ba03c3ae1ae1e31: Status 404 returned error can't find the container with id afc1200ff827d4548ab11cddd6816f85c80105014e8c4b9c1ba03c3ae1ae1e31
Sep 18 20:02:52.895274 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:52.895258    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:02:53.364145 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:53.364117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" event={"ID":"98a8b324-3760-4023-8f84-962427519106","Type":"ContainerStarted","Data":"2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225"}
Sep 18 20:02:53.364289 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:53.364168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" event={"ID":"98a8b324-3760-4023-8f84-962427519106","Type":"ContainerStarted","Data":"afc1200ff827d4548ab11cddd6816f85c80105014e8c4b9c1ba03c3ae1ae1e31"}
Sep 18 20:02:53.364289 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:53.364230    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:02:53.383067 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:53.383019    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" podStartSLOduration=1.99202258 podStartE2EDuration="2.383002977s" totalImagesPullingTime="390.980397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:02:53.381318834 +0000 UTC m=+1409.140126820" watchObservedRunningTime="2026-09-18 20:02:53.383002977 +0000 UTC m=+1409.141810961"
Sep 18 20:02:59.375605 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:02:59.375577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:03:20.528913 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:20.528801    2582 generic.go:356] "Generic (PLEG): container finished" podID="caf344a0-a494-486b-8ee4-24b395f64024" containerID="a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c" exitCode=0
Sep 18 20:03:20.528913 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:20.528859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" event={"ID":"caf344a0-a494-486b-8ee4-24b395f64024","Type":"ContainerDied","Data":"a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"}
Sep 18 20:03:20.529493 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:20.529337    2582 scope.go:117] "RemoveContainer" containerID="a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"
Sep 18 20:03:20.530688 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:20.530659    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:03:20.530776 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:20.530728    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:03:20.530776 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:20.530769    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:03:21.541199 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:21.541159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" event={"ID":"caf344a0-a494-486b-8ee4-24b395f64024","Type":"ContainerStarted","Data":"11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92"}
Sep 18 20:03:21.998646 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:21.998617    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:03:21.998841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:21.998808    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 18 20:03:21.998939 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:21.998902    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 18 20:03:22.999269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:22.999235    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 18 20:03:22.999684 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:22.999305    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 18 20:03:23.998478 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:23.998449    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 18 20:03:23.998718 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:23.998696    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 18 20:03:24.108525 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.108490    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"]
Sep 18 20:03:24.115902 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.112461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.119904 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.117926    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-5547b6-serving-cert\""
Sep 18 20:03:24.127906 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.127620    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"]
Sep 18 20:03:24.287665 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.287565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.287665 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.287622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5810105-340c-4d4e-9b64-de171d9bc7ee-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.287665 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.287660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxx4z\" (UniqueName: \"kubernetes.io/projected/a5810105-340c-4d4e-9b64-de171d9bc7ee-kube-api-access-xxx4z\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.287930 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.287682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.389306 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.389268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.389514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.389319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5810105-340c-4d4e-9b64-de171d9bc7ee-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.389514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.389359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxx4z\" (UniqueName: \"kubernetes.io/projected/a5810105-340c-4d4e-9b64-de171d9bc7ee-kube-api-access-xxx4z\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.389514 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.389380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.389514 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:03:24.389502    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-serving-cert: secret "maas-api-e2e-shared-b-w3-5547b6-serving-cert" not found
Sep 18 20:03:24.389753 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:03:24.389573    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls podName:a5810105-340c-4d4e-9b64-de171d9bc7ee nodeName:}" failed. No retries permitted until 2026-09-18 20:03:24.889553302 +0000 UTC m=+1440.648361284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls") pod "maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" (UID: "a5810105-340c-4d4e-9b64-de171d9bc7ee") : secret "maas-api-e2e-shared-b-w3-5547b6-serving-cert" not found
Sep 18 20:03:24.390281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.390257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5810105-340c-4d4e-9b64-de171d9bc7ee-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.392426 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.392409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.398439 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.398415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxx4z\" (UniqueName: \"kubernetes.io/projected/a5810105-340c-4d4e-9b64-de171d9bc7ee-kube-api-access-xxx4z\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.895847 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.895810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.898534 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.898511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:24.998659 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.998626    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 18 20:03:24.998829 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:24.998674    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 18 20:03:25.045162 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:25.045124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:25.327576 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:25.327525    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"]
Sep 18 20:03:25.567788 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:25.567754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" event={"ID":"a5810105-340c-4d4e-9b64-de171d9bc7ee","Type":"ContainerStarted","Data":"84829ba27b463c6b852cc3e8972cbdf8c12535cafd0b98683b4ff5024f4e0a64"}
Sep 18 20:03:25.998941 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:25.998841    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 18 20:03:25.999092 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:25.998943    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 18 20:03:26.575118 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:26.575082    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" event={"ID":"a5810105-340c-4d4e-9b64-de171d9bc7ee","Type":"ContainerStarted","Data":"1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330"}
Sep 18 20:03:26.575507 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:26.575147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:26.595243 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:26.595199    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" podStartSLOduration=2.231327794 podStartE2EDuration="2.59518113s" totalImagesPullingTime="363.853336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:03:26.591565453 +0000 UTC m=+1442.350373437" watchObservedRunningTime="2026-09-18 20:03:26.59518113 +0000 UTC m=+1442.353989111"
Sep 18 20:03:27.003568 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:27.003533    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:03:27.003927 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:27.003909    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:03:27.004683 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:27.004663    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:03:32.586229 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:32.586201    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:03:34.975469 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:34.975429    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"]
Sep 18 20:03:34.975996 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:34.975732    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4" podUID="b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" containerName="maas-api" containerID="cri-o://d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550" gracePeriod=30
Sep 18 20:03:35.257513 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.257491    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:03:35.299454 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.299414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5nc2\" (UniqueName: \"kubernetes.io/projected/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-kube-api-access-l5nc2\") pod \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") "
Sep 18 20:03:35.299844 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.299812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-openshift-service-ca\") pod \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") "
Sep 18 20:03:35.300496 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.300358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" (UID: "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:03:35.300935 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.300917    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-maas-api-tls\") pod \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") "
Sep 18 20:03:35.301141 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.301118    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-metrics-certs\") pod \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\" (UID: \"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7\") "
Sep 18 20:03:35.301857 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.301838    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.305670 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.304717    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-kube-api-access-l5nc2" (OuterVolumeSpecName: "kube-api-access-l5nc2") pod "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" (UID: "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7"). InnerVolumeSpecName "kube-api-access-l5nc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:03:35.306939 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.306901    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" (UID: "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:03:35.308242 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.308216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" (UID: "b20ed6d4-f01a-4e32-ad59-d95b5a975cb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:03:35.403063 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.403032    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.403063 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.403057    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.403063 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.403066    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5nc2\" (UniqueName: \"kubernetes.io/projected/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7-kube-api-access-l5nc2\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.629416 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.629328    2582 generic.go:356] "Generic (PLEG): container finished" podID="b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" containerID="d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550" exitCode=0
Sep 18 20:03:35.629416 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.629371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4" event={"ID":"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7","Type":"ContainerDied","Data":"d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550"}
Sep 18 20:03:35.629416 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.629378    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"
Sep 18 20:03:35.629416 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.629412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4" event={"ID":"b20ed6d4-f01a-4e32-ad59-d95b5a975cb7","Type":"ContainerDied","Data":"1742095d465e61eb2a2418e088aa1d148fe3a22b255dcf7cb6211e3df38b3393"}
Sep 18 20:03:35.629706 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.629433    2582 scope.go:117] "RemoveContainer" containerID="d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550"
Sep 18 20:03:35.640117 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.640090    2582 scope.go:117] "RemoveContainer" containerID="d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550"
Sep 18 20:03:35.640419 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:03:35.640400    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550\": container with ID starting with d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550 not found: ID does not exist" containerID="d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550"
Sep 18 20:03:35.640474 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.640430    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550"} err="failed to get container status \"d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550\": rpc error: code = NotFound desc = could not find container \"d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550\": container with ID starting with d66bdddb5cf3d82a58e00daa492553178e6146e8eb29a082f98c7495919a3550 not found: ID does not exist"
Sep 18 20:03:35.652314 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.652290    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"]
Sep 18 20:03:35.656046 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:35.656017    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-166dc9bb-74c97cc4d6-wldv4"]
Sep 18 20:03:36.442247 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:03:36.442214    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" path="/var/lib/kubelet/pods/b20ed6d4-f01a-4e32-ad59-d95b5a975cb7/volumes"
Sep 18 20:04:26.501485 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:26.501444    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:04:26.503509 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:26.503486    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:04:26.506575 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:26.506553    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:04:26.508555 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:26.508539    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:04:32.476185 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:32.476144    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"]
Sep 18 20:04:32.476751 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:32.476400    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" containerID="cri-o://fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc" gracePeriod=30
Sep 18 20:04:32.552295 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:32.552259    2582 patch_prober.go:28] interesting pod/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 20:04:32.552451 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:32.552349    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:04:37.735017 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.734988    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:04:37.782856 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.782771    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-podinfo\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.782856 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.782820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-certs\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.782865    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-credential-socket\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.782924    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-data\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.782964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnj6d\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-kube-api-access-rnj6d\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.782990    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-envoy\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istiod-ca-cert\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783123 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-socket\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783453 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:04:37.783453 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783181    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-token\") pod \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\" (UID: \"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb\") "
Sep 18 20:04:37.783453 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783187    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:04:37.783637 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783477    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:04:37.783637 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:04:37.783637 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783622    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.783803 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783641    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.783803 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783655    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.783803 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.783668    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.784203 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.784172    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:04:37.785593 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.785562    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-kube-api-access-rnj6d" (OuterVolumeSpecName: "kube-api-access-rnj6d") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "kube-api-access-rnj6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:04:37.785810 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.785787    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:04:37.785998 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.785974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:04:37.786281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.786250    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" (UID: "f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:04:37.885052 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.885020    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.885052 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.885048    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.885052 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.885058    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.885363 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.885067    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnj6d\" (UniqueName: \"kubernetes.io/projected/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-kube-api-access-rnj6d\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.885363 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.885077    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:04:37.998591 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.998558    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerID="fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc" exitCode=0
Sep 18 20:04:37.998753 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.998605    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"
Sep 18 20:04:37.998753 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.998635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" event={"ID":"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb","Type":"ContainerDied","Data":"fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc"}
Sep 18 20:04:37.998753 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.998691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm" event={"ID":"f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb","Type":"ContainerDied","Data":"3aabc74ce28240a554ecb2803fd4eb9f5f81a461653560dfff01e65192f74add"}
Sep 18 20:04:37.998753 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:37.998713    2582 scope.go:117] "RemoveContainer" containerID="fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc"
Sep 18 20:04:38.008948 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.008929    2582 scope.go:117] "RemoveContainer" containerID="a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"
Sep 18 20:04:38.017990 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.017970    2582 scope.go:117] "RemoveContainer" containerID="fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc"
Sep 18 20:04:38.018265 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:04:38.018246    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc\": container with ID starting with fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc not found: ID does not exist" containerID="fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc"
Sep 18 20:04:38.018350 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.018277    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc"} err="failed to get container status \"fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc\": rpc error: code = NotFound desc = could not find container \"fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc\": container with ID starting with fd1e7c823624f70e74bdb38d5415a3e36d7ed03db57a2601a76eab85f4528abc not found: ID does not exist"
Sep 18 20:04:38.018350 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.018299    2582 scope.go:117] "RemoveContainer" containerID="a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"
Sep 18 20:04:38.018635 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:04:38.018610    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828\": container with ID starting with a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828 not found: ID does not exist" containerID="a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"
Sep 18 20:04:38.018707 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.018644    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828"} err="failed to get container status \"a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828\": rpc error: code = NotFound desc = could not find container \"a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828\": container with ID starting with a1a45ac09d1a7e0d8be2c8c91bbee5ec4c63311cc5683de352fae3c401eff828 not found: ID does not exist"
Sep 18 20:04:38.022047 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.022025    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"]
Sep 18 20:04:38.027104 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.027082    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm"]
Sep 18 20:04:38.441174 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:04:38.441144    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" path="/var/lib/kubelet/pods/f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb/volumes"
Sep 18 20:05:27.047969 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.047935    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"]
Sep 18 20:05:27.048427 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048413    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy"
Sep 18 20:05:27.048427 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048429    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy"
Sep 18 20:05:27.048546 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048445    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" containerName="maas-api"
Sep 18 20:05:27.048546 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048450    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" containerName="maas-api"
Sep 18 20:05:27.048546 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048463    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy"
Sep 18 20:05:27.048546 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048468    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy"
Sep 18 20:05:27.048546 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048537    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy"
Sep 18 20:05:27.048546 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048545    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20ed6d4-f01a-4e32-ad59-d95b5a975cb7" containerName="maas-api"
Sep 18 20:05:27.048745 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.048552    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1ec1e1b-51c1-4e86-8a5b-1b8eed6b82cb" containerName="istio-proxy"
Sep 18 20:05:27.052856 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.052839    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.057060 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.057017    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c3d85f-openshift-default-dockercfg-z2qtj\""
Sep 18 20:05:27.068339 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.068310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"]
Sep 18 20:05:27.191243 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-data\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191448 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istiod-ca-cert\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191448 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-socket\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191448 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-envoy\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-podinfo\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-certs\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl2lg\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-kube-api-access-bl2lg\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-token\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.191833 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.191663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-credential-socket\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.292966 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.292929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-credential-socket\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293132 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.292972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-data\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293132 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istiod-ca-cert\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293132 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-socket\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293132 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-envoy\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293325 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-podinfo\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293325 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-certs\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293325 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl2lg\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-kube-api-access-bl2lg\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293325 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-token\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293542 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-data\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293542 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-socket\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293642 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-certs\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293714 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-credential-socket\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.293787 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.293767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istiod-ca-cert\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.295524 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.295500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-envoy\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.295752 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.295733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-podinfo\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.301318 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.301256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-token\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.301423 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.301404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl2lg\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-kube-api-access-bl2lg\") pod \"e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") " pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.363691 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.363661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:27.647120 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.647097    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"]
Sep 18 20:05:27.649093 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:05:27.649065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b63d86a_5473_4924_b2bf_cc9b13e7c027.slice/crio-6066043abe231e0b3772ef4b28322d264ecad7a3cfc0887bdfcceab9aebaa71a WatchSource:0}: Error finding container 6066043abe231e0b3772ef4b28322d264ecad7a3cfc0887bdfcceab9aebaa71a: Status 404 returned error can't find the container with id 6066043abe231e0b3772ef4b28322d264ecad7a3cfc0887bdfcceab9aebaa71a
Sep 18 20:05:27.651454 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.651425    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:05:27.651522 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.651490    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:05:27.651560 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:27.651527    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:05:28.281452 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:28.281413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" event={"ID":"9b63d86a-5473-4924-b2bf-cc9b13e7c027","Type":"ContainerStarted","Data":"99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"}
Sep 18 20:05:28.281907 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:28.281468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" event={"ID":"9b63d86a-5473-4924-b2bf-cc9b13e7c027","Type":"ContainerStarted","Data":"6066043abe231e0b3772ef4b28322d264ecad7a3cfc0887bdfcceab9aebaa71a"}
Sep 18 20:05:28.305170 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:28.305110    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podStartSLOduration=1.305091979 podStartE2EDuration="1.305091979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:05:28.301748634 +0000 UTC m=+1564.060556621" watchObservedRunningTime="2026-09-18 20:05:28.305091979 +0000 UTC m=+1564.063899967"
Sep 18 20:05:28.363929 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:28.363857    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:28.369258 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:28.369227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:29.287437 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:29.287403    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:29.288431 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:29.288414    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:05:34.976894 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:34.976844    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"]
Sep 18 20:05:34.981111 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:34.981094    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:34.983706 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:34.983687    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c3d85f-serving-cert\""
Sep 18 20:05:34.992440 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:34.992415    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"]
Sep 18 20:05:35.084308 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.084268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00458157-e1b8-4252-a541-f19657241b9c-openshift-service-ca\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.084308 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.084309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzhmv\" (UniqueName: \"kubernetes.io/projected/00458157-e1b8-4252-a541-f19657241b9c-kube-api-access-bzhmv\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.084561 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.084484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.084561 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.084541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-metrics-certs\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.185757 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.185719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.185977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.185774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-metrics-certs\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.185977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.185819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00458157-e1b8-4252-a541-f19657241b9c-openshift-service-ca\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.185977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.185843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzhmv\" (UniqueName: \"kubernetes.io/projected/00458157-e1b8-4252-a541-f19657241b9c-kube-api-access-bzhmv\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.185977 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:05:35.185914    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-serving-cert: secret "maas-api-e2e-api-a-c3d85f-serving-cert" not found
Sep 18 20:05:35.186195 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:05:35.186024    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls podName:00458157-e1b8-4252-a541-f19657241b9c nodeName:}" failed. No retries permitted until 2026-09-18 20:05:35.686001765 +0000 UTC m=+1571.444809747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls") pod "maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" (UID: "00458157-e1b8-4252-a541-f19657241b9c") : secret "maas-api-e2e-api-a-c3d85f-serving-cert" not found
Sep 18 20:05:35.186607 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.186587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00458157-e1b8-4252-a541-f19657241b9c-openshift-service-ca\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.188495 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.188477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-metrics-certs\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.194378 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.194356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzhmv\" (UniqueName: \"kubernetes.io/projected/00458157-e1b8-4252-a541-f19657241b9c-kube-api-access-bzhmv\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.691735 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.691696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.694353 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.694324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls\") pod \"maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:35.893593 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:35.893563    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:36.167266 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:36.167241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"]
Sep 18 20:05:36.168024 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:05:36.168002    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00458157_e1b8_4252_a541_f19657241b9c.slice/crio-5e55a0e4290f2055022c521d0b580e73fb6b66dd551db2cbeefd74a7ae2302b9 WatchSource:0}: Error finding container 5e55a0e4290f2055022c521d0b580e73fb6b66dd551db2cbeefd74a7ae2302b9: Status 404 returned error can't find the container with id 5e55a0e4290f2055022c521d0b580e73fb6b66dd551db2cbeefd74a7ae2302b9
Sep 18 20:05:36.331793 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:36.331712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" event={"ID":"00458157-e1b8-4252-a541-f19657241b9c","Type":"ContainerStarted","Data":"5e55a0e4290f2055022c521d0b580e73fb6b66dd551db2cbeefd74a7ae2302b9"}
Sep 18 20:05:37.339434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:37.339389    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" event={"ID":"00458157-e1b8-4252-a541-f19657241b9c","Type":"ContainerStarted","Data":"a8f4f4ddfef6ae621d5d3935f8fa878b2a7c5cabbdc0ee5686a032acf5078c9d"}
Sep 18 20:05:37.339808 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:37.339481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:05:37.358002 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:37.357956    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" podStartSLOduration=2.916350466 podStartE2EDuration="3.357942099s" totalImagesPullingTime="441.591633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:05:37.355501036 +0000 UTC m=+1573.114309026" watchObservedRunningTime="2026-09-18 20:05:37.357942099 +0000 UTC m=+1573.116750135"
Sep 18 20:05:43.350921 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:05:43.350868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:06:09.543906 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.542743    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"]
Sep 18 20:06:09.548382 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.548354    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.554537 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.553995    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-13f9e5-serving-cert\""
Sep 18 20:06:09.565956 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.565858    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"]
Sep 18 20:06:09.654768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.654720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71442191-5551-44be-828a-d8766b6c37cc-openshift-service-ca\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.654965 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.654819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzbm\" (UniqueName: \"kubernetes.io/projected/71442191-5551-44be-828a-d8766b6c37cc-kube-api-access-hqzbm\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.655055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.655035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-metrics-certs\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.655099 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.655085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-maas-api-tls\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.756221 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.756187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71442191-5551-44be-828a-d8766b6c37cc-openshift-service-ca\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.756434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.756230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzbm\" (UniqueName: \"kubernetes.io/projected/71442191-5551-44be-828a-d8766b6c37cc-kube-api-access-hqzbm\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.756434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.756317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-metrics-certs\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.756434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.756340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-maas-api-tls\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.756857 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.756832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71442191-5551-44be-828a-d8766b6c37cc-openshift-service-ca\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.759082 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.759057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-metrics-certs\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.759177 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.759057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-maas-api-tls\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.764759 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.764737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzbm\" (UniqueName: \"kubernetes.io/projected/71442191-5551-44be-828a-d8766b6c37cc-kube-api-access-hqzbm\") pod \"maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:09.867009 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:09.866913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:10.167661 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:10.167633    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"]
Sep 18 20:06:10.169258 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:06:10.169238    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71442191_5551_44be_828a_d8766b6c37cc.slice/crio-a1c17897f96d29d497b1aa01342e32422a1cee8dd21df85ac14514c3f19318bc WatchSource:0}: Error finding container a1c17897f96d29d497b1aa01342e32422a1cee8dd21df85ac14514c3f19318bc: Status 404 returned error can't find the container with id a1c17897f96d29d497b1aa01342e32422a1cee8dd21df85ac14514c3f19318bc
Sep 18 20:06:10.539042 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:10.539007    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn" event={"ID":"71442191-5551-44be-828a-d8766b6c37cc","Type":"ContainerStarted","Data":"a1c17897f96d29d497b1aa01342e32422a1cee8dd21df85ac14514c3f19318bc"}
Sep 18 20:06:11.547972 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:11.547939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn" event={"ID":"71442191-5551-44be-828a-d8766b6c37cc","Type":"ContainerStarted","Data":"1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca"}
Sep 18 20:06:11.548416 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:11.548060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:11.567269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:11.567220    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn" podStartSLOduration=2.021907691 podStartE2EDuration="2.567201695s" totalImagesPullingTime="545.294004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:06:11.564416325 +0000 UTC m=+1607.323224310" watchObservedRunningTime="2026-09-18 20:06:11.567201695 +0000 UTC m=+1607.326009680"
Sep 18 20:06:17.558900 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:17.558836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:06:18.591928 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:18.591900    2582 generic.go:356] "Generic (PLEG): container finished" podID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerID="99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7" exitCode=0
Sep 18 20:06:18.591928 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:18.591916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" event={"ID":"9b63d86a-5473-4924-b2bf-cc9b13e7c027","Type":"ContainerDied","Data":"99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"}
Sep 18 20:06:18.592388 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:18.592328    2582 scope.go:117] "RemoveContainer" containerID="99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"
Sep 18 20:06:18.593706 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:18.593676    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:06:18.593779 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:18.593748    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:06:18.593779 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:18.593776    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:06:19.598846 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:19.598807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" event={"ID":"9b63d86a-5473-4924-b2bf-cc9b13e7c027","Type":"ContainerStarted","Data":"c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d"}
Sep 18 20:06:20.364468 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:20.364432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:06:20.364679 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:20.364623    2582 patch_prober.go:28] interesting pod/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 18 20:06:20.364764 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:20.364692    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 18 20:06:21.364501 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:21.364469    2582 patch_prober.go:28] interesting pod/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 18 20:06:21.364913 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:21.364529    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 18 20:06:22.364814 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:22.364772    2582 patch_prober.go:28] interesting pod/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 18 20:06:22.365262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:22.364853    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 18 20:06:23.365009 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:23.364971    2582 patch_prober.go:28] interesting pod/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 18 20:06:23.365399 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:23.365037    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 18 20:06:24.364933 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:24.364902    2582 patch_prober.go:28] interesting pod/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 18 20:06:24.365100 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:24.364955    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 18 20:06:25.367813 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:25.367784    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:06:25.368246 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:25.368071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:06:25.368814 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:25.368794    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:06:31.677938 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:31.677866    2582 generic.go:356] "Generic (PLEG): container finished" podID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerID="f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080" exitCode=137
Sep 18 20:06:31.678371 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:31.677937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" event={"ID":"4fb621e7-0df2-4354-a7fd-3b58417ee48e","Type":"ContainerDied","Data":"f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"}
Sep 18 20:06:31.678371 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:31.678308    2582 scope.go:117] "RemoveContainer" containerID="f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"
Sep 18 20:06:32.686741 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:32.686703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" event={"ID":"4fb621e7-0df2-4354-a7fd-3b58417ee48e","Type":"ContainerStarted","Data":"b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501"}
Sep 18 20:06:32.687163 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:32.686925    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 20:06:34.654027 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:34.653982    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"]
Sep 18 20:06:34.654390 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:34.654225    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" podUID="b80e432f-d788-4d9c-86d7-3cba53c988d8" containerName="maas-api" containerID="cri-o://7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3" gracePeriod=30
Sep 18 20:06:34.909104 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:34.909047    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 20:06:35.043633 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.043599    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls\") pod \"b80e432f-d788-4d9c-86d7-3cba53c988d8\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") "
Sep 18 20:06:35.043633 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.043651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkvhp\" (UniqueName: \"kubernetes.io/projected/b80e432f-d788-4d9c-86d7-3cba53c988d8-kube-api-access-wkvhp\") pod \"b80e432f-d788-4d9c-86d7-3cba53c988d8\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") "
Sep 18 20:06:35.043953 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.043684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80e432f-d788-4d9c-86d7-3cba53c988d8-openshift-service-ca\") pod \"b80e432f-d788-4d9c-86d7-3cba53c988d8\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") "
Sep 18 20:06:35.043953 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.043712    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-metrics-certs\") pod \"b80e432f-d788-4d9c-86d7-3cba53c988d8\" (UID: \"b80e432f-d788-4d9c-86d7-3cba53c988d8\") "
Sep 18 20:06:35.044084 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.044031    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80e432f-d788-4d9c-86d7-3cba53c988d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b80e432f-d788-4d9c-86d7-3cba53c988d8" (UID: "b80e432f-d788-4d9c-86d7-3cba53c988d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:35.044167 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.044147    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80e432f-d788-4d9c-86d7-3cba53c988d8-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:35.046515 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.046471    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b80e432f-d788-4d9c-86d7-3cba53c988d8" (UID: "b80e432f-d788-4d9c-86d7-3cba53c988d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:35.047011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.046984    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b80e432f-d788-4d9c-86d7-3cba53c988d8" (UID: "b80e432f-d788-4d9c-86d7-3cba53c988d8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:35.047132 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.047092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80e432f-d788-4d9c-86d7-3cba53c988d8-kube-api-access-wkvhp" (OuterVolumeSpecName: "kube-api-access-wkvhp") pod "b80e432f-d788-4d9c-86d7-3cba53c988d8" (UID: "b80e432f-d788-4d9c-86d7-3cba53c988d8"). InnerVolumeSpecName "kube-api-access-wkvhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:35.144870 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.144840    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:35.144870 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.144866    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkvhp\" (UniqueName: \"kubernetes.io/projected/b80e432f-d788-4d9c-86d7-3cba53c988d8-kube-api-access-wkvhp\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:35.144870 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.144888    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b80e432f-d788-4d9c-86d7-3cba53c988d8-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:35.710357 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.710321    2582 generic.go:356] "Generic (PLEG): container finished" podID="b80e432f-d788-4d9c-86d7-3cba53c988d8" containerID="7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3" exitCode=0
Sep 18 20:06:35.710730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.710364    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"
Sep 18 20:06:35.710730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.710405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" event={"ID":"b80e432f-d788-4d9c-86d7-3cba53c988d8","Type":"ContainerDied","Data":"7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3"}
Sep 18 20:06:35.710730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.710462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7" event={"ID":"b80e432f-d788-4d9c-86d7-3cba53c988d8","Type":"ContainerDied","Data":"135c56329fd9746620fca888295bbfeae7d556859e8254ab3b3313b2dca24c8f"}
Sep 18 20:06:35.710730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.710486    2582 scope.go:117] "RemoveContainer" containerID="7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3"
Sep 18 20:06:35.721217 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.721202    2582 scope.go:117] "RemoveContainer" containerID="7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3"
Sep 18 20:06:35.721490 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:06:35.721468    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3\": container with ID starting with 7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3 not found: ID does not exist" containerID="7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3"
Sep 18 20:06:35.721535 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.721499    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3"} err="failed to get container status \"7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3\": rpc error: code = NotFound desc = could not find container \"7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3\": container with ID starting with 7a89258c85cbb5fa44a2a96db4fe69dc6342de1e4e6e89eb63c8493d4dba5be3 not found: ID does not exist"
Sep 18 20:06:35.751248 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.751215    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"]
Sep 18 20:06:35.760836 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:35.760810    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d94b9e-787f6dd4d9-fcjl7"]
Sep 18 20:06:36.441313 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:36.441281    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80e432f-d788-4d9c-86d7-3cba53c988d8" path="/var/lib/kubelet/pods/b80e432f-d788-4d9c-86d7-3cba53c988d8/volumes"
Sep 18 20:06:43.695976 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:43.695944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 20:06:46.598460 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.598427    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"]
Sep 18 20:06:46.598940 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.598647    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" podUID="00458157-e1b8-4252-a541-f19657241b9c" containerName="maas-api" containerID="cri-o://a8f4f4ddfef6ae621d5d3935f8fa878b2a7c5cabbdc0ee5686a032acf5078c9d" gracePeriod=30
Sep 18 20:06:46.778317 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.777749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" event={"ID":"00458157-e1b8-4252-a541-f19657241b9c","Type":"ContainerDied","Data":"a8f4f4ddfef6ae621d5d3935f8fa878b2a7c5cabbdc0ee5686a032acf5078c9d"}
Sep 18 20:06:46.778317 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.777758    2582 generic.go:356] "Generic (PLEG): container finished" podID="00458157-e1b8-4252-a541-f19657241b9c" containerID="a8f4f4ddfef6ae621d5d3935f8fa878b2a7c5cabbdc0ee5686a032acf5078c9d" exitCode=0
Sep 18 20:06:46.863410 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.863349    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:06:46.968618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.968586    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00458157-e1b8-4252-a541-f19657241b9c-openshift-service-ca\") pod \"00458157-e1b8-4252-a541-f19657241b9c\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") "
Sep 18 20:06:46.968794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.968700    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-metrics-certs\") pod \"00458157-e1b8-4252-a541-f19657241b9c\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") "
Sep 18 20:06:46.968794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.968743    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzhmv\" (UniqueName: \"kubernetes.io/projected/00458157-e1b8-4252-a541-f19657241b9c-kube-api-access-bzhmv\") pod \"00458157-e1b8-4252-a541-f19657241b9c\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") "
Sep 18 20:06:46.968794 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.968778    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls\") pod \"00458157-e1b8-4252-a541-f19657241b9c\" (UID: \"00458157-e1b8-4252-a541-f19657241b9c\") "
Sep 18 20:06:46.969088 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.969060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00458157-e1b8-4252-a541-f19657241b9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00458157-e1b8-4252-a541-f19657241b9c" (UID: "00458157-e1b8-4252-a541-f19657241b9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:46.971395 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.971352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00458157-e1b8-4252-a541-f19657241b9c-kube-api-access-bzhmv" (OuterVolumeSpecName: "kube-api-access-bzhmv") pod "00458157-e1b8-4252-a541-f19657241b9c" (UID: "00458157-e1b8-4252-a541-f19657241b9c"). InnerVolumeSpecName "kube-api-access-bzhmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:46.971619 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.971599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00458157-e1b8-4252-a541-f19657241b9c" (UID: "00458157-e1b8-4252-a541-f19657241b9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:46.971942 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:46.971917    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "00458157-e1b8-4252-a541-f19657241b9c" (UID: "00458157-e1b8-4252-a541-f19657241b9c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:47.069833 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.069799    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.069833 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.069827    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzhmv\" (UniqueName: \"kubernetes.io/projected/00458157-e1b8-4252-a541-f19657241b9c-kube-api-access-bzhmv\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.069833 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.069836    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00458157-e1b8-4252-a541-f19657241b9c-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.070089 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.069844    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00458157-e1b8-4252-a541-f19657241b9c-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.784688 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.784651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn" event={"ID":"00458157-e1b8-4252-a541-f19657241b9c","Type":"ContainerDied","Data":"5e55a0e4290f2055022c521d0b580e73fb6b66dd551db2cbeefd74a7ae2302b9"}
Sep 18 20:06:47.785190 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.784720    2582 scope.go:117] "RemoveContainer" containerID="a8f4f4ddfef6ae621d5d3935f8fa878b2a7c5cabbdc0ee5686a032acf5078c9d"
Sep 18 20:06:47.785190 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.784756    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"
Sep 18 20:06:47.807888 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.807857    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"]
Sep 18 20:06:47.811842 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:47.811817    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3d85f-756bfd5d9f-6nwnn"]
Sep 18 20:06:48.441791 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:48.441758    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00458157-e1b8-4252-a541-f19657241b9c" path="/var/lib/kubelet/pods/00458157-e1b8-4252-a541-f19657241b9c/volumes"
Sep 18 20:06:53.468942 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:53.468910    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"]
Sep 18 20:06:53.469420 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:53.469177    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" containerID="cri-o://c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d" gracePeriod=30
Sep 18 20:06:55.370628 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:55.370594    2582 patch_prober.go:28] interesting pod/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 20:06:55.371010 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:55.370660    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:06:58.743582 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.743526    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:06:58.799515 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799488    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl2lg\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-kube-api-access-bl2lg\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799701 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-envoy\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799701 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799556    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-socket\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799701 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istiod-ca-cert\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799701 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799700    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-podinfo\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799768    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-credential-socket\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799814    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-certs\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:58.799958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799851    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-data\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.799958 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.799939    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-token\") pod \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\" (UID: \"9b63d86a-5473-4924-b2bf-cc9b13e7c027\") "
Sep 18 20:06:58.800294 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.800257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:58.800531 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.800412    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.800531 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.800518    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:58.800642 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.800565    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.800734 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.800711    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:58.800911 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.800848    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:58.802398 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.802370    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:58.802509 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.802447    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:06:58.802555 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.802534    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-kube-api-access-bl2lg" (OuterVolumeSpecName: "kube-api-access-bl2lg") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "kube-api-access-bl2lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:58.802999 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.802975    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b63d86a-5473-4924-b2bf-cc9b13e7c027" (UID: "9b63d86a-5473-4924-b2bf-cc9b13e7c027"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:58.853605 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.853570    2582 generic.go:356] "Generic (PLEG): container finished" podID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerID="c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d" exitCode=0
Sep 18 20:06:58.853784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.853617    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"
Sep 18 20:06:58.853784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.853654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" event={"ID":"9b63d86a-5473-4924-b2bf-cc9b13e7c027","Type":"ContainerDied","Data":"c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d"}
Sep 18 20:06:58.853784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.853706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl" event={"ID":"9b63d86a-5473-4924-b2bf-cc9b13e7c027","Type":"ContainerDied","Data":"6066043abe231e0b3772ef4b28322d264ecad7a3cfc0887bdfcceab9aebaa71a"}
Sep 18 20:06:58.853784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.853730    2582 scope.go:117] "RemoveContainer" containerID="c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d"
Sep 18 20:06:58.863668 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.863650    2582 scope.go:117] "RemoveContainer" containerID="99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"
Sep 18 20:06:58.872847 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.872828    2582 scope.go:117] "RemoveContainer" containerID="c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d"
Sep 18 20:06:58.873150 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:06:58.873133    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d\": container with ID starting with c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d not found: ID does not exist" containerID="c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d"
Sep 18 20:06:58.873198 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.873161    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d"} err="failed to get container status \"c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d\": rpc error: code = NotFound desc = could not find container \"c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d\": container with ID starting with c8986b53c5aa4a92a3338dc3a1f45635163e727f16291515762223c4b910d42d not found: ID does not exist"
Sep 18 20:06:58.873198 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.873178    2582 scope.go:117] "RemoveContainer" containerID="99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"
Sep 18 20:06:58.873430 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:06:58.873415    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7\": container with ID starting with 99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7 not found: ID does not exist" containerID="99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"
Sep 18 20:06:58.873467 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.873433    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7"} err="failed to get container status \"99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7\": rpc error: code = NotFound desc = could not find container \"99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7\": container with ID starting with 99617fd6ffdc12849565ab15912beafe5c84acf79d2c327666a30236bdf1d7d7 not found: ID does not exist"
Sep 18 20:06:58.878244 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.878157    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"]
Sep 18 20:06:58.880521 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.880501    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl"]
Sep 18 20:06:58.901461 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901436    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.901461 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901459    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.901611 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901472    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.901611 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901481    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.901611 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901488    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.901611 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901495    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl2lg\" (UniqueName: \"kubernetes.io/projected/9b63d86a-5473-4924-b2bf-cc9b13e7c027-kube-api-access-bl2lg\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:06:58.901611 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:06:58.901503    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b63d86a-5473-4924-b2bf-cc9b13e7c027-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:00.441566 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:00.441533    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" path="/var/lib/kubelet/pods/9b63d86a-5473-4924-b2bf-cc9b13e7c027/volumes"
Sep 18 20:07:09.319893 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.319833    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"]
Sep 18 20:07:09.320428 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.320123    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn" podUID="71442191-5551-44be-828a-d8766b6c37cc" containerName="maas-api" containerID="cri-o://1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca" gracePeriod=30
Sep 18 20:07:09.582767 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.582702    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:07:09.717288 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.717250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-metrics-certs\") pod \"71442191-5551-44be-828a-d8766b6c37cc\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") "
Sep 18 20:07:09.717583 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.717565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71442191-5551-44be-828a-d8766b6c37cc-openshift-service-ca\") pod \"71442191-5551-44be-828a-d8766b6c37cc\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") "
Sep 18 20:07:09.717712 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.717698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqzbm\" (UniqueName: \"kubernetes.io/projected/71442191-5551-44be-828a-d8766b6c37cc-kube-api-access-hqzbm\") pod \"71442191-5551-44be-828a-d8766b6c37cc\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") "
Sep 18 20:07:09.717943 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.717927    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-maas-api-tls\") pod \"71442191-5551-44be-828a-d8766b6c37cc\" (UID: \"71442191-5551-44be-828a-d8766b6c37cc\") "
Sep 18 20:07:09.719028 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.719002    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71442191-5551-44be-828a-d8766b6c37cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71442191-5551-44be-828a-d8766b6c37cc" (UID: "71442191-5551-44be-828a-d8766b6c37cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:09.722124 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.721537    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "71442191-5551-44be-828a-d8766b6c37cc" (UID: "71442191-5551-44be-828a-d8766b6c37cc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:07:09.722980 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.722806    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71442191-5551-44be-828a-d8766b6c37cc" (UID: "71442191-5551-44be-828a-d8766b6c37cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:07:09.722980 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.722936    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71442191-5551-44be-828a-d8766b6c37cc-kube-api-access-hqzbm" (OuterVolumeSpecName: "kube-api-access-hqzbm") pod "71442191-5551-44be-828a-d8766b6c37cc" (UID: "71442191-5551-44be-828a-d8766b6c37cc"). InnerVolumeSpecName "kube-api-access-hqzbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:09.819387 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.819352    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:09.819387 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.819384    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71442191-5551-44be-828a-d8766b6c37cc-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:09.819387 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.819393    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71442191-5551-44be-828a-d8766b6c37cc-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:09.819643 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.819403    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqzbm\" (UniqueName: \"kubernetes.io/projected/71442191-5551-44be-828a-d8766b6c37cc-kube-api-access-hqzbm\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:09.924240 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.924207    2582 generic.go:356] "Generic (PLEG): container finished" podID="71442191-5551-44be-828a-d8766b6c37cc" containerID="1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca" exitCode=0
Sep 18 20:07:09.924450 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.924251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn" event={"ID":"71442191-5551-44be-828a-d8766b6c37cc","Type":"ContainerDied","Data":"1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca"}
Sep 18 20:07:09.924450 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.924274    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"
Sep 18 20:07:09.924450 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.924300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn" event={"ID":"71442191-5551-44be-828a-d8766b6c37cc","Type":"ContainerDied","Data":"a1c17897f96d29d497b1aa01342e32422a1cee8dd21df85ac14514c3f19318bc"}
Sep 18 20:07:09.924450 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.924328    2582 scope.go:117] "RemoveContainer" containerID="1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca"
Sep 18 20:07:09.934850 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.934776    2582 scope.go:117] "RemoveContainer" containerID="1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca"
Sep 18 20:07:09.935216 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:07:09.935162    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca\": container with ID starting with 1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca not found: ID does not exist" containerID="1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca"
Sep 18 20:07:09.935216 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.935198    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca"} err="failed to get container status \"1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca\": rpc error: code = NotFound desc = could not find container \"1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca\": container with ID starting with 1fc359d161f3f7b57fb31afe3e8242ef28a510384a567f2d259afba35a4282ca not found: ID does not exist"
Sep 18 20:07:09.950953 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.950914    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"]
Sep 18 20:07:09.954701 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:09.954669    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-13f9e5-545f5f7f56-ffdjn"]
Sep 18 20:07:10.441012 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:10.440986    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71442191-5551-44be-828a-d8766b6c37cc" path="/var/lib/kubelet/pods/71442191-5551-44be-828a-d8766b6c37cc/volumes"
Sep 18 20:07:26.812696 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:26.812658    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"]
Sep 18 20:07:26.813184 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:26.812940    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d" podUID="d1f0637a-ab1e-45f9-b15c-fa967a725a1e" containerName="maas-api" containerID="cri-o://16cb72d2fe7f1ee91f74f6dd5b031e3aa88bb13e78fa132ce378e484af625d2e" gracePeriod=30
Sep 18 20:07:27.028573 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.028544    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1f0637a-ab1e-45f9-b15c-fa967a725a1e" containerID="16cb72d2fe7f1ee91f74f6dd5b031e3aa88bb13e78fa132ce378e484af625d2e" exitCode=0
Sep 18 20:07:27.028831 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.028601    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d" event={"ID":"d1f0637a-ab1e-45f9-b15c-fa967a725a1e","Type":"ContainerDied","Data":"16cb72d2fe7f1ee91f74f6dd5b031e3aa88bb13e78fa132ce378e484af625d2e"}
Sep 18 20:07:27.087388 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.087365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:07:27.189622 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.189541    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-openshift-service-ca\") pod \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") "
Sep 18 20:07:27.189798 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.189633    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-maas-api-tls\") pod \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") "
Sep 18 20:07:27.189798 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.189651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tkvn\" (UniqueName: \"kubernetes.io/projected/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-kube-api-access-9tkvn\") pod \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") "
Sep 18 20:07:27.189798 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.189678    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-metrics-certs\") pod \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\" (UID: \"d1f0637a-ab1e-45f9-b15c-fa967a725a1e\") "
Sep 18 20:07:27.190007 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.189968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1f0637a-ab1e-45f9-b15c-fa967a725a1e" (UID: "d1f0637a-ab1e-45f9-b15c-fa967a725a1e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:27.192016 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.191989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1f0637a-ab1e-45f9-b15c-fa967a725a1e" (UID: "d1f0637a-ab1e-45f9-b15c-fa967a725a1e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:07:27.192170 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.192144    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-kube-api-access-9tkvn" (OuterVolumeSpecName: "kube-api-access-9tkvn") pod "d1f0637a-ab1e-45f9-b15c-fa967a725a1e" (UID: "d1f0637a-ab1e-45f9-b15c-fa967a725a1e"). InnerVolumeSpecName "kube-api-access-9tkvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:27.193196 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.193166    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d1f0637a-ab1e-45f9-b15c-fa967a725a1e" (UID: "d1f0637a-ab1e-45f9-b15c-fa967a725a1e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:07:27.291066 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.291039    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.291066 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.291065    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tkvn\" (UniqueName: \"kubernetes.io/projected/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-kube-api-access-9tkvn\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.291066 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.291077    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.291290 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:27.291086    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f0637a-ab1e-45f9-b15c-fa967a725a1e-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:28.036400 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:28.036365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d" event={"ID":"d1f0637a-ab1e-45f9-b15c-fa967a725a1e","Type":"ContainerDied","Data":"c14855adc5f848c419309845cb333bfdd40caf9bb82bf348614da8b00e0560cf"}
Sep 18 20:07:28.036825 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:28.036420    2582 scope.go:117] "RemoveContainer" containerID="16cb72d2fe7f1ee91f74f6dd5b031e3aa88bb13e78fa132ce378e484af625d2e"
Sep 18 20:07:28.036825 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:28.036377    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"
Sep 18 20:07:28.059255 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:28.059213    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"]
Sep 18 20:07:28.065726 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:28.065706    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-047bea-744685cdf6-rhw6d"]
Sep 18 20:07:28.441747 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:28.441715    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f0637a-ab1e-45f9-b15c-fa967a725a1e" path="/var/lib/kubelet/pods/d1f0637a-ab1e-45f9-b15c-fa967a725a1e/volumes"
Sep 18 20:07:33.649823 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:33.649784    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"]
Sep 18 20:07:33.650242 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:33.650096    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" containerID="cri-o://4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb" gracePeriod=30
Sep 18 20:07:33.923230 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:33.923194    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 20:07:33.923382 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:33.923266    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:07:38.915723 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:38.915659    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:07:39.014127 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/369dc456-dba4-41c1-9766-845af390e37b-istio-podinfo\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014127 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014133    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-socket\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014383 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-envoy\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014383 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-istio-token\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014383 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-data\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014383 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014329    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-credential-socket\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014400    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-certs\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r5z9\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-kube-api-access-2r5z9\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014481    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/369dc456-dba4-41c1-9766-845af390e37b-istiod-ca-cert\") pod \"369dc456-dba4-41c1-9766-845af390e37b\" (UID: \"369dc456-dba4-41c1-9766-845af390e37b\") "
Sep 18 20:07:39.014610 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014517    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:39.014799 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014711    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:39.014799 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014763    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:39.014957 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014931    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.015035 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014959    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.015097 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.014940    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-data" (OuterVolumeSpecName: "istio-data") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:39.015153 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.015056    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.015208 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.015188    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/369dc456-dba4-41c1-9766-845af390e37b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:39.017035 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.017007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:39.017237 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.017214    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/369dc456-dba4-41c1-9766-845af390e37b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:07:39.017309 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.017216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-istio-token" (OuterVolumeSpecName: "istio-token") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:39.017529 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.017499    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-kube-api-access-2r5z9" (OuterVolumeSpecName: "kube-api-access-2r5z9") pod "369dc456-dba4-41c1-9766-845af390e37b" (UID: "369dc456-dba4-41c1-9766-845af390e37b"). InnerVolumeSpecName "kube-api-access-2r5z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:39.101775 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.101742    2582 generic.go:356] "Generic (PLEG): container finished" podID="369dc456-dba4-41c1-9766-845af390e37b" containerID="4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb" exitCode=0
Sep 18 20:07:39.101977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.101790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" event={"ID":"369dc456-dba4-41c1-9766-845af390e37b","Type":"ContainerDied","Data":"4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb"}
Sep 18 20:07:39.101977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.101798    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"
Sep 18 20:07:39.101977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.101857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt" event={"ID":"369dc456-dba4-41c1-9766-845af390e37b","Type":"ContainerDied","Data":"5f3609ad5e60958b3c04962b761874a9fc46eb6d2152a64254838ca1850389d5"}
Sep 18 20:07:39.101977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.101910    2582 scope.go:117] "RemoveContainer" containerID="4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb"
Sep 18 20:07:39.112025 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.112000    2582 scope.go:117] "RemoveContainer" containerID="cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"
Sep 18 20:07:39.115991 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.115964    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r5z9\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-kube-api-access-2r5z9\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.116083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.115996    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/369dc456-dba4-41c1-9766-845af390e37b-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.116083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.116010    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/369dc456-dba4-41c1-9766-845af390e37b-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.116083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.116022    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.116083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.116036    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369dc456-dba4-41c1-9766-845af390e37b-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.116083 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.116047    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/369dc456-dba4-41c1-9766-845af390e37b-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:39.120998 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.120981    2582 scope.go:117] "RemoveContainer" containerID="4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb"
Sep 18 20:07:39.121255 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:07:39.121239    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb\": container with ID starting with 4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb not found: ID does not exist" containerID="4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb"
Sep 18 20:07:39.121300 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.121262    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb"} err="failed to get container status \"4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb\": rpc error: code = NotFound desc = could not find container \"4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb\": container with ID starting with 4727973902f86aab471d8e1311a5f12e335d46474a5701a20a37071996a521bb not found: ID does not exist"
Sep 18 20:07:39.121300 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.121279    2582 scope.go:117] "RemoveContainer" containerID="cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"
Sep 18 20:07:39.121542 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:07:39.121524    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc\": container with ID starting with cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc not found: ID does not exist" containerID="cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"
Sep 18 20:07:39.121597 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.121546    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc"} err="failed to get container status \"cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc\": rpc error: code = NotFound desc = could not find container \"cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc\": container with ID starting with cbdff07863967ec15ac97ef23f6d347a6b3380c4c72fe7337264af91900976bc not found: ID does not exist"
Sep 18 20:07:39.124822 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.124800    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"]
Sep 18 20:07:39.128720 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:39.128700    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt"]
Sep 18 20:07:40.441606 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:40.441579    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="369dc456-dba4-41c1-9766-845af390e37b" path="/var/lib/kubelet/pods/369dc456-dba4-41c1-9766-845af390e37b/volumes"
Sep 18 20:07:44.505544 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.505512    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"]
Sep 18 20:07:44.505962 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.505710    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" podUID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" containerName="maas-api" containerID="cri-o://42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17" gracePeriod=30
Sep 18 20:07:44.553458 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.553418    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" podUID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.61:8443/health\": dial tcp 10.134.0.61:8443: connect: connection refused"
Sep 18 20:07:44.776320 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.776296    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:07:44.873640 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.873608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-openshift-service-ca\") pod \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") "
Sep 18 20:07:44.873837 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.873676    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-metrics-certs\") pod \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") "
Sep 18 20:07:44.873837 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.873721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls\") pod \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") "
Sep 18 20:07:44.873837 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.873752    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b958t\" (UniqueName: \"kubernetes.io/projected/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-kube-api-access-b958t\") pod \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\" (UID: \"c6e26e13-f1a0-41d9-95f9-b85bd94f2421\") "
Sep 18 20:07:44.874077 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.874048    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6e26e13-f1a0-41d9-95f9-b85bd94f2421" (UID: "c6e26e13-f1a0-41d9-95f9-b85bd94f2421"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:44.874238 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.874220    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:44.876158 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.876127    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6e26e13-f1a0-41d9-95f9-b85bd94f2421" (UID: "c6e26e13-f1a0-41d9-95f9-b85bd94f2421"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:07:44.876248 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.876166    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c6e26e13-f1a0-41d9-95f9-b85bd94f2421" (UID: "c6e26e13-f1a0-41d9-95f9-b85bd94f2421"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:07:44.876248 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.876179    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-kube-api-access-b958t" (OuterVolumeSpecName: "kube-api-access-b958t") pod "c6e26e13-f1a0-41d9-95f9-b85bd94f2421" (UID: "c6e26e13-f1a0-41d9-95f9-b85bd94f2421"). InnerVolumeSpecName "kube-api-access-b958t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:44.975011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.974974    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:44.975011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.975004    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:44.975011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:44.975013    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b958t\" (UniqueName: \"kubernetes.io/projected/c6e26e13-f1a0-41d9-95f9-b85bd94f2421-kube-api-access-b958t\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:07:45.144970 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.144868    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" containerID="42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17" exitCode=0
Sep 18 20:07:45.144970 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.144931    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"
Sep 18 20:07:45.145212 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.144977    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" event={"ID":"c6e26e13-f1a0-41d9-95f9-b85bd94f2421","Type":"ContainerDied","Data":"42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17"}
Sep 18 20:07:45.145212 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.145037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t" event={"ID":"c6e26e13-f1a0-41d9-95f9-b85bd94f2421","Type":"ContainerDied","Data":"a779be58dd78842bd7ce2f5731931a4d8e12494f623dbe944d0101533f285802"}
Sep 18 20:07:45.145212 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.145070    2582 scope.go:117] "RemoveContainer" containerID="42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17"
Sep 18 20:07:45.155223 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.155206    2582 scope.go:117] "RemoveContainer" containerID="42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17"
Sep 18 20:07:45.155581 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:07:45.155550    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17\": container with ID starting with 42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17 not found: ID does not exist" containerID="42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17"
Sep 18 20:07:45.155642 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.155592    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17"} err="failed to get container status \"42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17\": rpc error: code = NotFound desc = could not find container \"42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17\": container with ID starting with 42c949473475da0cfa9f3b0118bd4d41957959b05468cbc221fee8e6e65bde17 not found: ID does not exist"
Sep 18 20:07:45.167945 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.167917    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"]
Sep 18 20:07:45.172850 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:45.172829    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9838c2-569c9f56bc-nfc8t"]
Sep 18 20:07:46.440798 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:07:46.440767    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" path="/var/lib/kubelet/pods/c6e26e13-f1a0-41d9-95f9-b85bd94f2421/volumes"
Sep 18 20:08:14.620966 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.620923    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"]
Sep 18 20:08:14.621548 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.621176    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt" podUID="f762b3e2-ec33-46cc-8add-bf90d3ad28d9" containerName="maas-api" containerID="cri-o://2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7" gracePeriod=30
Sep 18 20:08:14.891098 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.891071    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 20:08:14.975709 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.975672    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-openshift-service-ca\") pod \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") "
Sep 18 20:08:14.975709 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.975716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-metrics-certs\") pod \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") "
Sep 18 20:08:14.976044 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.975793    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln4tb\" (UniqueName: \"kubernetes.io/projected/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-kube-api-access-ln4tb\") pod \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") "
Sep 18 20:08:14.976044 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.975824    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-maas-api-tls\") pod \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\" (UID: \"f762b3e2-ec33-46cc-8add-bf90d3ad28d9\") "
Sep 18 20:08:14.976165 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.976082    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f762b3e2-ec33-46cc-8add-bf90d3ad28d9" (UID: "f762b3e2-ec33-46cc-8add-bf90d3ad28d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:08:14.978147 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.978114    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-kube-api-access-ln4tb" (OuterVolumeSpecName: "kube-api-access-ln4tb") pod "f762b3e2-ec33-46cc-8add-bf90d3ad28d9" (UID: "f762b3e2-ec33-46cc-8add-bf90d3ad28d9"). InnerVolumeSpecName "kube-api-access-ln4tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:08:14.978691 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.978672    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f762b3e2-ec33-46cc-8add-bf90d3ad28d9" (UID: "f762b3e2-ec33-46cc-8add-bf90d3ad28d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:08:14.978768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:14.978693    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f762b3e2-ec33-46cc-8add-bf90d3ad28d9" (UID: "f762b3e2-ec33-46cc-8add-bf90d3ad28d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:08:15.076717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.076679    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:08:15.076717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.076714    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:08:15.076717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.076724    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln4tb\" (UniqueName: \"kubernetes.io/projected/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-kube-api-access-ln4tb\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:08:15.077026 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.076732    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f762b3e2-ec33-46cc-8add-bf90d3ad28d9-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:08:15.313032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.312996    2582 generic.go:356] "Generic (PLEG): container finished" podID="f762b3e2-ec33-46cc-8add-bf90d3ad28d9" containerID="2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7" exitCode=0
Sep 18 20:08:15.313255 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.313099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt" event={"ID":"f762b3e2-ec33-46cc-8add-bf90d3ad28d9","Type":"ContainerDied","Data":"2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7"}
Sep 18 20:08:15.313255 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.313186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt" event={"ID":"f762b3e2-ec33-46cc-8add-bf90d3ad28d9","Type":"ContainerDied","Data":"25de41ce6f7242156a483973b89185ed1ab718c50ab2370c54630c6888f5e7f0"}
Sep 18 20:08:15.313255 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.313233    2582 scope.go:117] "RemoveContainer" containerID="2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7"
Sep 18 20:08:15.313422 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.313404    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"
Sep 18 20:08:15.328032 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.328012    2582 scope.go:117] "RemoveContainer" containerID="2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7"
Sep 18 20:08:15.328351 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:08:15.328328    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7\": container with ID starting with 2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7 not found: ID does not exist" containerID="2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7"
Sep 18 20:08:15.328421 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.328358    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7"} err="failed to get container status \"2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7\": rpc error: code = NotFound desc = could not find container \"2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7\": container with ID starting with 2abc3626f133e7cb8e9841d039991f530f9ef4efddbab4ce1dd8846ace8979c7 not found: ID does not exist"
Sep 18 20:08:15.340527 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.340487    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"]
Sep 18 20:08:15.344243 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:15.344220    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-674263-5c747d555d-tjszt"]
Sep 18 20:08:16.441815 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:08:16.441786    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f762b3e2-ec33-46cc-8add-bf90d3ad28d9" path="/var/lib/kubelet/pods/f762b3e2-ec33-46cc-8add-bf90d3ad28d9/volumes"
Sep 18 20:09:26.540639 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:09:26.540609    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:09:26.545683 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:09:26.545661    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:09:26.549594 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:09:26.549570    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:09:26.554011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:09:26.553992    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:12:54.159389 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:12:54.159355    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-q2vlj_47754a28-350a-46e5-ab22-84d9a12a7800/payload-processing/0.log"
Sep 18 20:13:02.582779 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.582743    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"]
Sep 18 20:13:02.583247 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583214    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f762b3e2-ec33-46cc-8add-bf90d3ad28d9" containerName="maas-api"
Sep 18 20:13:02.583247 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583234    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f762b3e2-ec33-46cc-8add-bf90d3ad28d9" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583249    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583258    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583282    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80e432f-d788-4d9c-86d7-3cba53c988d8" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583290    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80e432f-d788-4d9c-86d7-3cba53c988d8" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583304    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583313    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583324    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71442191-5551-44be-828a-d8766b6c37cc" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583332    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="71442191-5551-44be-828a-d8766b6c37cc" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583343    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583352    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583363    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00458157-e1b8-4252-a541-f19657241b9c" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583370    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00458157-e1b8-4252-a541-f19657241b9c" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583401    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f0637a-ab1e-45f9-b15c-fa967a725a1e" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583412    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f0637a-ab1e-45f9-b15c-fa967a725a1e" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583423    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" containerName="maas-api"
Sep 18 20:13:02.583425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583431    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" containerName="maas-api"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583541    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="71442191-5551-44be-828a-d8766b6c37cc" containerName="maas-api"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583554    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00458157-e1b8-4252-a541-f19657241b9c" containerName="maas-api"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583562    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583573    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583581    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583597    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f762b3e2-ec33-46cc-8add-bf90d3ad28d9" containerName="maas-api"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583605    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6e26e13-f1a0-41d9-95f9-b85bd94f2421" containerName="maas-api"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583613    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80e432f-d788-4d9c-86d7-3cba53c988d8" containerName="maas-api"
Sep 18 20:13:02.584055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.583619    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f0637a-ab1e-45f9-b15c-fa967a725a1e" containerName="maas-api"
Sep 18 20:13:02.586657 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.586640    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.590476 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.590456    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-953438\"/\"kube-root-ca.crt\""
Sep 18 20:13:02.590476 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.590474    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-953438\"/\"default-dockercfg-2cf7t\""
Sep 18 20:13:02.590476 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.590482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-953438\"/\"openshift-service-ca.crt\""
Sep 18 20:13:02.590710 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.590498    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-953438\"/\"ipp-route-953438-kserve-self-signed-certs\""
Sep 18 20:13:02.596864 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.596841    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"]
Sep 18 20:13:02.676441 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.676407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887c2349-6241-4a69-89eb-58d38984fc77-tls-certs\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.676612 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.676453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-tmp-dir\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.676612 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.676475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-home\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.676730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.676606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-model-cache\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.676730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.676654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2dw8\" (UniqueName: \"kubernetes.io/projected/887c2349-6241-4a69-89eb-58d38984fc77-kube-api-access-b2dw8\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.676730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.676680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-dshm\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.777775 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.777748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887c2349-6241-4a69-89eb-58d38984fc77-tls-certs\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.777973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.777789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-tmp-dir\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.777973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.777810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-home\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.777973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.777859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-model-cache\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.777973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.777911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2dw8\" (UniqueName: \"kubernetes.io/projected/887c2349-6241-4a69-89eb-58d38984fc77-kube-api-access-b2dw8\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.777973 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.777933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-dshm\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.778262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.778237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-tmp-dir\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.778329 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.778273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-home\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.778390 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.778342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-model-cache\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.780192 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.780176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-dshm\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.780586 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.780567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887c2349-6241-4a69-89eb-58d38984fc77-tls-certs\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.785588 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.785566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2dw8\" (UniqueName: \"kubernetes.io/projected/887c2349-6241-4a69-89eb-58d38984fc77-kube-api-access-b2dw8\") pod \"ipp-route-953438-kserve-57f99c9c79-7w5lt\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") " pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:02.897153 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:02.897055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:03.174496 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:03.174472    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"]
Sep 18 20:13:03.176387 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:13:03.176363    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod887c2349_6241_4a69_89eb_58d38984fc77.slice/crio-a913424d0f645957f61b8b1563dffa0bdede7d551f609fb483687b917a9bd99d WatchSource:0}: Error finding container a913424d0f645957f61b8b1563dffa0bdede7d551f609fb483687b917a9bd99d: Status 404 returned error can't find the container with id a913424d0f645957f61b8b1563dffa0bdede7d551f609fb483687b917a9bd99d
Sep 18 20:13:03.863107 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:03.863069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt" event={"ID":"887c2349-6241-4a69-89eb-58d38984fc77","Type":"ContainerStarted","Data":"a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b"}
Sep 18 20:13:03.863107 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:03.863113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt" event={"ID":"887c2349-6241-4a69-89eb-58d38984fc77","Type":"ContainerStarted","Data":"a913424d0f645957f61b8b1563dffa0bdede7d551f609fb483687b917a9bd99d"}
Sep 18 20:13:03.881483 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:03.881434    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt" podStartSLOduration=1.881417741 podStartE2EDuration="1.881417741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:13:03.879695112 +0000 UTC m=+2019.638503103" watchObservedRunningTime="2026-09-18 20:13:03.881417741 +0000 UTC m=+2019.640225726"
Sep 18 20:13:12.897755 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:12.897718    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:12.898225 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:12.897770    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:12.910833 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:12.910804    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:12.923385 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:12.923353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:13:25.296281 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:25.296248    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-q2vlj_47754a28-350a-46e5-ab22-84d9a12a7800/payload-processing/0.log"
Sep 18 20:13:26.022705 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.022670    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"]
Sep 18 20:13:26.023356 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.023321    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy"
Sep 18 20:13:26.023356 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.023345    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="369dc456-dba4-41c1-9766-845af390e37b" containerName="istio-proxy"
Sep 18 20:13:26.023547 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.023462    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b63d86a-5473-4924-b2bf-cc9b13e7c027" containerName="istio-proxy"
Sep 18 20:13:26.026742 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.026725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.030111 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.030086    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-e91414-openshift-default-dockercfg-zkskw\""
Sep 18 20:13:26.050448 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.050422    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"]
Sep 18 20:13:26.209871 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.209798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w99f4\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-kube-api-access-w99f4\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210072 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.209925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18955e46-77a7-424b-989b-3baaf996b213-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210072 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.209972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-certs\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210072 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.210035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-socket\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210245 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.210157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-envoy\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210245 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.210177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-istio-token\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210245 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.210207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-data\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210354 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.210244    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-credential-socket\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.210354 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.210268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18955e46-77a7-424b-989b-3baaf996b213-istio-podinfo\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311209 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-envoy\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311209 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-istio-token\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311209 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-data\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-credential-socket\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18955e46-77a7-424b-989b-3baaf996b213-istio-podinfo\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w99f4\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-kube-api-access-w99f4\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18955e46-77a7-424b-989b-3baaf996b213-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-certs\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-data\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311688    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-credential-socket\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.311771 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-certs\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.312262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.311482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-socket\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.312262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.312139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18955e46-77a7-424b-989b-3baaf996b213-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.312262 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.312205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-socket\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.316116 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.316089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-envoy\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.316444 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.316400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18955e46-77a7-424b-989b-3baaf996b213-istio-podinfo\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.319521 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.319500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-istio-token\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.320730 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.320713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w99f4\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-kube-api-access-w99f4\") pod \"e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") " pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.340309 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.340280    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-e91414-openshift-default-dockercfg-zkskw\""
Sep 18 20:13:26.347575 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.347547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:26.630253 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.630232    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"]
Sep 18 20:13:26.631539 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:13:26.631514    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18955e46_77a7_424b_989b_3baaf996b213.slice/crio-3329ef0e8c66c48d9fb78f73088f5f5c17be369f1241e7835ebee7e7f0de04e8 WatchSource:0}: Error finding container 3329ef0e8c66c48d9fb78f73088f5f5c17be369f1241e7835ebee7e7f0de04e8: Status 404 returned error can't find the container with id 3329ef0e8c66c48d9fb78f73088f5f5c17be369f1241e7835ebee7e7f0de04e8
Sep 18 20:13:26.633969 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.633925    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:13:26.634073 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.634004    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:13:26.634073 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.634050    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:13:26.993622 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.993579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" event={"ID":"18955e46-77a7-424b-989b-3baaf996b213","Type":"ContainerStarted","Data":"9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"}
Sep 18 20:13:26.993793 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:26.993644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" event={"ID":"18955e46-77a7-424b-989b-3baaf996b213","Type":"ContainerStarted","Data":"3329ef0e8c66c48d9fb78f73088f5f5c17be369f1241e7835ebee7e7f0de04e8"}
Sep 18 20:13:27.347986 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:27.347893    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:27.353296 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:27.353271    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:27.374309 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:27.374264    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podStartSLOduration=2.374248722 podStartE2EDuration="2.374248722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:13:27.016322028 +0000 UTC m=+2042.775130014" watchObservedRunningTime="2026-09-18 20:13:27.374248722 +0000 UTC m=+2043.133056709"
Sep 18 20:13:27.999305 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:27.999276    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:28.000173 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:28.000154    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:33.398944 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.398908    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"]
Sep 18 20:13:33.402944 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.402919    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.405567 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.405546    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-e91414-serving-cert\""
Sep 18 20:13:33.415744 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.415719    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"]
Sep 18 20:13:33.479977 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.479940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.480167 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.480058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcqv\" (UniqueName: \"kubernetes.io/projected/20bdc23f-b66b-4a39-acfc-154c2dbabc04-kube-api-access-phcqv\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.480167 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.480080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bdc23f-b66b-4a39-acfc-154c2dbabc04-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.480167 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.480101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.581295 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.581261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcqv\" (UniqueName: \"kubernetes.io/projected/20bdc23f-b66b-4a39-acfc-154c2dbabc04-kube-api-access-phcqv\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.581476 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.581300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bdc23f-b66b-4a39-acfc-154c2dbabc04-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.581476 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.581333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.581476 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.581377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.581692 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:13:33.581479    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-serving-cert: secret "maas-api-e2e-ipp-cleanup-e91414-serving-cert" not found
Sep 18 20:13:33.581692 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:13:33.581595    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls podName:20bdc23f-b66b-4a39-acfc-154c2dbabc04 nodeName:}" failed. No retries permitted until 2026-09-18 20:13:34.081574045 +0000 UTC m=+2049.840382010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" (UID: "20bdc23f-b66b-4a39-acfc-154c2dbabc04") : secret "maas-api-e2e-ipp-cleanup-e91414-serving-cert" not found
Sep 18 20:13:33.582036 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.582016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bdc23f-b66b-4a39-acfc-154c2dbabc04-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.584101 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.584071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:33.589998 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:33.589977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcqv\" (UniqueName: \"kubernetes.io/projected/20bdc23f-b66b-4a39-acfc-154c2dbabc04-kube-api-access-phcqv\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:34.085313 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:34.085286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:34.087828 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:34.087806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:34.316954 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:34.316912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:34.596732 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:34.596702    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"]
Sep 18 20:13:34.599974 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:13:34.599947    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bdc23f_b66b_4a39_acfc_154c2dbabc04.slice/crio-e0c92ce27e28699acfa012e1fa1c83d3100800f70f0037241f679b115d69d8e3 WatchSource:0}: Error finding container e0c92ce27e28699acfa012e1fa1c83d3100800f70f0037241f679b115d69d8e3: Status 404 returned error can't find the container with id e0c92ce27e28699acfa012e1fa1c83d3100800f70f0037241f679b115d69d8e3
Sep 18 20:13:34.601329 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:34.601311    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:13:35.047138 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:35.047107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" event={"ID":"20bdc23f-b66b-4a39-acfc-154c2dbabc04","Type":"ContainerStarted","Data":"e0c92ce27e28699acfa012e1fa1c83d3100800f70f0037241f679b115d69d8e3"}
Sep 18 20:13:36.054371 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:36.054330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" event={"ID":"20bdc23f-b66b-4a39-acfc-154c2dbabc04","Type":"ContainerStarted","Data":"2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb"}
Sep 18 20:13:36.054849 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:36.054500    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:36.072471 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:36.072428    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" podStartSLOduration=2.684055897 podStartE2EDuration="3.072414476s" totalImagesPullingTime="388.358579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:13:36.070345071 +0000 UTC m=+2051.829153081" watchObservedRunningTime="2026-09-18 20:13:36.072414476 +0000 UTC m=+2051.831222462"
Sep 18 20:13:42.065783 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:42.065755    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:13:50.137680 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:50.137651    2582 generic.go:356] "Generic (PLEG): container finished" podID="18955e46-77a7-424b-989b-3baaf996b213" containerID="9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6" exitCode=0
Sep 18 20:13:50.138147 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:50.137727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" event={"ID":"18955e46-77a7-424b-989b-3baaf996b213","Type":"ContainerDied","Data":"9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"}
Sep 18 20:13:50.138193 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:50.138168    2582 scope.go:117] "RemoveContainer" containerID="9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"
Sep 18 20:13:50.139374 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:50.139349    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:13:50.139438 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:50.139414    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:13:50.139474 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:50.139442    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 20:13:51.145024 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:51.144989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" event={"ID":"18955e46-77a7-424b-989b-3baaf996b213","Type":"ContainerStarted","Data":"017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514"}
Sep 18 20:13:51.348162 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:51.348117    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:51.348365 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:51.348341    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:13:51.348426 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:51.348407    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 18 20:13:52.348821 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:52.348783    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:13:52.349250 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:52.348850    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 18 20:13:53.348473 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:53.348441    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:13:53.348671 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:53.348494    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 18 20:13:54.348506 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:54.348473    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:13:54.348951 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:54.348526    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 18 20:13:55.347967 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:55.347932    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:13:55.348242 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:55.347998    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 18 20:13:56.348225 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:56.348185    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:13:56.348705 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:56.348268    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 18 20:13:57.352737 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:57.352706    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:57.353302 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:57.353135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:13:57.353834 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:13:57.353812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:14:10.864381 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:10.864326    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"]
Sep 18 20:14:10.872903 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:10.865179    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" podUID="20bdc23f-b66b-4a39-acfc-154c2dbabc04" containerName="maas-api" containerID="cri-o://2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb" gracePeriod=30
Sep 18 20:14:11.145068 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.145044    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:14:11.166383 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.166358    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls\") pod \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") "
Sep 18 20:14:11.166533 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.166474    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phcqv\" (UniqueName: \"kubernetes.io/projected/20bdc23f-b66b-4a39-acfc-154c2dbabc04-kube-api-access-phcqv\") pod \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") "
Sep 18 20:14:11.166602 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.166568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-metrics-certs\") pod \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") "
Sep 18 20:14:11.166663 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.166609    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bdc23f-b66b-4a39-acfc-154c2dbabc04-openshift-service-ca\") pod \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\" (UID: \"20bdc23f-b66b-4a39-acfc-154c2dbabc04\") "
Sep 18 20:14:11.167303 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.167273    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20bdc23f-b66b-4a39-acfc-154c2dbabc04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20bdc23f-b66b-4a39-acfc-154c2dbabc04" (UID: "20bdc23f-b66b-4a39-acfc-154c2dbabc04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:11.169087 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.169053    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20bdc23f-b66b-4a39-acfc-154c2dbabc04" (UID: "20bdc23f-b66b-4a39-acfc-154c2dbabc04"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:14:11.169213 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.169138    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20bdc23f-b66b-4a39-acfc-154c2dbabc04-kube-api-access-phcqv" (OuterVolumeSpecName: "kube-api-access-phcqv") pod "20bdc23f-b66b-4a39-acfc-154c2dbabc04" (UID: "20bdc23f-b66b-4a39-acfc-154c2dbabc04"). InnerVolumeSpecName "kube-api-access-phcqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:11.169447 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.169412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20bdc23f-b66b-4a39-acfc-154c2dbabc04" (UID: "20bdc23f-b66b-4a39-acfc-154c2dbabc04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:14:11.262899 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.262842    2582 generic.go:356] "Generic (PLEG): container finished" podID="20bdc23f-b66b-4a39-acfc-154c2dbabc04" containerID="2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb" exitCode=0
Sep 18 20:14:11.263064 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.262960    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"
Sep 18 20:14:11.263064 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.262984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" event={"ID":"20bdc23f-b66b-4a39-acfc-154c2dbabc04","Type":"ContainerDied","Data":"2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb"}
Sep 18 20:14:11.263064 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.263055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64" event={"ID":"20bdc23f-b66b-4a39-acfc-154c2dbabc04","Type":"ContainerDied","Data":"e0c92ce27e28699acfa012e1fa1c83d3100800f70f0037241f679b115d69d8e3"}
Sep 18 20:14:11.263237 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.263086    2582 scope.go:117] "RemoveContainer" containerID="2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb"
Sep 18 20:14:11.267847 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.267767    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20bdc23f-b66b-4a39-acfc-154c2dbabc04-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.267847 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.267794    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.267847 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.267810    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phcqv\" (UniqueName: \"kubernetes.io/projected/20bdc23f-b66b-4a39-acfc-154c2dbabc04-kube-api-access-phcqv\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.267847 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.267824    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20bdc23f-b66b-4a39-acfc-154c2dbabc04-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.273906 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.273862    2582 scope.go:117] "RemoveContainer" containerID="2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb"
Sep 18 20:14:11.274252 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:14:11.274175    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb\": container with ID starting with 2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb not found: ID does not exist" containerID="2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb"
Sep 18 20:14:11.274252 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.274201    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb"} err="failed to get container status \"2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb\": rpc error: code = NotFound desc = could not find container \"2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb\": container with ID starting with 2029cf7c91999c0a2a64c0b40975d4a8b9641c09d6100ec834540372f8046bbb not found: ID does not exist"
Sep 18 20:14:11.287135 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.287109    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"]
Sep 18 20:14:11.292242 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:11.292216    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e91414-6548668b6b-p7p64"]
Sep 18 20:14:12.440972 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:12.440936    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20bdc23f-b66b-4a39-acfc-154c2dbabc04" path="/var/lib/kubelet/pods/20bdc23f-b66b-4a39-acfc-154c2dbabc04/volumes"
Sep 18 20:14:17.821590 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:17.821554    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"]
Sep 18 20:14:17.822180 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:17.821813    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy" containerID="cri-o://017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514" gracePeriod=30
Sep 18 20:14:23.069830 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.069803    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:14:23.190576 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190545    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-socket\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190576 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190578    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-certs\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18955e46-77a7-424b-989b-3baaf996b213-istiod-ca-cert\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190634    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18955e46-77a7-424b-989b-3baaf996b213-istio-podinfo\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190660    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-data\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-credential-socket\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190719    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-istio-token\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190768    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w99f4\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-kube-api-access-w99f4\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.190841 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-envoy\") pod \"18955e46-77a7-424b-989b-3baaf996b213\" (UID: \"18955e46-77a7-424b-989b-3baaf996b213\") "
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.190946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.191092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-data" (OuterVolumeSpecName: "istio-data") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.191145    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.191182    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18955e46-77a7-424b-989b-3baaf996b213-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.191211    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.191230    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.191239 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.191238    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.193324 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.193284    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-kube-api-access-w99f4" (OuterVolumeSpecName: "kube-api-access-w99f4") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "kube-api-access-w99f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:23.193430 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.193348    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-istio-token" (OuterVolumeSpecName: "istio-token") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:23.193430 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.193357    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:23.193430 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.193397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18955e46-77a7-424b-989b-3baaf996b213-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18955e46-77a7-424b-989b-3baaf996b213" (UID: "18955e46-77a7-424b-989b-3baaf996b213"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:14:23.292702 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.292662    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w99f4\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-kube-api-access-w99f4\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.292702 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.292693    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.292702 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.292703    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18955e46-77a7-424b-989b-3baaf996b213-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.292702 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.292711    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18955e46-77a7-424b-989b-3baaf996b213-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.293025 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.292719    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18955e46-77a7-424b-989b-3baaf996b213-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.293025 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.292726    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18955e46-77a7-424b-989b-3baaf996b213-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:23.340666 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.340631    2582 generic.go:356] "Generic (PLEG): container finished" podID="18955e46-77a7-424b-989b-3baaf996b213" containerID="017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514" exitCode=0
Sep 18 20:14:23.340842 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.340675    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" event={"ID":"18955e46-77a7-424b-989b-3baaf996b213","Type":"ContainerDied","Data":"017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514"}
Sep 18 20:14:23.340842 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.340727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d" event={"ID":"18955e46-77a7-424b-989b-3baaf996b213","Type":"ContainerDied","Data":"3329ef0e8c66c48d9fb78f73088f5f5c17be369f1241e7835ebee7e7f0de04e8"}
Sep 18 20:14:23.340842 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.340678    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"
Sep 18 20:14:23.340842 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.340754    2582 scope.go:117] "RemoveContainer" containerID="017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514"
Sep 18 20:14:23.354387 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.354367    2582 scope.go:117] "RemoveContainer" containerID="9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"
Sep 18 20:14:23.363461 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.363444    2582 scope.go:117] "RemoveContainer" containerID="017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514"
Sep 18 20:14:23.363763 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:14:23.363741    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514\": container with ID starting with 017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514 not found: ID does not exist" containerID="017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514"
Sep 18 20:14:23.363844 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.363772    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514"} err="failed to get container status \"017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514\": rpc error: code = NotFound desc = could not find container \"017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514\": container with ID starting with 017b23e16f7739704500fa6ae54f0325797772c13f430d54eb26290bf0b6a514 not found: ID does not exist"
Sep 18 20:14:23.363844 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.363789    2582 scope.go:117] "RemoveContainer" containerID="9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"
Sep 18 20:14:23.364081 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:14:23.364061    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6\": container with ID starting with 9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6 not found: ID does not exist" containerID="9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"
Sep 18 20:14:23.364139 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.364085    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6"} err="failed to get container status \"9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6\": rpc error: code = NotFound desc = could not find container \"9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6\": container with ID starting with 9462a22ff0b3d7fe1010d86c2098eef4fd025188f3a8d4e20ecabb0c568b6fc6 not found: ID does not exist"
Sep 18 20:14:23.365422 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.365401    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"]
Sep 18 20:14:23.372098 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:23.372078    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d"]
Sep 18 20:14:24.440904 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:24.440840    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18955e46-77a7-424b-989b-3baaf996b213" path="/var/lib/kubelet/pods/18955e46-77a7-424b-989b-3baaf996b213/volumes"
Sep 18 20:14:26.576248 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:26.576211    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:14:26.581382 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:26.581354    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:14:26.586044 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:26.586027    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:14:26.591234 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:26.591219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:14:42.615354 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:42.615319    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"]
Sep 18 20:14:57.636485 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.636445    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt" podUID="887c2349-6241-4a69-89eb-58d38984fc77" containerName="main" containerID="cri-o://a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b" gracePeriod=45
Sep 18 20:14:57.890603 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.890550    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:14:57.924422 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.924395    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-dshm\") pod \"887c2349-6241-4a69-89eb-58d38984fc77\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") "
Sep 18 20:14:57.924601 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.924485    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887c2349-6241-4a69-89eb-58d38984fc77-tls-certs\") pod \"887c2349-6241-4a69-89eb-58d38984fc77\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") "
Sep 18 20:14:57.924601 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.924555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-model-cache\") pod \"887c2349-6241-4a69-89eb-58d38984fc77\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") "
Sep 18 20:14:57.924601 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.924580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-home\") pod \"887c2349-6241-4a69-89eb-58d38984fc77\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") "
Sep 18 20:14:57.924784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.924631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-tmp-dir\") pod \"887c2349-6241-4a69-89eb-58d38984fc77\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") "
Sep 18 20:14:57.924784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.924676    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2dw8\" (UniqueName: \"kubernetes.io/projected/887c2349-6241-4a69-89eb-58d38984fc77-kube-api-access-b2dw8\") pod \"887c2349-6241-4a69-89eb-58d38984fc77\" (UID: \"887c2349-6241-4a69-89eb-58d38984fc77\") "
Sep 18 20:14:57.925091 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.925056    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "887c2349-6241-4a69-89eb-58d38984fc77" (UID: "887c2349-6241-4a69-89eb-58d38984fc77"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:57.925091 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.925071    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-model-cache" (OuterVolumeSpecName: "model-cache") pod "887c2349-6241-4a69-89eb-58d38984fc77" (UID: "887c2349-6241-4a69-89eb-58d38984fc77"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:57.925450 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.925139    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-home" (OuterVolumeSpecName: "home") pod "887c2349-6241-4a69-89eb-58d38984fc77" (UID: "887c2349-6241-4a69-89eb-58d38984fc77"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:57.926971 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.926945    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-dshm" (OuterVolumeSpecName: "dshm") pod "887c2349-6241-4a69-89eb-58d38984fc77" (UID: "887c2349-6241-4a69-89eb-58d38984fc77"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:14:57.927054 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.927028    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/887c2349-6241-4a69-89eb-58d38984fc77-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "887c2349-6241-4a69-89eb-58d38984fc77" (UID: "887c2349-6241-4a69-89eb-58d38984fc77"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:14:57.927784 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:57.927760    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/887c2349-6241-4a69-89eb-58d38984fc77-kube-api-access-b2dw8" (OuterVolumeSpecName: "kube-api-access-b2dw8") pod "887c2349-6241-4a69-89eb-58d38984fc77" (UID: "887c2349-6241-4a69-89eb-58d38984fc77"). InnerVolumeSpecName "kube-api-access-b2dw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:58.026543 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.026515    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-tmp-dir\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:58.026543 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.026539    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2dw8\" (UniqueName: \"kubernetes.io/projected/887c2349-6241-4a69-89eb-58d38984fc77-kube-api-access-b2dw8\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:58.026717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.026550    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-dshm\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:58.026717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.026558    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/887c2349-6241-4a69-89eb-58d38984fc77-tls-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:58.026717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.026567    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-model-cache\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:58.026717 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.026574    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/887c2349-6241-4a69-89eb-58d38984fc77-home\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:14:58.540609 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.540579    2582 generic.go:356] "Generic (PLEG): container finished" podID="887c2349-6241-4a69-89eb-58d38984fc77" containerID="a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b" exitCode=0
Sep 18 20:14:58.540768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.540619    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"
Sep 18 20:14:58.540768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.540660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt" event={"ID":"887c2349-6241-4a69-89eb-58d38984fc77","Type":"ContainerDied","Data":"a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b"}
Sep 18 20:14:58.540768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.540704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt" event={"ID":"887c2349-6241-4a69-89eb-58d38984fc77","Type":"ContainerDied","Data":"a913424d0f645957f61b8b1563dffa0bdede7d551f609fb483687b917a9bd99d"}
Sep 18 20:14:58.540768 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.540720    2582 scope.go:117] "RemoveContainer" containerID="a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b"
Sep 18 20:14:58.549331 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.549315    2582 scope.go:117] "RemoveContainer" containerID="a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b"
Sep 18 20:14:58.549573 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:14:58.549557    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b\": container with ID starting with a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b not found: ID does not exist" containerID="a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b"
Sep 18 20:14:58.549646 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.549585    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b"} err="failed to get container status \"a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b\": rpc error: code = NotFound desc = could not find container \"a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b\": container with ID starting with a2f20815331f13d8f020a773424d2d15df5312139f25ede8288e597dea9cb41b not found: ID does not exist"
Sep 18 20:14:58.557559 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.557538    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"]
Sep 18 20:14:58.561090 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:14:58.561071    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-953438/ipp-route-953438-kserve-57f99c9c79-7w5lt"]
Sep 18 20:15:00.440553 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:00.440520    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="887c2349-6241-4a69-89eb-58d38984fc77" path="/var/lib/kubelet/pods/887c2349-6241-4a69-89eb-58d38984fc77/volumes"
Sep 18 20:15:54.472759 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.472727    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"]
Sep 18 20:15:54.473459 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.473125    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" podUID="98a8b324-3760-4023-8f84-962427519106" containerName="maas-api" containerID="cri-o://2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225" gracePeriod=30
Sep 18 20:15:54.733461 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.733395    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:15:54.837414 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.837371    2582 generic.go:356] "Generic (PLEG): container finished" podID="98a8b324-3760-4023-8f84-962427519106" containerID="2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225" exitCode=0
Sep 18 20:15:54.837588 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.837427    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"
Sep 18 20:15:54.837588 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.837428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" event={"ID":"98a8b324-3760-4023-8f84-962427519106","Type":"ContainerDied","Data":"2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225"}
Sep 18 20:15:54.837588 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.837578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb" event={"ID":"98a8b324-3760-4023-8f84-962427519106","Type":"ContainerDied","Data":"afc1200ff827d4548ab11cddd6816f85c80105014e8c4b9c1ba03c3ae1ae1e31"}
Sep 18 20:15:54.837770 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.837614    2582 scope.go:117] "RemoveContainer" containerID="2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225"
Sep 18 20:15:54.847016 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.846992    2582 scope.go:117] "RemoveContainer" containerID="2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225"
Sep 18 20:15:54.847318 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:15:54.847293    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225\": container with ID starting with 2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225 not found: ID does not exist" containerID="2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225"
Sep 18 20:15:54.847388 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.847320    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225"} err="failed to get container status \"2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225\": rpc error: code = NotFound desc = could not find container \"2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225\": container with ID starting with 2b7f48cd1133f2f66b6809f545fbbef9275f6751ba411650858ff02c97080225 not found: ID does not exist"
Sep 18 20:15:54.870758 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.870717    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls\") pod \"98a8b324-3760-4023-8f84-962427519106\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") "
Sep 18 20:15:54.870923 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.870784    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-metrics-certs\") pod \"98a8b324-3760-4023-8f84-962427519106\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") "
Sep 18 20:15:54.870923 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.870844    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w8m7\" (UniqueName: \"kubernetes.io/projected/98a8b324-3760-4023-8f84-962427519106-kube-api-access-2w8m7\") pod \"98a8b324-3760-4023-8f84-962427519106\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") "
Sep 18 20:15:54.871049 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.870941    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a8b324-3760-4023-8f84-962427519106-openshift-service-ca\") pod \"98a8b324-3760-4023-8f84-962427519106\" (UID: \"98a8b324-3760-4023-8f84-962427519106\") "
Sep 18 20:15:54.871660 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.871631    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a8b324-3760-4023-8f84-962427519106-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98a8b324-3760-4023-8f84-962427519106" (UID: "98a8b324-3760-4023-8f84-962427519106"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:15:54.873531 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.873481    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "98a8b324-3760-4023-8f84-962427519106" (UID: "98a8b324-3760-4023-8f84-962427519106"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:15:54.873776 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.873753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98a8b324-3760-4023-8f84-962427519106" (UID: "98a8b324-3760-4023-8f84-962427519106"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:15:54.873870 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.873851    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a8b324-3760-4023-8f84-962427519106-kube-api-access-2w8m7" (OuterVolumeSpecName: "kube-api-access-2w8m7") pod "98a8b324-3760-4023-8f84-962427519106" (UID: "98a8b324-3760-4023-8f84-962427519106"). InnerVolumeSpecName "kube-api-access-2w8m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:15:54.972287 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.972247    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w8m7\" (UniqueName: \"kubernetes.io/projected/98a8b324-3760-4023-8f84-962427519106-kube-api-access-2w8m7\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:15:54.972287 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.972278    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a8b324-3760-4023-8f84-962427519106-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:15:54.972287 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.972293    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:15:54.972539 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:54.972304    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a8b324-3760-4023-8f84-962427519106-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:15:55.161455 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:55.161415    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"]
Sep 18 20:15:55.165480 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:55.165450    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-57b6ce-bbf8769d6-297cb"]
Sep 18 20:15:56.441270 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:15:56.441237    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98a8b324-3760-4023-8f84-962427519106" path="/var/lib/kubelet/pods/98a8b324-3760-4023-8f84-962427519106/volumes"
Sep 18 20:16:01.430036 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:01.430003    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"]
Sep 18 20:16:01.430483 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:01.430245    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy" containerID="cri-o://11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92" gracePeriod=30
Sep 18 20:16:06.682104 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.682079    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:16:06.686243 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47g5x\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-kube-api-access-47g5x\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686352 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-credential-socket\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686352 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686289    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf344a0-a494-486b-8ee4-24b395f64024-istiod-ca-cert\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686352 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-certs\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686352 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686336    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-socket\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686554 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-istio-token\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686554 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686432    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-data\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686554 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686476    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-envoy\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.686554 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686496    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:06.686745 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686613    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:06.686745 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:06.686745 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686675    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-data" (OuterVolumeSpecName: "istio-data") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:06.686745 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686702    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf344a0-a494-486b-8ee4-24b395f64024-istio-podinfo\") pod \"caf344a0-a494-486b-8ee4-24b395f64024\" (UID: \"caf344a0-a494-486b-8ee4-24b395f64024\") "
Sep 18 20:16:06.687011 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.686758    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caf344a0-a494-486b-8ee4-24b395f64024-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:16:06.687051 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.687030    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-credential-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.687096 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.687053    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caf344a0-a494-486b-8ee4-24b395f64024-istiod-ca-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.687096 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.687066    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.687096 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.687079    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-workload-socket\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.687096 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.687092    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-data\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.688737 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.688712    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-istio-token" (OuterVolumeSpecName: "istio-token") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:06.688849 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.688789    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/caf344a0-a494-486b-8ee4-24b395f64024-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:16:06.689164 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.689146    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:06.689164 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.689152    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-kube-api-access-47g5x" (OuterVolumeSpecName: "kube-api-access-47g5x") pod "caf344a0-a494-486b-8ee4-24b395f64024" (UID: "caf344a0-a494-486b-8ee4-24b395f64024"). InnerVolumeSpecName "kube-api-access-47g5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:06.788113 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.788087    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caf344a0-a494-486b-8ee4-24b395f64024-istio-envoy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.788113 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.788109    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caf344a0-a494-486b-8ee4-24b395f64024-istio-podinfo\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.788113 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.788118    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47g5x\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-kube-api-access-47g5x\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.788339 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.788127    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caf344a0-a494-486b-8ee4-24b395f64024-istio-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:06.902191 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.902163    2582 generic.go:356] "Generic (PLEG): container finished" podID="caf344a0-a494-486b-8ee4-24b395f64024" containerID="11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92" exitCode=0
Sep 18 20:16:06.902347 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.902214    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"
Sep 18 20:16:06.902347 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.902253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" event={"ID":"caf344a0-a494-486b-8ee4-24b395f64024","Type":"ContainerDied","Data":"11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92"}
Sep 18 20:16:06.902347 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.902305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc" event={"ID":"caf344a0-a494-486b-8ee4-24b395f64024","Type":"ContainerDied","Data":"3d891f2396ad3656765a472bf2151cb24445a0e8b8e45cc4cf04fcf07178a83d"}
Sep 18 20:16:06.902347 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.902326    2582 scope.go:117] "RemoveContainer" containerID="11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92"
Sep 18 20:16:06.911750 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.911739    2582 scope.go:117] "RemoveContainer" containerID="a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"
Sep 18 20:16:06.920023 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.920005    2582 scope.go:117] "RemoveContainer" containerID="11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92"
Sep 18 20:16:06.920285 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:16:06.920267    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92\": container with ID starting with 11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92 not found: ID does not exist" containerID="11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92"
Sep 18 20:16:06.920328 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.920294    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92"} err="failed to get container status \"11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92\": rpc error: code = NotFound desc = could not find container \"11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92\": container with ID starting with 11a39621fb634de655b384a865871f04b1cae40e3c2616fc9fcc44c235a60d92 not found: ID does not exist"
Sep 18 20:16:06.920328 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.920310    2582 scope.go:117] "RemoveContainer" containerID="a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"
Sep 18 20:16:06.920589 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:16:06.920567    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c\": container with ID starting with a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c not found: ID does not exist" containerID="a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"
Sep 18 20:16:06.920680 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.920593    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c"} err="failed to get container status \"a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c\": rpc error: code = NotFound desc = could not find container \"a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c\": container with ID starting with a3dfe74b44141e24028cd3ffcdbacf2d68412d0125aad0621cae562c7688383c not found: ID does not exist"
Sep 18 20:16:06.924512 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.924492    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"]
Sep 18 20:16:06.930727 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:06.930707    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc"]
Sep 18 20:16:08.440861 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:08.440826    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf344a0-a494-486b-8ee4-24b395f64024" path="/var/lib/kubelet/pods/caf344a0-a494-486b-8ee4-24b395f64024/volumes"
Sep 18 20:16:12.269090 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.269060    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"]
Sep 18 20:16:12.269859 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.269807    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" podUID="a5810105-340c-4d4e-9b64-de171d9bc7ee" containerName="maas-api" containerID="cri-o://1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330" gracePeriod=30
Sep 18 20:16:12.526491 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.526428    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:16:12.639891 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.639860    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls\") pod \"a5810105-340c-4d4e-9b64-de171d9bc7ee\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") "
Sep 18 20:16:12.640099 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.639930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-metrics-certs\") pod \"a5810105-340c-4d4e-9b64-de171d9bc7ee\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") "
Sep 18 20:16:12.640099 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.639975    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxx4z\" (UniqueName: \"kubernetes.io/projected/a5810105-340c-4d4e-9b64-de171d9bc7ee-kube-api-access-xxx4z\") pod \"a5810105-340c-4d4e-9b64-de171d9bc7ee\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") "
Sep 18 20:16:12.640099 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.640059    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5810105-340c-4d4e-9b64-de171d9bc7ee-openshift-service-ca\") pod \"a5810105-340c-4d4e-9b64-de171d9bc7ee\" (UID: \"a5810105-340c-4d4e-9b64-de171d9bc7ee\") "
Sep 18 20:16:12.640463 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.640433    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5810105-340c-4d4e-9b64-de171d9bc7ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5810105-340c-4d4e-9b64-de171d9bc7ee" (UID: "a5810105-340c-4d4e-9b64-de171d9bc7ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:16:12.642330 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.642295    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5810105-340c-4d4e-9b64-de171d9bc7ee" (UID: "a5810105-340c-4d4e-9b64-de171d9bc7ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:16:12.642330 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.642316    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5810105-340c-4d4e-9b64-de171d9bc7ee" (UID: "a5810105-340c-4d4e-9b64-de171d9bc7ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:16:12.642767 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.642747    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5810105-340c-4d4e-9b64-de171d9bc7ee-kube-api-access-xxx4z" (OuterVolumeSpecName: "kube-api-access-xxx4z") pod "a5810105-340c-4d4e-9b64-de171d9bc7ee" (UID: "a5810105-340c-4d4e-9b64-de171d9bc7ee"). InnerVolumeSpecName "kube-api-access-xxx4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:12.741197 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.741164    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:12.741197 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.741192    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5810105-340c-4d4e-9b64-de171d9bc7ee-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:12.741197 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.741201    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxx4z\" (UniqueName: \"kubernetes.io/projected/a5810105-340c-4d4e-9b64-de171d9bc7ee-kube-api-access-xxx4z\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:12.741416 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.741212    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5810105-340c-4d4e-9b64-de171d9bc7ee-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:12.936142 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.936110    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5810105-340c-4d4e-9b64-de171d9bc7ee" containerID="1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330" exitCode=0
Sep 18 20:16:12.936331 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.936162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" event={"ID":"a5810105-340c-4d4e-9b64-de171d9bc7ee","Type":"ContainerDied","Data":"1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330"}
Sep 18 20:16:12.936331 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.936164    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"
Sep 18 20:16:12.936331 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.936203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98" event={"ID":"a5810105-340c-4d4e-9b64-de171d9bc7ee","Type":"ContainerDied","Data":"84829ba27b463c6b852cc3e8972cbdf8c12535cafd0b98683b4ff5024f4e0a64"}
Sep 18 20:16:12.936331 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.936223    2582 scope.go:117] "RemoveContainer" containerID="1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330"
Sep 18 20:16:12.946568 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.946548    2582 scope.go:117] "RemoveContainer" containerID="1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330"
Sep 18 20:16:12.946922 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:16:12.946898    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330\": container with ID starting with 1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330 not found: ID does not exist" containerID="1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330"
Sep 18 20:16:12.947004 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.946933    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330"} err="failed to get container status \"1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330\": rpc error: code = NotFound desc = could not find container \"1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330\": container with ID starting with 1b7eca985110ed2b05f0a478ef43b83702eb61e178c096487907709315743330 not found: ID does not exist"
Sep 18 20:16:12.960172 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.960145    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"]
Sep 18 20:16:12.962424 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:12.962405    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-5547b6-5f9bc99b88-k9j98"]
Sep 18 20:16:14.441593 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:14.441559    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5810105-340c-4d4e-9b64-de171d9bc7ee" path="/var/lib/kubelet/pods/a5810105-340c-4d4e-9b64-de171d9bc7ee/volumes"
Sep 18 20:16:22.722234 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:22.722197    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5746666cfc-p2ntv"]
Sep 18 20:16:22.722651 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:22.722407    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5746666cfc-p2ntv" podUID="80f64b4c-2b32-42ca-9784-7a74da6cace4" containerName="manager" containerID="cri-o://aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8" gracePeriod=30
Sep 18 20:16:22.965911 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:22.965868    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 20:16:23.000345 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.000259    2582 generic.go:356] "Generic (PLEG): container finished" podID="80f64b4c-2b32-42ca-9784-7a74da6cace4" containerID="aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8" exitCode=0
Sep 18 20:16:23.000345 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.000324    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-p2ntv"
Sep 18 20:16:23.000562 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.000345    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-p2ntv" event={"ID":"80f64b4c-2b32-42ca-9784-7a74da6cace4","Type":"ContainerDied","Data":"aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8"}
Sep 18 20:16:23.000562 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.000425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-p2ntv" event={"ID":"80f64b4c-2b32-42ca-9784-7a74da6cace4","Type":"ContainerDied","Data":"2c9089aa792ccfb866c625982f20face5ac1711cedca70e78924a2f0cf5e2dd3"}
Sep 18 20:16:23.000562 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.000457    2582 scope.go:117] "RemoveContainer" containerID="aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8"
Sep 18 20:16:23.011942 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.011853    2582 scope.go:117] "RemoveContainer" containerID="aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8"
Sep 18 20:16:23.012358 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:16:23.012334    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8\": container with ID starting with aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8 not found: ID does not exist" containerID="aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8"
Sep 18 20:16:23.012462 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.012363    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8"} err="failed to get container status \"aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8\": rpc error: code = NotFound desc = could not find container \"aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8\": container with ID starting with aae52a2bc8b83fea5635d6fe6f449d4bf514b14d676a2a1337ec85beb0301cc8 not found: ID does not exist"
Sep 18 20:16:23.033669 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.033646    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-metrics-certs\") pod \"80f64b4c-2b32-42ca-9784-7a74da6cace4\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") "
Sep 18 20:16:23.033815 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.033799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-webhook-cert\") pod \"80f64b4c-2b32-42ca-9784-7a74da6cace4\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") "
Sep 18 20:16:23.033904 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.033843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxdvt\" (UniqueName: \"kubernetes.io/projected/80f64b4c-2b32-42ca-9784-7a74da6cace4-kube-api-access-qxdvt\") pod \"80f64b4c-2b32-42ca-9784-7a74da6cace4\" (UID: \"80f64b4c-2b32-42ca-9784-7a74da6cace4\") "
Sep 18 20:16:23.035774 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.035753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "80f64b4c-2b32-42ca-9784-7a74da6cace4" (UID: "80f64b4c-2b32-42ca-9784-7a74da6cace4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:16:23.036098 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.036071    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f64b4c-2b32-42ca-9784-7a74da6cace4-kube-api-access-qxdvt" (OuterVolumeSpecName: "kube-api-access-qxdvt") pod "80f64b4c-2b32-42ca-9784-7a74da6cace4" (UID: "80f64b4c-2b32-42ca-9784-7a74da6cace4"). InnerVolumeSpecName "kube-api-access-qxdvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:23.036184 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.036139    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "80f64b4c-2b32-42ca-9784-7a74da6cace4" (UID: "80f64b4c-2b32-42ca-9784-7a74da6cace4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:16:23.134851 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.134818    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-webhook-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:23.134851 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.134844    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxdvt\" (UniqueName: \"kubernetes.io/projected/80f64b4c-2b32-42ca-9784-7a74da6cace4-kube-api-access-qxdvt\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:23.134851 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.134853    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80f64b4c-2b32-42ca-9784-7a74da6cace4-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:16:23.325956 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.325926    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5746666cfc-p2ntv"]
Sep 18 20:16:23.330413 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:23.330388    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5746666cfc-p2ntv"]
Sep 18 20:16:23.342754 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:16:23.342726    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f64b4c_2b32_42ca_9784_7a74da6cace4.slice/crio-2c9089aa792ccfb866c625982f20face5ac1711cedca70e78924a2f0cf5e2dd3\": RecentStats: unable to find data in memory cache]"
Sep 18 20:16:24.441302 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:16:24.441268    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f64b4c-2b32-42ca-9784-7a74da6cace4" path="/var/lib/kubelet/pods/80f64b4c-2b32-42ca-9784-7a74da6cace4/volumes"
Sep 18 20:17:24.125112 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125078    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5746666cfc-r6qpz"]
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125467    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20bdc23f-b66b-4a39-acfc-154c2dbabc04" containerName="maas-api"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125478    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="20bdc23f-b66b-4a39-acfc-154c2dbabc04" containerName="maas-api"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125490    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125496    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125506    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125511    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125519    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f64b4c-2b32-42ca-9784-7a74da6cace4" containerName="manager"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125524    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f64b4c-2b32-42ca-9784-7a74da6cace4" containerName="manager"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125529    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5810105-340c-4d4e-9b64-de171d9bc7ee" containerName="maas-api"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125535    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5810105-340c-4d4e-9b64-de171d9bc7ee" containerName="maas-api"
Sep 18 20:17:24.125536 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125540    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="887c2349-6241-4a69-89eb-58d38984fc77" containerName="main"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125545    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="887c2349-6241-4a69-89eb-58d38984fc77" containerName="main"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125552    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125557    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125567    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a8b324-3760-4023-8f84-962427519106" containerName="maas-api"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125572    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a8b324-3760-4023-8f84-962427519106" containerName="maas-api"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125627    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125635    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125641    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125648    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="887c2349-6241-4a69-89eb-58d38984fc77" containerName="main"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125654    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5810105-340c-4d4e-9b64-de171d9bc7ee" containerName="maas-api"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125660    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f64b4c-2b32-42ca-9784-7a74da6cace4" containerName="manager"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125665    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a8b324-3760-4023-8f84-962427519106" containerName="maas-api"
Sep 18 20:17:24.125909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.125670    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="20bdc23f-b66b-4a39-acfc-154c2dbabc04" containerName="maas-api"
Sep 18 20:17:24.128931 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.128911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.132852 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.132824    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 20:17:24.132991 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.132857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-64hrz\""
Sep 18 20:17:24.132991 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.132866    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 20:17:24.132991 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.132891    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 20:17:24.140928 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.140907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5746666cfc-r6qpz"]
Sep 18 20:17:24.301934 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.301899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-metrics-certs\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.302114 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.302015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qww\" (UniqueName: \"kubernetes.io/projected/1b610f87-e0c5-4611-b877-5d7583a0f321-kube-api-access-r7qww\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.302114 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.302041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-webhook-cert\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.402855 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.402780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qww\" (UniqueName: \"kubernetes.io/projected/1b610f87-e0c5-4611-b877-5d7583a0f321-kube-api-access-r7qww\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.402855 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.402817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-webhook-cert\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.402855 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.402839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-metrics-certs\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.405441 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.405412    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-metrics-certs\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.405441 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.405439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-webhook-cert\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.411271 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.411249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qww\" (UniqueName: \"kubernetes.io/projected/1b610f87-e0c5-4611-b877-5d7583a0f321-kube-api-access-r7qww\") pod \"maas-controller-5746666cfc-r6qpz\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") " pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.439113 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.439080    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:24.713449 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:24.713422    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5746666cfc-r6qpz"]
Sep 18 20:17:24.715121 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:17:24.715093    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b610f87_e0c5_4611_b877_5d7583a0f321.slice/crio-d84cdd03f1327e91fada791e44e342fbd85f89540dec33c35dbcb12b5e8b9197 WatchSource:0}: Error finding container d84cdd03f1327e91fada791e44e342fbd85f89540dec33c35dbcb12b5e8b9197: Status 404 returned error can't find the container with id d84cdd03f1327e91fada791e44e342fbd85f89540dec33c35dbcb12b5e8b9197
Sep 18 20:17:25.317369 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:25.317334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-r6qpz" event={"ID":"1b610f87-e0c5-4611-b877-5d7583a0f321","Type":"ContainerStarted","Data":"22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6"}
Sep 18 20:17:25.317814 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:25.317395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-r6qpz" event={"ID":"1b610f87-e0c5-4611-b877-5d7583a0f321","Type":"ContainerStarted","Data":"d84cdd03f1327e91fada791e44e342fbd85f89540dec33c35dbcb12b5e8b9197"}
Sep 18 20:17:25.317814 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:25.317451    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:25.338154 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:25.338105    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5746666cfc-r6qpz" podStartSLOduration=0.834506101 podStartE2EDuration="1.33809112s" totalImagesPullingTime="503.585019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:17:25.336339771 +0000 UTC m=+2281.095147758" watchObservedRunningTime="2026-09-18 20:17:25.33809112 +0000 UTC m=+2281.096899105"
Sep 18 20:17:36.325017 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:36.324984    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:47.813576 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:47.813540    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5746666cfc-r6qpz"]
Sep 18 20:17:47.814454 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:47.814117    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5746666cfc-r6qpz" podUID="1b610f87-e0c5-4611-b877-5d7583a0f321" containerName="manager" containerID="cri-o://22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6" gracePeriod=30
Sep 18 20:17:48.071248 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.071162    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:48.119425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.119393    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-metrics-certs\") pod \"1b610f87-e0c5-4611-b877-5d7583a0f321\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") "
Sep 18 20:17:48.119425 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.119435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-webhook-cert\") pod \"1b610f87-e0c5-4611-b877-5d7583a0f321\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") "
Sep 18 20:17:48.119714 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.119484    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7qww\" (UniqueName: \"kubernetes.io/projected/1b610f87-e0c5-4611-b877-5d7583a0f321-kube-api-access-r7qww\") pod \"1b610f87-e0c5-4611-b877-5d7583a0f321\" (UID: \"1b610f87-e0c5-4611-b877-5d7583a0f321\") "
Sep 18 20:17:48.123381 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.123326    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1b610f87-e0c5-4611-b877-5d7583a0f321" (UID: "1b610f87-e0c5-4611-b877-5d7583a0f321"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:17:48.124139 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.124031    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b610f87-e0c5-4611-b877-5d7583a0f321-kube-api-access-r7qww" (OuterVolumeSpecName: "kube-api-access-r7qww") pod "1b610f87-e0c5-4611-b877-5d7583a0f321" (UID: "1b610f87-e0c5-4611-b877-5d7583a0f321"). InnerVolumeSpecName "kube-api-access-r7qww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:17:48.124139 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.124114    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1b610f87-e0c5-4611-b877-5d7583a0f321" (UID: "1b610f87-e0c5-4611-b877-5d7583a0f321"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:17:48.221215 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.221182    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-webhook-cert\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:17:48.221215 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.221212    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7qww\" (UniqueName: \"kubernetes.io/projected/1b610f87-e0c5-4611-b877-5d7583a0f321-kube-api-access-r7qww\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:17:48.221215 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.221221    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b610f87-e0c5-4611-b877-5d7583a0f321-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:17:48.439978 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.439945    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b610f87-e0c5-4611-b877-5d7583a0f321" containerID="22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6" exitCode=0
Sep 18 20:17:48.440159 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.440069    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-r6qpz"
Sep 18 20:17:48.441845 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.441823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-r6qpz" event={"ID":"1b610f87-e0c5-4611-b877-5d7583a0f321","Type":"ContainerDied","Data":"22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6"}
Sep 18 20:17:48.441967 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.441861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-r6qpz" event={"ID":"1b610f87-e0c5-4611-b877-5d7583a0f321","Type":"ContainerDied","Data":"d84cdd03f1327e91fada791e44e342fbd85f89540dec33c35dbcb12b5e8b9197"}
Sep 18 20:17:48.441967 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.441900    2582 scope.go:117] "RemoveContainer" containerID="22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6"
Sep 18 20:17:48.451591 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.451569    2582 scope.go:117] "RemoveContainer" containerID="22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6"
Sep 18 20:17:48.451862 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:17:48.451842    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6\": container with ID starting with 22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6 not found: ID does not exist" containerID="22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6"
Sep 18 20:17:48.451953 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.451893    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6"} err="failed to get container status \"22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6\": rpc error: code = NotFound desc = could not find container \"22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6\": container with ID starting with 22c0a27e4d249c2e2f56a234d6aaaa2d830cddb8ee4f503830337e0a98157bf6 not found: ID does not exist"
Sep 18 20:17:48.464335 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.464305    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5746666cfc-r6qpz"]
Sep 18 20:17:48.468341 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:48.468322    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5746666cfc-r6qpz"]
Sep 18 20:17:49.257534 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.257506    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5746666cfc-zb6vj"]
Sep 18 20:17:49.257944 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.257931    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy"
Sep 18 20:17:49.257944 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.257944    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="18955e46-77a7-424b-989b-3baaf996b213" containerName="istio-proxy"
Sep 18 20:17:49.258033 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.257955    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b610f87-e0c5-4611-b877-5d7583a0f321" containerName="manager"
Sep 18 20:17:49.258033 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.257960    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b610f87-e0c5-4611-b877-5d7583a0f321" containerName="manager"
Sep 18 20:17:49.258033 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.258023    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b610f87-e0c5-4611-b877-5d7583a0f321" containerName="manager"
Sep 18 20:17:49.258126 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.258034    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf344a0-a494-486b-8ee4-24b395f64024" containerName="istio-proxy"
Sep 18 20:17:49.262706 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.262687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.265390 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.265370    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-64hrz\""
Sep 18 20:17:49.265492 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.265386    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 20:17:49.266523 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.266496    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 20:17:49.266608 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.266533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 20:17:49.270614 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.270591    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5746666cfc-zb6vj"]
Sep 18 20:17:49.329952 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.329923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75f78e10-390c-4152-90f3-a7b6ca2fc68c-webhook-cert\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.330105 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.329956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2hv8\" (UniqueName: \"kubernetes.io/projected/75f78e10-390c-4152-90f3-a7b6ca2fc68c-kube-api-access-l2hv8\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.330105 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.330055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75f78e10-390c-4152-90f3-a7b6ca2fc68c-metrics-certs\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.431232 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.431198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75f78e10-390c-4152-90f3-a7b6ca2fc68c-metrics-certs\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.431390 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.431297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75f78e10-390c-4152-90f3-a7b6ca2fc68c-webhook-cert\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.431390 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.431327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2hv8\" (UniqueName: \"kubernetes.io/projected/75f78e10-390c-4152-90f3-a7b6ca2fc68c-kube-api-access-l2hv8\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.434035 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.434012    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75f78e10-390c-4152-90f3-a7b6ca2fc68c-metrics-certs\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.434136 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.434057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75f78e10-390c-4152-90f3-a7b6ca2fc68c-webhook-cert\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.439280 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.439261    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2hv8\" (UniqueName: \"kubernetes.io/projected/75f78e10-390c-4152-90f3-a7b6ca2fc68c-kube-api-access-l2hv8\") pod \"maas-controller-5746666cfc-zb6vj\" (UID: \"75f78e10-390c-4152-90f3-a7b6ca2fc68c\") " pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.574263 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.574190    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:49.849774 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:49.849747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5746666cfc-zb6vj"]
Sep 18 20:17:49.851379 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:17:49.851341    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f78e10_390c_4152_90f3_a7b6ca2fc68c.slice/crio-dd1f0ffe876d6a7c1e26612aba919ca4228493417e9c7ecd966f93590a9b709a WatchSource:0}: Error finding container dd1f0ffe876d6a7c1e26612aba919ca4228493417e9c7ecd966f93590a9b709a: Status 404 returned error can't find the container with id dd1f0ffe876d6a7c1e26612aba919ca4228493417e9c7ecd966f93590a9b709a
Sep 18 20:17:50.448177 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:50.448137    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b610f87-e0c5-4611-b877-5d7583a0f321" path="/var/lib/kubelet/pods/1b610f87-e0c5-4611-b877-5d7583a0f321/volumes"
Sep 18 20:17:50.453761 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:50.453697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-zb6vj" event={"ID":"75f78e10-390c-4152-90f3-a7b6ca2fc68c","Type":"ContainerStarted","Data":"cbb8babf916a4327eb292c0ab7eaaa9a73f9bc494b245fe730bd52fb0e69f06d"}
Sep 18 20:17:50.453761 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:50.453748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5746666cfc-zb6vj" event={"ID":"75f78e10-390c-4152-90f3-a7b6ca2fc68c","Type":"ContainerStarted","Data":"dd1f0ffe876d6a7c1e26612aba919ca4228493417e9c7ecd966f93590a9b709a"}
Sep 18 20:17:50.453948 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:50.453864    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:17:50.471211 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:17:50.471166    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5746666cfc-zb6vj" podStartSLOduration=1.122680775 podStartE2EDuration="1.471151826s" totalImagesPullingTime="348.471051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:17:50.470523113 +0000 UTC m=+2306.229331113" watchObservedRunningTime="2026-09-18 20:17:50.471151826 +0000 UTC m=+2306.229959811"
Sep 18 20:18:01.461584 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:18:01.461553    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5746666cfc-zb6vj"
Sep 18 20:19:06.871824 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:06.871792    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"]
Sep 18 20:19:06.874504 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:06.872027    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager" containerID="cri-o://b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501" gracePeriod=10
Sep 18 20:19:09.429109 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.429083    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 20:19:09.480121 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.480051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb2mr\" (UniqueName: \"kubernetes.io/projected/4fb621e7-0df2-4354-a7fd-3b58417ee48e-kube-api-access-xb2mr\") pod \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") "
Sep 18 20:19:09.480121 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.480092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb621e7-0df2-4354-a7fd-3b58417ee48e-extensions-socket-volume\") pod \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\" (UID: \"4fb621e7-0df2-4354-a7fd-3b58417ee48e\") "
Sep 18 20:19:09.480747 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.480670    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb621e7-0df2-4354-a7fd-3b58417ee48e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fb621e7-0df2-4354-a7fd-3b58417ee48e" (UID: "4fb621e7-0df2-4354-a7fd-3b58417ee48e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:19:09.482271 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.482242    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb621e7-0df2-4354-a7fd-3b58417ee48e-kube-api-access-xb2mr" (OuterVolumeSpecName: "kube-api-access-xb2mr") pod "4fb621e7-0df2-4354-a7fd-3b58417ee48e" (UID: "4fb621e7-0df2-4354-a7fd-3b58417ee48e"). InnerVolumeSpecName "kube-api-access-xb2mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:19:09.581302 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.581271    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb2mr\" (UniqueName: \"kubernetes.io/projected/4fb621e7-0df2-4354-a7fd-3b58417ee48e-kube-api-access-xb2mr\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:19:09.581302 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.581294    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fb621e7-0df2-4354-a7fd-3b58417ee48e-extensions-socket-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:19:09.864402 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.864307    2582 generic.go:356] "Generic (PLEG): container finished" podID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerID="b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501" exitCode=0
Sep 18 20:19:09.864402 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.864352    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"
Sep 18 20:19:09.864648 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.864400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" event={"ID":"4fb621e7-0df2-4354-a7fd-3b58417ee48e","Type":"ContainerDied","Data":"b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501"}
Sep 18 20:19:09.864648 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.864458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k" event={"ID":"4fb621e7-0df2-4354-a7fd-3b58417ee48e","Type":"ContainerDied","Data":"c6544938d2b4d8dc7bde54f9f74b58a46afec78cfe7b8105325ef623d0347b24"}
Sep 18 20:19:09.864648 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.864486    2582 scope.go:117] "RemoveContainer" containerID="b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501"
Sep 18 20:19:09.874012 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.873995    2582 scope.go:117] "RemoveContainer" containerID="f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"
Sep 18 20:19:09.882748 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.882727    2582 scope.go:117] "RemoveContainer" containerID="b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501"
Sep 18 20:19:09.883070 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:19:09.883044    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501\": container with ID starting with b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501 not found: ID does not exist" containerID="b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501"
Sep 18 20:19:09.883189 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.883077    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501"} err="failed to get container status \"b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501\": rpc error: code = NotFound desc = could not find container \"b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501\": container with ID starting with b763b840e2f7b7dc7f28cc137a67f52033f74eec9b1e90b6cba3bda63f4f0501 not found: ID does not exist"
Sep 18 20:19:09.883189 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.883094    2582 scope.go:117] "RemoveContainer" containerID="f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"
Sep 18 20:19:09.883334 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:19:09.883317    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080\": container with ID starting with f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080 not found: ID does not exist" containerID="f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"
Sep 18 20:19:09.883374 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.883340    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080"} err="failed to get container status \"f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080\": rpc error: code = NotFound desc = could not find container \"f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080\": container with ID starting with f7efd55cd5ca1e7b41da0f778135ba73a7cce14e5d5575e861cf2869f4ce3080 not found: ID does not exist"
Sep 18 20:19:09.886690 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.886668    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"]
Sep 18 20:19:09.890349 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:09.890327    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mwv2k"]
Sep 18 20:19:10.441931 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:10.441867    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" path="/var/lib/kubelet/pods/4fb621e7-0df2-4354-a7fd-3b58417ee48e/volumes"
Sep 18 20:19:26.610317 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:26.610286    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:19:26.615035 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:26.615014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:19:26.618618 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:26.618600    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:19:26.622859 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:19:26.622843    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2d5t_a285377b-0634-4f43-8294-520305cbd4e4/ovn-acl-logging/0.log"
Sep 18 20:20:07.575490 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.575444    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"]
Sep 18 20:20:07.576031 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.575839    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager"
Sep 18 20:20:07.576031 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.575850    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager"
Sep 18 20:20:07.576031 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.575948    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager"
Sep 18 20:20:07.576031 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.575958    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager"
Sep 18 20:20:07.579106 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.579089    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.581919 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.581868    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2wh2f\""
Sep 18 20:20:07.590069 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.590044    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"]
Sep 18 20:20:07.715283 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.715241    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/931a729e-f4a6-4bf3-90cb-8c996def0446-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fkmqp\" (UID: \"931a729e-f4a6-4bf3-90cb-8c996def0446\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.715283 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.715289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc8d7\" (UniqueName: \"kubernetes.io/projected/931a729e-f4a6-4bf3-90cb-8c996def0446-kube-api-access-nc8d7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fkmqp\" (UID: \"931a729e-f4a6-4bf3-90cb-8c996def0446\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.816807 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.816762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/931a729e-f4a6-4bf3-90cb-8c996def0446-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fkmqp\" (UID: \"931a729e-f4a6-4bf3-90cb-8c996def0446\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.816807 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.816812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc8d7\" (UniqueName: \"kubernetes.io/projected/931a729e-f4a6-4bf3-90cb-8c996def0446-kube-api-access-nc8d7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fkmqp\" (UID: \"931a729e-f4a6-4bf3-90cb-8c996def0446\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.817269 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.817246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/931a729e-f4a6-4bf3-90cb-8c996def0446-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fkmqp\" (UID: \"931a729e-f4a6-4bf3-90cb-8c996def0446\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.825914 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.825833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc8d7\" (UniqueName: \"kubernetes.io/projected/931a729e-f4a6-4bf3-90cb-8c996def0446-kube-api-access-nc8d7\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fkmqp\" (UID: \"931a729e-f4a6-4bf3-90cb-8c996def0446\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:07.889928 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:07.889866    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:08.173860 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:08.173839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"]
Sep 18 20:20:08.175989 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:20:08.175959    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931a729e_f4a6_4bf3_90cb_8c996def0446.slice/crio-a771173d6213bcc0e3853246cffcd0aba4a6a27ebb00017a8df489af811eb0f3 WatchSource:0}: Error finding container a771173d6213bcc0e3853246cffcd0aba4a6a27ebb00017a8df489af811eb0f3: Status 404 returned error can't find the container with id a771173d6213bcc0e3853246cffcd0aba4a6a27ebb00017a8df489af811eb0f3
Sep 18 20:20:09.165869 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:09.165830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp" event={"ID":"931a729e-f4a6-4bf3-90cb-8c996def0446","Type":"ContainerStarted","Data":"1c42d5725f6fe0c0ff05407181867eecf80fb5a4857de46f9c28e6702635f0a3"}
Sep 18 20:20:09.166306 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:09.165913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp" event={"ID":"931a729e-f4a6-4bf3-90cb-8c996def0446","Type":"ContainerStarted","Data":"a771173d6213bcc0e3853246cffcd0aba4a6a27ebb00017a8df489af811eb0f3"}
Sep 18 20:20:09.166306 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:09.165985    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:20:09.189615 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:09.189565    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp" podStartSLOduration=2.189547532 podStartE2EDuration="2.189547532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:09.18577277 +0000 UTC m=+2444.944580756" watchObservedRunningTime="2026-09-18 20:20:09.189547532 +0000 UTC m=+2444.948355576"
Sep 18 20:20:20.174005 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:20:20.173974    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fkmqp"
Sep 18 20:21:37.106804 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.106771    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"]
Sep 18 20:21:37.107372 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.107168    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager"
Sep 18 20:21:37.107372 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.107178    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb621e7-0df2-4354-a7fd-3b58417ee48e" containerName="manager"
Sep 18 20:21:37.109840 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.109818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.122634 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.122603    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"]
Sep 18 20:21:37.264775 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.264735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xgqh\" (UniqueName: \"kubernetes.io/projected/978701aa-dfb0-4a39-be83-6f3e8ac43b26-kube-api-access-2xgqh\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.265001 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.264853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/978701aa-dfb0-4a39-be83-6f3e8ac43b26-openshift-service-ca\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.265001 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.264912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/978701aa-dfb0-4a39-be83-6f3e8ac43b26-metrics-certs\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.265001 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.264940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/978701aa-dfb0-4a39-be83-6f3e8ac43b26-maas-api-tls\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.365978 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.365868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/978701aa-dfb0-4a39-be83-6f3e8ac43b26-metrics-certs\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.365978 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.365961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/978701aa-dfb0-4a39-be83-6f3e8ac43b26-maas-api-tls\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.366221 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.366017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xgqh\" (UniqueName: \"kubernetes.io/projected/978701aa-dfb0-4a39-be83-6f3e8ac43b26-kube-api-access-2xgqh\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.366221 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.366150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/978701aa-dfb0-4a39-be83-6f3e8ac43b26-openshift-service-ca\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.366824 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.366782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/978701aa-dfb0-4a39-be83-6f3e8ac43b26-openshift-service-ca\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.368701 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.368680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/978701aa-dfb0-4a39-be83-6f3e8ac43b26-maas-api-tls\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.368792 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.368679    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/978701aa-dfb0-4a39-be83-6f3e8ac43b26-metrics-certs\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.374007 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.373988    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xgqh\" (UniqueName: \"kubernetes.io/projected/978701aa-dfb0-4a39-be83-6f3e8ac43b26-kube-api-access-2xgqh\") pod \"maas-api-7f7bf4cfb5-mfftv\" (UID: \"978701aa-dfb0-4a39-be83-6f3e8ac43b26\") " pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.423776 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.423746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:37.699478 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.699448    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"]
Sep 18 20:21:37.701323 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:21:37.701294    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978701aa_dfb0_4a39_be83_6f3e8ac43b26.slice/crio-4a9f8c10a618ee82a4d9295b40ad93f3d5cc084efe69d37394f0f02e1df9a23d WatchSource:0}: Error finding container 4a9f8c10a618ee82a4d9295b40ad93f3d5cc084efe69d37394f0f02e1df9a23d: Status 404 returned error can't find the container with id 4a9f8c10a618ee82a4d9295b40ad93f3d5cc084efe69d37394f0f02e1df9a23d
Sep 18 20:21:37.702665 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:37.702647    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:21:38.643952 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:38.643911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv" event={"ID":"978701aa-dfb0-4a39-be83-6f3e8ac43b26","Type":"ContainerStarted","Data":"3e3fa909b44e5d9203636e323d8cab8daafba3b09f73f1389d44e2e1af81e3ee"}
Sep 18 20:21:38.644337 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:38.643991    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv" event={"ID":"978701aa-dfb0-4a39-be83-6f3e8ac43b26","Type":"ContainerStarted","Data":"4a9f8c10a618ee82a4d9295b40ad93f3d5cc084efe69d37394f0f02e1df9a23d"}
Sep 18 20:21:38.644337 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:38.644104    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:38.679545 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:38.679494    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv" podStartSLOduration=1.249911915 podStartE2EDuration="1.679477552s" totalImagesPullingTime="429.565637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:38.676365451 +0000 UTC m=+2534.435173437" watchObservedRunningTime="2026-09-18 20:21:38.679477552 +0000 UTC m=+2534.438285536"
Sep 18 20:21:44.654407 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:44.654381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f7bf4cfb5-mfftv"
Sep 18 20:21:52.831635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:52.831597    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"]
Sep 18 20:21:52.832257 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:52.831900    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4" podUID="dc9d79fd-92ec-4c18-8b59-621829a2c266" containerName="maas-api" containerID="cri-o://21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043" gracePeriod=30
Sep 18 20:21:54.081103 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.081078    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 20:21:54.122649 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.122617    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-metrics-certs\") pod \"dc9d79fd-92ec-4c18-8b59-621829a2c266\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") "
Sep 18 20:21:54.122828 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.122710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls\") pod \"dc9d79fd-92ec-4c18-8b59-621829a2c266\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") "
Sep 18 20:21:54.122828 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.122781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7dk\" (UniqueName: \"kubernetes.io/projected/dc9d79fd-92ec-4c18-8b59-621829a2c266-kube-api-access-mv7dk\") pod \"dc9d79fd-92ec-4c18-8b59-621829a2c266\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") "
Sep 18 20:21:54.122828 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.122816    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9d79fd-92ec-4c18-8b59-621829a2c266-openshift-service-ca\") pod \"dc9d79fd-92ec-4c18-8b59-621829a2c266\" (UID: \"dc9d79fd-92ec-4c18-8b59-621829a2c266\") "
Sep 18 20:21:54.123558 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.123514    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9d79fd-92ec-4c18-8b59-621829a2c266-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc9d79fd-92ec-4c18-8b59-621829a2c266" (UID: "dc9d79fd-92ec-4c18-8b59-621829a2c266"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:21:54.125079 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.125044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc9d79fd-92ec-4c18-8b59-621829a2c266" (UID: "dc9d79fd-92ec-4c18-8b59-621829a2c266"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:21:54.125223 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.125110    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9d79fd-92ec-4c18-8b59-621829a2c266-kube-api-access-mv7dk" (OuterVolumeSpecName: "kube-api-access-mv7dk") pod "dc9d79fd-92ec-4c18-8b59-621829a2c266" (UID: "dc9d79fd-92ec-4c18-8b59-621829a2c266"). InnerVolumeSpecName "kube-api-access-mv7dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:21:54.125282 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.125248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc9d79fd-92ec-4c18-8b59-621829a2c266" (UID: "dc9d79fd-92ec-4c18-8b59-621829a2c266"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:21:54.223755 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.223727    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7dk\" (UniqueName: \"kubernetes.io/projected/dc9d79fd-92ec-4c18-8b59-621829a2c266-kube-api-access-mv7dk\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:21:54.223755 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.223752    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9d79fd-92ec-4c18-8b59-621829a2c266-openshift-service-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:21:54.223755 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.223762    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-metrics-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:21:54.223999 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.223771    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9d79fd-92ec-4c18-8b59-621829a2c266-maas-api-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\""
Sep 18 20:21:54.727659 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.727576    2582 generic.go:356] "Generic (PLEG): container finished" podID="dc9d79fd-92ec-4c18-8b59-621829a2c266" containerID="21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043" exitCode=0
Sep 18 20:21:54.727659 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.727617    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"
Sep 18 20:21:54.727932 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.727652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4" event={"ID":"dc9d79fd-92ec-4c18-8b59-621829a2c266","Type":"ContainerDied","Data":"21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043"}
Sep 18 20:21:54.727932 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.727715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4" event={"ID":"dc9d79fd-92ec-4c18-8b59-621829a2c266","Type":"ContainerDied","Data":"af7f732d07a13f1638b6cf66f11e0ba4a75a60e25e64517eec73d57791dc34de"}
Sep 18 20:21:54.727932 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.727745    2582 scope.go:117] "RemoveContainer" containerID="21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043"
Sep 18 20:21:54.738833 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.738817    2582 scope.go:117] "RemoveContainer" containerID="21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043"
Sep 18 20:21:54.739118 ip-10-0-143-228 kubenswrapper[2582]: E0918 20:21:54.739097    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043\": container with ID starting with 21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043 not found: ID does not exist" containerID="21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043"
Sep 18 20:21:54.739183 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.739130    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043"} err="failed to get container status \"21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043\": rpc error: code = NotFound desc = could not find container \"21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043\": container with ID starting with 21fd6e1bfaf5287b31ec5855e50498f5bdf5dd728973f96e731b7bd387798043 not found: ID does not exist"
Sep 18 20:21:54.744961 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.744938    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"]
Sep 18 20:21:54.751157 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:54.751137    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f6dd68d9c-5vxh4"]
Sep 18 20:21:56.445904 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:21:56.445846    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9d79fd-92ec-4c18-8b59-621829a2c266" path="/var/lib/kubelet/pods/dc9d79fd-92ec-4c18-8b59-621829a2c266/volumes"
Sep 18 20:22:07.444998 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:07.444971    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79b55fcb65-2lf7j_1bd50238-0f4f-44d4-ba54-422671ba8fe8/authorino/0.log"
Sep 18 20:22:13.127005 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.126972    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pvf8l_e12201f6-6021-432f-aae2-4842e288b7b3/manager/0.log"
Sep 18 20:22:13.250440 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.250413    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k8sbw_b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644/manager/0.log"
Sep 18 20:22:13.376728 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.376704    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5746666cfc-zb6vj_75f78e10-390c-4152-90f3-a7b6ca2fc68c/manager/0.log"
Sep 18 20:22:13.493589 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.493563    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-568sq_182be8c6-b56e-4c45-94b5-192f982457f3/server/0.log"
Sep 18 20:22:13.641106 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.641071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jrczj_06a63c5e-24db-4b1e-a0cb-0960ef8d67ad/manager/0.log"
Sep 18 20:22:13.768827 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.768752    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g_762c4bf4-3f53-4295-89f4-53b14955412b/copy-manifests/0.log"
Sep 18 20:22:13.776253 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:13.776234    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g_762c4bf4-3f53-4295-89f4-53b14955412b/manager/0.log"
Sep 18 20:22:14.543273 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:14.543245    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f7bf4cfb5-mfftv_978701aa-dfb0-4a39-be83-6f3e8ac43b26/maas-api/0.log"
Sep 18 20:22:14.891639 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:14.891562    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dbk4p_23193709-da73-4a41-971a-62f9ce5b5e12/postgres/0.log"
Sep 18 20:22:15.762907 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:15.762861    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79b55fcb65-2lf7j_1bd50238-0f4f-44d4-ba54-422671ba8fe8/authorino/0.log"
Sep 18 20:22:15.884871 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:15.884842    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-8t6h8_7aeee20b-0d44-481c-a743-dc8a7aa25db8/manager/0.log"
Sep 18 20:22:16.003192 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:16.003167    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4wmcc_a7cbbbb0-0856-4998-8b9c-b88a983ec836/manager/0.log"
Sep 18 20:22:16.112688 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:16.112615    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5m79x_5885de6d-72cd-4cea-bf05-3810faff97f6/kuadrant-console-plugin/0.log"
Sep 18 20:22:16.236055 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:16.236033    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fkmqp_931a729e-f4a6-4bf3-90cb-8c996def0446/manager/0.log"
Sep 18 20:22:17.064095 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:17.064054    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc78fcbdb-lmldp_3a9c636c-b884-43c8-bc70-67bbbf0d4dde/kube-auth-proxy/0.log"
Sep 18 20:22:17.292185 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:17.292158    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/1.log"
Sep 18 20:22:17.411049 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:17.410976    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pw62n_ad0e6999-3f1d-46c7-b2be-7bdccf514a51/payload-pre-processing/0.log"
Sep 18 20:22:17.527371 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:17.527341    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-q2vlj_47754a28-350a-46e5-ab22-84d9a12a7800/payload-processing/0.log"
Sep 18 20:22:18.120434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:18.120404    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vcdcw_b5e93412-16c1-4fdf-a5e2-f90fca4ad807/main/0.log"
Sep 18 20:22:18.470190 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:18.470165    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthwlz_e9e6ddf5-2d35-4cfe-9f07-18d891b46679/main/0.log"
Sep 18 20:22:27.446777 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:27.446739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-scwmc_1b511cb1-75c5-4cd0-9641-025f1475680e/global-pull-secret-syncer/0.log"
Sep 18 20:22:27.526265 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:27.526238    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gx8r9_d4d3152a-6fb2-4b4e-ac5a-24ca554ade3c/konnectivity-agent/0.log"
Sep 18 20:22:27.632649 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:27.632623    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-228.ec2.internal_9e70fcf4e6b756809a2612ebd8cc6497/haproxy/0.log"
Sep 18 20:22:32.308486 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:32.308454    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79b55fcb65-2lf7j_1bd50238-0f4f-44d4-ba54-422671ba8fe8/authorino/0.log"
Sep 18 20:22:32.338008 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:32.337979    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-8t6h8_7aeee20b-0d44-481c-a743-dc8a7aa25db8/manager/0.log"
Sep 18 20:22:32.363322 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:32.363302    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4wmcc_a7cbbbb0-0856-4998-8b9c-b88a983ec836/manager/0.log"
Sep 18 20:22:32.390178 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:32.390150    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5m79x_5885de6d-72cd-4cea-bf05-3810faff97f6/kuadrant-console-plugin/0.log"
Sep 18 20:22:32.427407 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:32.427382    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fkmqp_931a729e-f4a6-4bf3-90cb-8c996def0446/manager/0.log"
Sep 18 20:22:33.892810 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:33.892781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/alertmanager/0.log"
Sep 18 20:22:33.918229 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:33.918207    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/config-reloader/0.log"
Sep 18 20:22:33.947559 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:33.947514    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/kube-rbac-proxy-web/0.log"
Sep 18 20:22:33.973846 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:33.973828    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/kube-rbac-proxy/0.log"
Sep 18 20:22:33.997084 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:33.997066    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/kube-rbac-proxy-metric/0.log"
Sep 18 20:22:34.023831 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.023809    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/prom-label-proxy/0.log"
Sep 18 20:22:34.052683 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.052664    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_82c792d9-03fa-485b-82fe-870733fde55d/init-config-reloader/0.log"
Sep 18 20:22:34.240267 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.240238    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-97688cdd6-h96vf_d72b0043-6319-422f-b42b-7cf364a1241e/metrics-server/0.log"
Sep 18 20:22:34.401264 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.401228    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwws5_f1755dba-f099-4830-a1af-c682ecf4931f/node-exporter/0.log"
Sep 18 20:22:34.424159 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.424122    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwws5_f1755dba-f099-4830-a1af-c682ecf4931f/kube-rbac-proxy/0.log"
Sep 18 20:22:34.447078 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.447055    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwws5_f1755dba-f099-4830-a1af-c682ecf4931f/init-textfile/0.log"
Sep 18 20:22:34.925800 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.925778    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5476464f76-72w42_405eeade-944a-4853-a3c2-676b1a545a33/telemeter-client/0.log"
Sep 18 20:22:34.947023 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.946999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5476464f76-72w42_405eeade-944a-4853-a3c2-676b1a545a33/reload/0.log"
Sep 18 20:22:34.969342 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:34.969323    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5476464f76-72w42_405eeade-944a-4853-a3c2-676b1a545a33/kube-rbac-proxy/0.log"
Sep 18 20:22:37.104903 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.104816    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/1.log"
Sep 18 20:22:37.110707 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.110687    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-8kqw5_c4aca0af-2a65-4dfb-ad7e-2108a454584d/console-operator/2.log"
Sep 18 20:22:37.261207 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.261176    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"]
Sep 18 20:22:37.261608 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.261586    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9d79fd-92ec-4c18-8b59-621829a2c266" containerName="maas-api"
Sep 18 20:22:37.261608 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.261602    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9d79fd-92ec-4c18-8b59-621829a2c266" containerName="maas-api"
Sep 18 20:22:37.261767 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.261685    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9d79fd-92ec-4c18-8b59-621829a2c266" containerName="maas-api"
Sep 18 20:22:37.266384 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.266365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.268805 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.268781    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts5cd\"/\"kube-root-ca.crt\""
Sep 18 20:22:37.268942 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.268782    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts5cd\"/\"openshift-service-ca.crt\""
Sep 18 20:22:37.269974 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.269958    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ts5cd\"/\"default-dockercfg-4nfxp\""
Sep 18 20:22:37.274974 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.274953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"]
Sep 18 20:22:37.419563 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.419473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-podres\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.419563 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.419516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgfl\" (UniqueName: \"kubernetes.io/projected/aa5797a1-7f41-4f70-840b-1376c3a872fe-kube-api-access-tzgfl\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.419744 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.419589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-lib-modules\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.419744 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.419644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-proc\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.419744 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.419698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-sys\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520431 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-sys\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520431 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-podres\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgfl\" (UniqueName: \"kubernetes.io/projected/aa5797a1-7f41-4f70-840b-1376c3a872fe-kube-api-access-tzgfl\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-lib-modules\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-sys\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-proc\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-podres\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520635 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-lib-modules\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.520864 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.520638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aa5797a1-7f41-4f70-840b-1376c3a872fe-proc\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.528291 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.528270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgfl\" (UniqueName: \"kubernetes.io/projected/aa5797a1-7f41-4f70-840b-1376c3a872fe-kube-api-access-tzgfl\") pod \"perf-node-gather-daemonset-p2552\" (UID: \"aa5797a1-7f41-4f70-840b-1376c3a872fe\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.577334 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.577308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.688543 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.688516    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b65476695-zgh79_9a485fc1-ee69-4c5d-89ea-ebec3e5e5769/console/0.log"
Sep 18 20:22:37.849045 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.849021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"]
Sep 18 20:22:37.850848 ip-10-0-143-228 kubenswrapper[2582]: W0918 20:22:37.850816    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa5797a1_7f41_4f70_840b_1376c3a872fe.slice/crio-4b4a30aded5ebafb3cd817e23213fff32af3a733c7ac7d6ef1b31bd6b4fb0b48 WatchSource:0}: Error finding container 4b4a30aded5ebafb3cd817e23213fff32af3a733c7ac7d6ef1b31bd6b4fb0b48: Status 404 returned error can't find the container with id 4b4a30aded5ebafb3cd817e23213fff32af3a733c7ac7d6ef1b31bd6b4fb0b48
Sep 18 20:22:37.946909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.946831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552" event={"ID":"aa5797a1-7f41-4f70-840b-1376c3a872fe","Type":"ContainerStarted","Data":"d7729c415a1a3a3ebd18cac9d28387c636afe60f3f682e3889d889c50965bff8"}
Sep 18 20:22:37.946909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.946899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552" event={"ID":"aa5797a1-7f41-4f70-840b-1376c3a872fe","Type":"ContainerStarted","Data":"4b4a30aded5ebafb3cd817e23213fff32af3a733c7ac7d6ef1b31bd6b4fb0b48"}
Sep 18 20:22:37.947070 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.946993    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:37.963563 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:37.963519    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552" podStartSLOduration=0.963507382 podStartE2EDuration="963.507382ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:22:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:22:37.961755542 +0000 UTC m=+2593.720563527" watchObservedRunningTime="2026-09-18 20:22:37.963507382 +0000 UTC m=+2593.722315367"
Sep 18 20:22:39.522909 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:39.522867    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6wrzq_a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865/dns/0.log"
Sep 18 20:22:39.544489 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:39.544464    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6wrzq_a4bb4fc3-34e1-4aef-8c96-2d4f6e8c6865/kube-rbac-proxy/0.log"
Sep 18 20:22:39.679755 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:39.679733    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g9ftl_d83e3e6f-6855-4c8f-8d95-1b6e025179be/dns-node-resolver/0.log"
Sep 18 20:22:40.237110 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:40.237077    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6958b47ccf-sjp2r_3af77a49-175b-4dfe-ac2d-1fb2d32c3655/registry/0.log"
Sep 18 20:22:40.281724 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:40.281693    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m484c_5611f814-7222-4961-8759-3d039e5395eb/node-ca/0.log"
Sep 18 20:22:41.786403 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:41.786373    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc78fcbdb-lmldp_3a9c636c-b884-43c8-bc70-67bbbf0d4dde/kube-auth-proxy/0.log"
Sep 18 20:22:41.833402 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:41.833374    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/0.log"
Sep 18 20:22:41.835931 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:41.835912    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/1.log"
Sep 18 20:22:41.864708 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:41.864671    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pw62n_ad0e6999-3f1d-46c7-b2be-7bdccf514a51/payload-pre-processing/0.log"
Sep 18 20:22:41.896407 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:41.896384    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-q2vlj_47754a28-350a-46e5-ab22-84d9a12a7800/payload-processing/0.log"
Sep 18 20:22:42.867046 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:42.867015    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wxz8r_3b89a9e2-b45c-42d1-87c3-846db555eacf/serve-healthcheck-canary/0.log"
Sep 18 20:22:43.483624 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:43.483600    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvf4g_d09adcf3-af95-4b4b-a109-751b85ce9801/kube-rbac-proxy/0.log"
Sep 18 20:22:43.502659 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:43.502639    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvf4g_d09adcf3-af95-4b4b-a109-751b85ce9801/exporter/0.log"
Sep 18 20:22:43.522086 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:43.522056    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvf4g_d09adcf3-af95-4b4b-a109-751b85ce9801/extractor/0.log"
Sep 18 20:22:43.963854 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:43.963825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-p2552"
Sep 18 20:22:45.630542 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:45.630503    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pvf8l_e12201f6-6021-432f-aae2-4842e288b7b3/manager/0.log"
Sep 18 20:22:45.902311 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:45.902283    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k8sbw_b8e1e2f2-1b52-4b2c-b6fb-b25cdde56644/manager/0.log"
Sep 18 20:22:45.951089 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:45.951053    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5746666cfc-zb6vj_75f78e10-390c-4152-90f3-a7b6ca2fc68c/manager/0.log"
Sep 18 20:22:45.988442 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:45.988414    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-568sq_182be8c6-b56e-4c45-94b5-192f982457f3/server/0.log"
Sep 18 20:22:46.076628 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:46.076593    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jrczj_06a63c5e-24db-4b1e-a0cb-0960ef8d67ad/manager/0.log"
Sep 18 20:22:46.105640 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:46.105614    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g_762c4bf4-3f53-4295-89f4-53b14955412b/manager/0.log"
Sep 18 20:22:46.124754 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:46.124735    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-5qw7g_762c4bf4-3f53-4295-89f4-53b14955412b/copy-manifests/0.log"
Sep 18 20:22:48.853385 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:48.853348    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc78fcbdb-lmldp_3a9c636c-b884-43c8-bc70-67bbbf0d4dde/kube-auth-proxy/0.log"
Sep 18 20:22:48.885404 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:48.885382    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/0.log"
Sep 18 20:22:48.888031 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:48.888009    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/1.log"
Sep 18 20:22:48.909413 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:48.909388    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pw62n_ad0e6999-3f1d-46c7-b2be-7bdccf514a51/payload-pre-processing/0.log"
Sep 18 20:22:48.931638 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:48.931619    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-q2vlj_47754a28-350a-46e5-ab22-84d9a12a7800/payload-processing/0.log"
Sep 18 20:22:51.046074 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:51.046045    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc78fcbdb-lmldp_3a9c636c-b884-43c8-bc70-67bbbf0d4dde/kube-auth-proxy/0.log"
Sep 18 20:22:51.081708 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:51.081686    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/0.log"
Sep 18 20:22:51.086273 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:51.086244    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-lzj5s_e36cb668-95dc-42e7-9682-1adc97a8ba0f/istio-proxy/1.log"
Sep 18 20:22:51.108206 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:51.108178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pw62n_ad0e6999-3f1d-46c7-b2be-7bdccf514a51/payload-pre-processing/0.log"
Sep 18 20:22:51.133434 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:51.133409    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-q2vlj_47754a28-350a-46e5-ab22-84d9a12a7800/payload-processing/0.log"
Sep 18 20:22:54.372436 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.372410    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/kube-multus-additional-cni-plugins/0.log"
Sep 18 20:22:54.394630 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.394598    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/egress-router-binary-copy/0.log"
Sep 18 20:22:54.416231 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.416207    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/cni-plugins/0.log"
Sep 18 20:22:54.438067 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.438045    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/bond-cni-plugin/0.log"
Sep 18 20:22:54.459746 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.459721    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/routeoverride-cni/0.log"
Sep 18 20:22:54.479724 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.479701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/whereabouts-cni-bincopy/0.log"
Sep 18 20:22:54.501934 ip-10-0-143-228 kubenswrapper[2582]: I0918 20:22:54.501907    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87grs_5d0b7ad3-b63a-4bca-b203-376da025850a/whereabouts-cni/0.log"