Sep 09 20:14:31.946031 ip-10-0-143-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 20:14:31.946046 ip-10-0-143-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 20:14:31.946056 ip-10-0-143-224 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 20:14:31.946281 ip-10-0-143-224 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 20:14:43.423499 ip-10-0-143-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 20:14:43.423520 ip-10-0-143-224 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8a5f16742d964abbb58994a0c6a1beee --
Sep 09 20:16:35.647196 ip-10-0-143-224 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 20:16:36.084590 ip-10-0-143-224 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:16:36.084590 ip-10-0-143-224 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 20:16:36.084590 ip-10-0-143-224 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:16:36.084590 ip-10-0-143-224 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 20:16:36.084590 ip-10-0-143-224 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 20:16:36.085678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.085595    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 20:16:36.089923 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089906    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:16:36.089923 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089922    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:16:36.089923 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089938    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:16:36.089923 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089941    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089944    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089949    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089953    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089956    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089960    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089962    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089966    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089969    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089971    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089974    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089976    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089980    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089988    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089990    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.089999    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090003    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090006    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090008    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:16:36.090066 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090011    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090013    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090016    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090019    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090021    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090024    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090028    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090031    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090034    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090037    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090039    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090042    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090045    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090048    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090051    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090054    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090056    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090059    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090061    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090064    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:16:36.090530 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090066    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090069    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090072    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090074    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090077    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090082    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090085    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090088    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090092    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090095    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090097    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090100    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090103    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090105    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090108    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090112    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090115    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090117    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090120    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:16:36.091020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090122    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090125    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090128    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090131    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090133    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090136    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090139    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090142    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090144    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090148    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090150    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090153    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090155    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090158    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090160    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090162    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090165    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090168    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090170    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090173    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:16:36.091482 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090176    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090178    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090181    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090184    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090186    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090189    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090191    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090194    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090197    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090200    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090202    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090204    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090207    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090210    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090212    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090215    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090218    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090220    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090957    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090964    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:16:36.092006 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090967    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090970    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090972    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090976    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090979    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090981    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090984    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090986    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090989    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090991    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090994    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090996    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.090999    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091002    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091004    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091007    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091009    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091012    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091014    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091017    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091020    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:16:36.092489 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091022    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091025    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091028    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091032    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091034    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091037    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091040    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091043    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091045    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091048    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091050    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091053    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091055    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091057    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091060    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091063    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091065    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091068    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091070    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:16:36.093020 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091075    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091079    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091082    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091085    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091088    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091091    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091095    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091098    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091101    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091103    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091106    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091108    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091111    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091114    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091116    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091119    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091122    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091124    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091128    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:16:36.093480 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091131    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091134    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091137    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091140    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091143    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091147    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091150    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091153    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091155    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091158    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091161    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091163    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091166    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091168    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091171    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091173    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091175    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091178    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091180    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:16:36.094005 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091184    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091186    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091189    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091191    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091194    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091196    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091199    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091202    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091204    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091207    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091209    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091212    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091214    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091217    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091219    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091221    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091224    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091226    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091229    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091627    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:16:36.094463 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091632    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091635    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091639    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091642    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091645    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091648    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091650    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091653    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091655    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091658    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091660    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091664    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091667    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091670    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091674    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091677    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091680    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091683    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091686    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:16:36.094953 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091689    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091692    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091695    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091697    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091700    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091702    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091705    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091707    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091710    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091712    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091714    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091717    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091719    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091722    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091724    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091727    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091729    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091732    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091735    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:16:36.095416 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091737    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091740    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091742    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091745    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091747    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091750    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091752    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091754    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091760    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091762    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091765    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091768    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091771    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091774    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091776    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091779    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091781    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091783    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091786    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091788    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:16:36.095901 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091791    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091793    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091796    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091798    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091801    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091803    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091806    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091808    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091811    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091814    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091816    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091819    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091821    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091824    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091826    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091829    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091831    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091833    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091836    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091838    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:16:36.096388 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091842    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091846    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091850    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091854    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091856    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091859    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091861    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091864    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091866    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091869    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091872    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091874    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091876    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091880    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091883    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091886    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091889    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091892    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091894    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.091896    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:16:36.096867 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.091977    2570 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092011    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092018    2570 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092022    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092027    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092030    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092034    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092038    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092042    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092044    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092048    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092052    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092056    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092059    2570 flags.go:64] FLAG: --cgroup-root=""
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092062    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092067    2570 flags.go:64] FLAG: --client-ca-file=""
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092069    2570 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092072    2570 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092078    2570 flags.go:64] FLAG: --cluster-domain=""
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092081    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092084    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092087    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092090    2570 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092094    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 20:16:36.097366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092097    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092100    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092103    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092106    2570 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092109    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092112    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092115    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092118    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092121    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092124    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092127    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092130    2570 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092132    2570 flags.go:64] FLAG: --enable-server="true"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092136    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092140    2570 flags.go:64] FLAG: --event-burst="100"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092143    2570 flags.go:64] FLAG: --event-qps="50"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092146    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092149    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092152    2570 flags.go:64] FLAG: --eviction-hard=""
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092156    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092160    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092163    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092166    2570 flags.go:64] FLAG: --eviction-soft=""
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092170    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092173    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 20:16:36.097958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092176    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092178    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092181    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092184    2570 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092187    2570 flags.go:64] FLAG: --feature-gates=""
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092190    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092193    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092196    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092199    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092202    2570 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092205    2570 flags.go:64] FLAG: --help="false"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092208    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092211    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092214    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092217    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092220    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092223    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092226    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092229    2570 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092232    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092234    2570 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092238    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092241    2570 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092243    2570 flags.go:64] FLAG: --kube-reserved=""
Sep 09 20:16:36.098622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092246    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092249    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092252    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092255    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092258    2570 flags.go:64] FLAG: --lock-file=""
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092261    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092265    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092267    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092273    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092275    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092278    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092281    2570 flags.go:64] FLAG: --logging-format="text"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092283    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092287    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092289    2570 flags.go:64] FLAG: --manifest-url=""
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092292    2570 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092296    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092299    2570 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092303    2570 flags.go:64] FLAG: --max-pods="110"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092306    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092309    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092312    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092315    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092317    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092320    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 20:16:36.099212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092323    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092330    2570 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092333    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092336    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092338    2570 flags.go:64] FLAG: --pod-cidr=""
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092342    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092347    2570 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092350    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092353    2570 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092356    2570 flags.go:64] FLAG: --port="10250"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092360    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092363    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a00c9928758d194"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092366    2570 flags.go:64] FLAG: --qos-reserved=""
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092369    2570 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092373    2570 flags.go:64] FLAG: --register-node="true"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092376    2570 flags.go:64] FLAG: --register-with-taints=""
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092379    2570 flags.go:64] FLAG: --registry-burst="10"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092382    2570 flags.go:64] FLAG: --registry-qps="5"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092385    2570 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092387    2570 flags.go:64] FLAG: --reserved-memory=""
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092391    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092394    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092397    2570 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092400    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092402    2570 flags.go:64] FLAG: --runonce="false"
Sep 09 20:16:36.099811 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092405    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092408    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092411    2570 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092414    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092416    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092419    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092422    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092425    2570 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092427    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092430    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092433    2570 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092435    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092438    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092442    2570 flags.go:64] FLAG: --system-cgroups=""
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092445    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092450    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092452    2570 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092457    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092462    2570 flags.go:64] FLAG: --tls-min-version=""
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092465    2570 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092467    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092471    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092474    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092477    2570 flags.go:64] FLAG: --v="2"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092481    2570 flags.go:64] FLAG: --version="false"
Sep 09 20:16:36.100443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092484    2570 flags.go:64] FLAG: --vmodule=""
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092488    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092491    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092602    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092605    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092609    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092614    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092617    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092620    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092623    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092626    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092628    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092631    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092634    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092637    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092639    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092642    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092645    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092647    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:16:36.101057 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092650    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092652    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092655    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092658    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092661    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092664    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092667    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092669    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092672    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092675    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092678    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092680    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092682    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092685    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092687    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092690    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092692    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092694    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092697    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092699    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:16:36.101518 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092702    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092704    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092706    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092709    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092711    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092715    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092718    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092721    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092725    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092728    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092731    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092734    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092736    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092739    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092741    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092744    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092746    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092751    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092754    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:16:36.102025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092756    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092758    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092761    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092763    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092766    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092768    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092770    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092773    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092775    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092778    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092780    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092783    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092785    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092788    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092790    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092793    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092795    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092798    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092800    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092812    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:16:36.102487 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092815    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092817    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092819    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092822    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092824    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092827    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092829    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092832    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092834    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092837    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092841    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092844    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092846    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092849    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092851    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092854    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092856    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092859    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092861    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092864    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:16:36.103019 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092866    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092869    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092871    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.092874    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.092879    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.099870    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.099885    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.100637    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.100645    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100701    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100706    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100710    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100713    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100715    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100718    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:16:36.103609 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100721    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100723    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100726    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100729    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100731    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100734    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100737    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100739    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100742    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100744    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100749    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100752    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100755    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100758    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100761    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100764    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100767    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100769    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100772    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:16:36.103990 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100775    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100777    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100780    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100782    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100786    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100789    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100791    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100794    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100796    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100799    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100801    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100804    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100807    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100809    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100812    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100814    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100816    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100819    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100821    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100823    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:16:36.104449 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100826    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100829    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100831    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100834    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100836    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100838    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100841    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100843    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100846    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100848    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100864    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100868    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100872    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100874    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100877    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100880    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100883    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100886    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100889    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100892    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:16:36.105003 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100894    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100896    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100899    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100902    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100904    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100906    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100909    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100912    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100914    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100918    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100921    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100935    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100938    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100941    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100943    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100946    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100948    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100951    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100954    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100956    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:16:36.105613 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100959    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100962    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100965    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100969    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100971    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100974    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100977    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100980    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100983    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100986    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100989    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100992    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100994    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.100997    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:16:36.106147 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.101002    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101116    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101122    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101124    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101127    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101131    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101135    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101138    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101141    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101143    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101146    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101148    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101151    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101153    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101156    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101158    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101160    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101163    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101165    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 20:16:36.106533 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101168    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101170    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101172    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101175    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101177    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101179    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101182    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101185    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101187    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101190    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101193    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101195    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101198    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101200    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101203    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101205    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101208    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101210    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101212    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101215    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 20:16:36.107050 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101217    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101220    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101222    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101224    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101227    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101229    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101232    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101234    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101237    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101239    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101243    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101246    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101248    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101250    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101253    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101255    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101258    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101260    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101263    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101265    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 20:16:36.107587 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101268    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101270    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101272    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101275    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101278    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101280    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101283    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101285    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101287    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101290    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101292    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101295    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101297    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101299    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101302    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101304    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101307    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101309    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101311    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 20:16:36.108088 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101314    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101316    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101318    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101321    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101323    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101325    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101328    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101330    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101333    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101335    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101337    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101340    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101342    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101345    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101348    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101352    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101354    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101357    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101359    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101362    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 20:16:36.108558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101364    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:36.101367    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.101371    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.101474    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.103440    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.105250    2570 server.go:1019] "Starting client certificate rotation"
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.105419    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:16:36.109137 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.105521    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 20:16:36.110054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.110039    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:16:36.113177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.113161    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 20:16:36.128133 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.128115    2570 log.go:25] "Validated CRI v1 runtime API"
Sep 09 20:16:36.131070 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.131052    2570 log.go:25] "Validated CRI v1 image API"
Sep 09 20:16:36.133504 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.133479    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 20:16:36.137843 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.137824    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:16:36.138879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.138857    2570 fs.go:135] Filesystem UUIDs: map[2664bc42-e449-4861-8203-2e3578c787bf:/dev/nvme0n1p3 7601000e-5d27-4552-8ba4-3b8eb16c9a7c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 09 20:16:36.138941 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.138880    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 20:16:36.144274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.144170    2570 manager.go:216] Machine: {Timestamp:2026-09-09 20:16:36.143677128 +0000 UTC m=+0.370627879 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3077853 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2310c444a69e895c2d2ef8f7cbb0dd SystemUUID:ec2310c4-44a6-9e89-5c2d-2ef8f7cbb0dd BootID:8a5f1674-2d96-4abb-b589-94a0c6a1beee Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:3c:94:c5:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:3c:94:c5:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:cd:19:12:57:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 20:16:36.144274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.144273    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 20:16:36.144380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.144342    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 20:16:36.148076 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.148052    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 20:16:36.148224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.148079    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 20:16:36.148781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.148771    2570 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 20:16:36.148810 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.148784    2570 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 20:16:36.148810 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.148791    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:16:36.149521 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.149511    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 20:16:36.150803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.150793    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 20:16:36.156252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156240    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:16:36.156361 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156352    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 20:16:36.156397 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156389    2570 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 20:16:36.156425 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156410    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 20:16:36.156425 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156423    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 20:16:36.156477 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156436    2570 kubelet.go:398] "Adding apiserver pod source"
Sep 09 20:16:36.156477 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156444    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 20:16:36.157001 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.156980    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:16:36.157063 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.157022    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 20:16:36.160158 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.160023    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 20:16:36.162633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.162616    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 20:16:36.162694 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.162648    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 20:16:36.163422 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163409    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 20:16:36.163457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163433    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 20:16:36.163457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163441    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 20:16:36.163457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163446    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 20:16:36.163457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163455    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 20:16:36.163571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163460    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 20:16:36.163629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163621    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 20:16:36.163658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163630    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 20:16:36.163658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163637    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 20:16:36.163658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163642    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 20:16:36.163658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163651    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 20:16:36.163658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163658    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 20:16:36.163839 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163681    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 20:16:36.163839 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.163686    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 20:16:36.164302 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.164283    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmxdr"
Sep 09 20:16:36.167722 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.167707    2570 server.go:1268] "Started kubelet"
Sep 09 20:16:36.167864 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.167799    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 20:16:36.168252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.167859    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 20:16:36.168344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.168276    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 20:16:36.168536 ip-10-0-143-224 systemd[1]: Started Kubernetes Kubelet.
Sep 09 20:16:36.169549 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.169422    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 20:16:36.171716 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.171689    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 20:16:36.171815 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.171761    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 20:16:36.172312 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.172297    2570 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 20:16:36.172688 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.172652    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmxdr"
Sep 09 20:16:36.172748 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.172673    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 20:16:36.173589 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.173574    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 20:16:36.174094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.174080    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 20:16:36.174236 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.174212    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.174726 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.174658    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 20:16:36.174726 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.174661    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 20:16:36.174726 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.174685    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 20:16:36.174955 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.174802    2570 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 20:16:36.174955 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.174812    2570 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 20:16:36.175130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175115    2570 factory.go:55] Registering systemd factory
Sep 09 20:16:36.175198 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175156    2570 factory.go:223] Registration of the systemd container factory successfully
Sep 09 20:16:36.175559 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175542    2570 factory.go:153] Registering CRI-O factory
Sep 09 20:16:36.175559 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175561    2570 factory.go:223] Registration of the crio container factory successfully
Sep 09 20:16:36.175690 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175624    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 20:16:36.175690 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175639    2570 factory.go:103] Registering Raw factory
Sep 09 20:16:36.175690 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.175653    2570 manager.go:1196] Started watching for new ooms in manager
Sep 09 20:16:36.176073 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.176059    2570 manager.go:349] Starting recovery of all containers
Sep 09 20:16:36.178781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.178758    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:36.182876 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.182854    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:36.184268 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.184242    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-224.ec2.internal\" not found" node="ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.188651 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.188636    2570 manager.go:354] Recovery completed
Sep 09 20:16:36.193238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.193224    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.194995 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.194971    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.195098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.195013    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.195098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.195029    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.195610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.195594    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 20:16:36.195610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.195605    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.195704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.195609    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 20:16:36.195704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.195635    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 20:16:36.196287 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.196275    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.196331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.196297    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.196331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.196306    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.197649 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.197639    2570 policy_none.go:49] "None policy: Start"
Sep 09 20:16:36.197691 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.197653    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 20:16:36.197691 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.197663    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 20:16:36.199527 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.199514    2570 policy_none.go:47] "Start"
Sep 09 20:16:36.233577 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.233559    2570 manager.go:337] "Starting Device Plugin manager"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.233611    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.233625    2570 server.go:87] "Starting device plugin registration server"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.233988    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.234008    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.234121    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.234224    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.234234    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.234770    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 20:16:36.259325 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.234834    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.298306 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.298273    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 20:16:36.299574 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.299554    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 20:16:36.299644 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.299628    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 20:16:36.299679 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.299662    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 20:16:36.299723 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.299710    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 20:16:36.302291 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.302270    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:36.334482 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.334456    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.335478 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.335396    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.335478 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.335432    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.335478 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.335447    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.335478 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.335472    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.351448 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.351431    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.351533 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.351454    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-224.ec2.internal\": node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.390829 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.390802    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.400622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.400599    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"]
Sep 09 20:16:36.400712 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.400684    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.402208 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.402189    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.402274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.402228    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.402274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.402239    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.404359 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.404346    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.404514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.404486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.404571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.404518    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.405101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.405083    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.405164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.405116    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.405164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.405136    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.405234 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.405086    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.405234 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.405197    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.405234 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.405208    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.407287 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.407265    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.407373 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.407298    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 20:16:36.407945 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.407915    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 20:16:36.408013 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.407956    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 20:16:36.408013 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.407966    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeHasSufficientPID"
Sep 09 20:16:36.438486 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.438466    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-224.ec2.internal\" not found" node="ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.442509 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.442491    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-224.ec2.internal\" not found" node="ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.476205 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.476183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/200c6fd4f46529840321e03c7f401cfd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-224.ec2.internal\" (UID: \"200c6fd4f46529840321e03c7f401cfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.476301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.476207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bf9f3ccd74d0bfd486476c54631513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"11bf9f3ccd74d0bfd486476c54631513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.476301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.476224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bf9f3ccd74d0bfd486476c54631513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"11bf9f3ccd74d0bfd486476c54631513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.491282 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.491266    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.577236 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.577209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/200c6fd4f46529840321e03c7f401cfd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-224.ec2.internal\" (UID: \"200c6fd4f46529840321e03c7f401cfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.577236 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.577237    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bf9f3ccd74d0bfd486476c54631513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"11bf9f3ccd74d0bfd486476c54631513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.577414 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.577252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bf9f3ccd74d0bfd486476c54631513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"11bf9f3ccd74d0bfd486476c54631513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.577414 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.577324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/200c6fd4f46529840321e03c7f401cfd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-224.ec2.internal\" (UID: \"200c6fd4f46529840321e03c7f401cfd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.577414 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.577338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bf9f3ccd74d0bfd486476c54631513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"11bf9f3ccd74d0bfd486476c54631513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.577414 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.577331    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bf9f3ccd74d0bfd486476c54631513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal\" (UID: \"11bf9f3ccd74d0bfd486476c54631513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.592372 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.592313    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.692747 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.692726    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.741892 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.741872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.745081 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:36.745059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:36.793087 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.793063    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.893598 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.893570    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:36.994100 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:36.994054    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.094613 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.094572    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.105750 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.105723    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 20:16:37.105959 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.105920    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:16:37.106018 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.105924    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:16:37.106018 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.105920    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 20:16:37.176224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.176132    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:11:36 +0000 UTC" deadline="2028-04-05 16:09:29.062198846 +0000 UTC"
Sep 09 20:16:37.176224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.176171    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13771h52m51.886030995s"
Sep 09 20:16:37.195378 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.195350    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.296080 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.296033    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.341305 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:37.341261    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bf9f3ccd74d0bfd486476c54631513.slice/crio-3c2043562b01ebd359e2a6b32ceb9c8939d300a867019a5feb887a5a2d58328a WatchSource:0}: Error finding container 3c2043562b01ebd359e2a6b32ceb9c8939d300a867019a5feb887a5a2d58328a: Status 404 returned error can't find the container with id 3c2043562b01ebd359e2a6b32ceb9c8939d300a867019a5feb887a5a2d58328a
Sep 09 20:16:37.341658 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:37.341639    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200c6fd4f46529840321e03c7f401cfd.slice/crio-1da92541d16d2ee6ac0182317273a1673e8486dc934315c9d513500314a33e8e WatchSource:0}: Error finding container 1da92541d16d2ee6ac0182317273a1673e8486dc934315c9d513500314a33e8e: Status 404 returned error can't find the container with id 1da92541d16d2ee6ac0182317273a1673e8486dc934315c9d513500314a33e8e
Sep 09 20:16:37.346892 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.346878    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:16:37.396423 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.396391    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.496961 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.496869    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.597387 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.597356    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.698153 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:37.698116    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-224.ec2.internal\" not found"
Sep 09 20:16:37.753030 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.752935    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:37.775318 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.775293    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:37.789778 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.789756    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:16:37.789910 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.789883    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal"
Sep 09 20:16:37.799131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.799103    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 20:16:37.912847 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:37.912824    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:38.075869 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.075778    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:38.158164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.158138    2570 apiserver.go:52] "Watching apiserver"
Sep 09 20:16:38.167813 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.167786    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 20:16:38.168666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.168283    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-8wgsl","openshift-image-registry/node-ca-vb4mq","openshift-multus/network-metrics-daemon-4dq2s","openshift-network-diagnostics/network-check-target-k66nc","kube-system/konnectivity-agent-k6ltm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal","openshift-multus/multus-4zxxv","openshift-multus/multus-additional-cni-plugins-c7df5","openshift-network-operator/iptables-alerter-ksjxg","openshift-ovn-kubernetes/ovnkube-node-8jkrc","kube-system/global-pull-secret-syncer-lgw5x","kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt","openshift-cluster-node-tuning-operator/tuned-c7mx5"]
Sep 09 20:16:38.171172 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.171145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.173571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.173546    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.174076 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.174051    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 20:16:38.175939 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.175886    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.175939 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.175904    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kg69k\""
Sep 09 20:16:38.176430 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.176384    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 20:16:38.176430 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.176423    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.176777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.176759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.176871 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.176845    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:38.176934 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.176912    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.177162 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.177140    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cd929\""
Sep 09 20:16:38.177362 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.177343    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 20:16:38.177622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.177604    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 20:16:38.177830 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.177814    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.180289 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.180257    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:38.180401 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.180335    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:38.181850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.181571    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.184001 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.183980    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 20:16:38.184109 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.184038    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.184895 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.184785    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vf5kz\""
Sep 09 20:16:38.184995 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.184948    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 20:16:38.187066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.186835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-cni-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.186950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-cnibin\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.186981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-cni-bin\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-cni-multus\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkk5\" (UniqueName: \"kubernetes.io/projected/7ae726c6-c452-4061-89c4-62d84001cbd7-kube-api-access-nzkk5\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187076    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7b6de42-915f-4699-85a2-23b6c7e6144e-hosts-file\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187087    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ae726c6-c452-4061-89c4-62d84001cbd7-cni-binary-copy\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187122    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-socket-dir-parent\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-kubelet\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-hostroot\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187193    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-conf-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-daemon-config\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-multus-certs\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7b6de42-915f-4699-85a2-23b6c7e6144e-tmp-dir\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-k8s-cni-cncf-io\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187310    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-netns\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.187367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187335    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-etc-kubernetes\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187382    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drqj\" (UniqueName: \"kubernetes.io/projected/b7b6de42-915f-4699-85a2-23b6c7e6144e-kube-api-access-2drqj\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kglm\" (UniqueName: \"kubernetes.io/projected/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-kube-api-access-6kglm\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-system-cni-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187508    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187789    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 20:16:38.188082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.187843    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.188437 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.188344    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j7rzk\""
Sep 09 20:16:38.188490 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.188345    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 20:16:38.189177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.188986    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.189177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.189169    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 20:16:38.189339 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.189324    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.191415 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.191394    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 20:16:38.191777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.191761    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qmxpv\""
Sep 09 20:16:38.191999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.191972    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.192229 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.192214    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.192782 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.192548    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.195401 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.195125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.196860 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.196391    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.196860 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.196532    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j84lm\""
Sep 09 20:16:38.197056 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.196917    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.199086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.197142    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 20:16:38.199086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.198100    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.199086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.198219    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 20:16:38.199086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.198388    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.199400 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.199382    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bbdmt\""
Sep 09 20:16:38.199989 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.199971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.200080 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.200060    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:38.203496 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.203053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.205819 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.205782    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 20:16:38.207141 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.207120    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.207699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.207682    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8sz2c\""
Sep 09 20:16:38.207949 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.207730    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 20:16:38.209507 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.209484    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:16:38.210155 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.210135    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c9c2n\""
Sep 09 20:16:38.210391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.210372    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 20:16:38.217344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.217322    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sqgfg"
Sep 09 20:16:38.224630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.224607    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sqgfg"
Sep 09 20:16:38.276585 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.276564    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 20:16:38.288388 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.288481 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288398    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysctl-conf\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.288481 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-run-netns\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.288481 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-socket-dir-parent\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.288481 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288471    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-conf-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-multus-certs\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288546    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-socket-dir-parent\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288592    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-multus-certs\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-conf-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-device-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zc5q\" (UniqueName: \"kubernetes.io/projected/932fba7c-f20f-46c5-993b-fdcf80892c41-kube-api-access-5zc5q\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.288699 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-env-overrides\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-k8s-cni-cncf-io\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288762    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aac44618-f6eb-442b-a437-440d1b19e431-host-slash\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysconfig\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73ee5668-f149-473d-941e-7516cf2c4b4e-konnectivity-ca\") pod \"konnectivity-agent-k6ltm\" (UID: \"73ee5668-f149-473d-941e-7516cf2c4b4e\") " pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-k8s-cni-cncf-io\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-ovnkube-config\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-registration-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.288980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-kubernetes\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-sys\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-host\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-cni-bin\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcqln\" (UniqueName: \"kubernetes.io/projected/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-kube-api-access-lcqln\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-cnibin\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-tuned\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-var-lib-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-hostroot\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aac44618-f6eb-442b-a437-440d1b19e431-iptables-alerter-script\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-cni-binary-copy\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-modprobe-d\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-systemd-units\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289438    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-systemd\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-node-log\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-cni-netd\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-netns\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289556    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-var-lib-kubelet\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.289658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289652    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-run-netns\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/392511ae-8f1a-483b-a17e-164fc8d84f91-ovn-node-metrics-cert\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289758    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-system-cni-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysctl-d\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-run\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289841    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-cni-bin\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-lib-modules\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289890    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc52\" (UniqueName: \"kubernetes.io/projected/34ffdb09-39cc-4c7e-8806-b0c577204982-kube-api-access-wnc52\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289918    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-log-socket\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42p88\" (UniqueName: \"kubernetes.io/projected/55da36f3-5875-4fe6-94ef-5cfd122f0226-kube-api-access-42p88\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.289970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-kubelet\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7b6de42-915f-4699-85a2-23b6c7e6144e-tmp-dir\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6d2414e-c9b5-4aa6-a125-8b397fa50821-kubelet-config\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6d2414e-c9b5-4aa6-a125-8b397fa50821-dbus\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqklq\" (UniqueName: \"kubernetes.io/projected/392511ae-8f1a-483b-a17e-164fc8d84f91-kube-api-access-vqklq\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.290502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-etc-kubernetes\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8tk6\" (UniqueName: \"kubernetes.io/projected/aac44618-f6eb-442b-a437-440d1b19e431-kube-api-access-v8tk6\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73ee5668-f149-473d-941e-7516cf2c4b4e-agent-certs\") pod \"konnectivity-agent-k6ltm\" (UID: \"73ee5668-f149-473d-941e-7516cf2c4b4e\") " pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-kubelet\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55da36f3-5875-4fe6-94ef-5cfd122f0226-host\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-socket-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-systemd\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-ovn\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-cni-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkk5\" (UniqueName: \"kubernetes.io/projected/7ae726c6-c452-4061-89c4-62d84001cbd7-kube-api-access-nzkk5\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7b6de42-915f-4699-85a2-23b6c7e6144e-hosts-file\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290496    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34ffdb09-39cc-4c7e-8806-b0c577204982-tmp\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ae726c6-c452-4061-89c4-62d84001cbd7-cni-binary-copy\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-daemon-config\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.291358 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-slash\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290620    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-ovnkube-script-lib\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2drqj\" (UniqueName: \"kubernetes.io/projected/b7b6de42-915f-4699-85a2-23b6c7e6144e-kube-api-access-2drqj\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290661    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kglm\" (UniqueName: \"kubernetes.io/projected/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-kube-api-access-6kglm\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-sys-fs\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-system-cni-dir\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290918    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-etc-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55da36f3-5875-4fe6-94ef-5cfd122f0226-serviceca\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-cnibin\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.290997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-cni-multus\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291092    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-cni-multus\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291139    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-cni-bin\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-hostroot\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291299    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-system-cni-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.292226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291348    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-host-var-lib-kubelet\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.293150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7b6de42-915f-4699-85a2-23b6c7e6144e-tmp-dir\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.293150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-etc-kubernetes\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.293150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.291781    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-cni-dir\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.293150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.292074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7b6de42-915f-4699-85a2-23b6c7e6144e-hosts-file\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.293150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.292587    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ae726c6-c452-4061-89c4-62d84001cbd7-cni-binary-copy\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.293150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.293044    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7ae726c6-c452-4061-89c4-62d84001cbd7-multus-daemon-config\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.293455 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.293325    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:38.293455 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.293400    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:38.793371561 +0000 UTC m=+3.020322306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:38.293732 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.293701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ae726c6-c452-4061-89c4-62d84001cbd7-cnibin\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.299319 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.299300    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 20:16:38.305088 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.304872    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkk5\" (UniqueName: \"kubernetes.io/projected/7ae726c6-c452-4061-89c4-62d84001cbd7-kube-api-access-nzkk5\") pod \"multus-4zxxv\" (UID: \"7ae726c6-c452-4061-89c4-62d84001cbd7\") " pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.309383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.308315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drqj\" (UniqueName: \"kubernetes.io/projected/b7b6de42-915f-4699-85a2-23b6c7e6144e-kube-api-access-2drqj\") pod \"node-resolver-8wgsl\" (UID: \"b7b6de42-915f-4699-85a2-23b6c7e6144e\") " pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.309383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.308978    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal" event={"ID":"200c6fd4f46529840321e03c7f401cfd","Type":"ContainerStarted","Data":"1da92541d16d2ee6ac0182317273a1673e8486dc934315c9d513500314a33e8e"}
Sep 09 20:16:38.309383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.309206    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kglm\" (UniqueName: \"kubernetes.io/projected/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-kube-api-access-6kglm\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.311228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.311203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" event={"ID":"11bf9f3ccd74d0bfd486476c54631513","Type":"ContainerStarted","Data":"3c2043562b01ebd359e2a6b32ceb9c8939d300a867019a5feb887a5a2d58328a"}
Sep 09 20:16:38.391815 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6d2414e-c9b5-4aa6-a125-8b397fa50821-kubelet-config\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.391970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6d2414e-c9b5-4aa6-a125-8b397fa50821-dbus\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.391970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.391970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391919    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.391970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6d2414e-c9b5-4aa6-a125-8b397fa50821-kubelet-config\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.391970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqklq\" (UniqueName: \"kubernetes.io/projected/392511ae-8f1a-483b-a17e-164fc8d84f91-kube-api-access-vqklq\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.391992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8tk6\" (UniqueName: \"kubernetes.io/projected/aac44618-f6eb-442b-a437-440d1b19e431-kube-api-access-v8tk6\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73ee5668-f149-473d-941e-7516cf2c4b4e-agent-certs\") pod \"konnectivity-agent-k6ltm\" (UID: \"73ee5668-f149-473d-941e-7516cf2c4b4e\") " pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392019    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6d2414e-c9b5-4aa6-a125-8b397fa50821-dbus\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-kubelet\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55da36f3-5875-4fe6-94ef-5cfd122f0226-host\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.392269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-socket-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392313    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-kubelet\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-systemd\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-ovn\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-systemd\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34ffdb09-39cc-4c7e-8806-b0c577204982-tmp\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55da36f3-5875-4fe6-94ef-5cfd122f0226-host\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392376    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-ovn\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392468    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-socket-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392474    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-slash\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-ovnkube-script-lib\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392561    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.392628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-sys-fs\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-system-cni-dir\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-etc-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392698    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55da36f3-5875-4fe6-94ef-5cfd122f0226-serviceca\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392699    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-etc-selinux\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392745    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysctl-conf\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-run-netns\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-device-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zc5q\" (UniqueName: \"kubernetes.io/projected/932fba7c-f20f-46c5-993b-fdcf80892c41-kube-api-access-5zc5q\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392842    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-system-cni-dir\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-env-overrides\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392887    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aac44618-f6eb-442b-a437-440d1b19e431-host-slash\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392894    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-etc-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysconfig\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.393551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392965    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73ee5668-f149-473d-941e-7516cf2c4b4e-konnectivity-ca\") pod \"konnectivity-agent-k6ltm\" (UID: \"73ee5668-f149-473d-941e-7516cf2c4b4e\") " pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-ovnkube-config\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-registration-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-kubernetes\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-sys\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393165    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-host\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcqln\" (UniqueName: \"kubernetes.io/projected/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-kube-api-access-lcqln\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393217    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-cnibin\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-tuned\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-var-lib-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393297    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55da36f3-5875-4fe6-94ef-5cfd122f0226-serviceca\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aac44618-f6eb-442b-a437-440d1b19e431-iptables-alerter-script\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-cni-binary-copy\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393384    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-ovnkube-script-lib\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.394374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-modprobe-d\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-systemd-units\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/932fba7c-f20f-46c5-993b-fdcf80892c41-cnibin\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393452    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-systemd\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393477    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-node-log\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393480    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-registration-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393485    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysctl-conf\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-cni-netd\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-var-lib-kubelet\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-kubernetes\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393541    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-device-dir\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.392813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-sys-fs\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393559    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-slash\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-var-lib-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aac44618-f6eb-442b-a437-440d1b19e431-host-slash\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-sys\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394081    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-env-overrides\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.395314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-run-netns\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-host\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394462    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73ee5668-f149-473d-941e-7516cf2c4b4e-konnectivity-ca\") pod \"konnectivity-agent-k6ltm\" (UID: \"73ee5668-f149-473d-941e-7516cf2c4b4e\") " pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-systemd-units\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394541    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-cni-netd\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394588    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-systemd\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-node-log\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.394679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-var-lib-kubelet\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395078    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aac44618-f6eb-442b-a437-440d1b19e431-iptables-alerter-script\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395185    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-modprobe-d\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/392511ae-8f1a-483b-a17e-164fc8d84f91-ovnkube-config\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-run-openvswitch\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.395348    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.395417    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:38.895398232 +0000 UTC m=+3.122348993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.393556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/392511ae-8f1a-483b-a17e-164fc8d84f91-ovn-node-metrics-cert\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395644    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/932fba7c-f20f-46c5-993b-fdcf80892c41-cni-binary-copy\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.396180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysctl-d\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395667    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73ee5668-f149-473d-941e-7516cf2c4b4e-agent-certs\") pod \"konnectivity-agent-k6ltm\" (UID: \"73ee5668-f149-473d-941e-7516cf2c4b4e\") " pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-run\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-cni-bin\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395748    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysconfig\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395752    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-sysctl-d\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395752    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-lib-modules\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395789    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc52\" (UniqueName: \"kubernetes.io/projected/34ffdb09-39cc-4c7e-8806-b0c577204982-kube-api-access-wnc52\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-run\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-log-socket\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34ffdb09-39cc-4c7e-8806-b0c577204982-lib-modules\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-log-socket\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42p88\" (UniqueName: \"kubernetes.io/projected/55da36f3-5875-4fe6-94ef-5cfd122f0226-kube-api-access-42p88\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.397082 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.395876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/392511ae-8f1a-483b-a17e-164fc8d84f91-host-cni-bin\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.397924 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.397372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34ffdb09-39cc-4c7e-8806-b0c577204982-tmp\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.398693 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.398649    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/392511ae-8f1a-483b-a17e-164fc8d84f91-ovn-node-metrics-cert\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.399571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.399544    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34ffdb09-39cc-4c7e-8806-b0c577204982-etc-tuned\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.402921 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.402899    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:16:38.403036 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.402927    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:16:38.403036 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.402941    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:38.403036 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.403027    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:38.903009142 +0000 UTC m=+3.129959906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:38.405023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.404972    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8tk6\" (UniqueName: \"kubernetes.io/projected/aac44618-f6eb-442b-a437-440d1b19e431-kube-api-access-v8tk6\") pod \"iptables-alerter-ksjxg\" (UID: \"aac44618-f6eb-442b-a437-440d1b19e431\") " pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.407529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.407359    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqklq\" (UniqueName: \"kubernetes.io/projected/392511ae-8f1a-483b-a17e-164fc8d84f91-kube-api-access-vqklq\") pod \"ovnkube-node-8jkrc\" (UID: \"392511ae-8f1a-483b-a17e-164fc8d84f91\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.408266 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.408112    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc52\" (UniqueName: \"kubernetes.io/projected/34ffdb09-39cc-4c7e-8806-b0c577204982-kube-api-access-wnc52\") pod \"tuned-c7mx5\" (UID: \"34ffdb09-39cc-4c7e-8806-b0c577204982\") " pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.408266 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.408222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zc5q\" (UniqueName: \"kubernetes.io/projected/932fba7c-f20f-46c5-993b-fdcf80892c41-kube-api-access-5zc5q\") pod \"multus-additional-cni-plugins-c7df5\" (UID: \"932fba7c-f20f-46c5-993b-fdcf80892c41\") " pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.409677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.409634    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcqln\" (UniqueName: \"kubernetes.io/projected/0cd0fd8a-9919-4e63-8c52-84fa3a7237ac-kube-api-access-lcqln\") pod \"aws-ebs-csi-driver-node-czkzt\" (UID: \"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.409677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.409651    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42p88\" (UniqueName: \"kubernetes.io/projected/55da36f3-5875-4fe6-94ef-5cfd122f0226-kube-api-access-42p88\") pod \"node-ca-vb4mq\" (UID: \"55da36f3-5875-4fe6-94ef-5cfd122f0226\") " pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.484164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.484135    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zxxv"
Sep 09 20:16:38.495482 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.495464    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8wgsl"
Sep 09 20:16:38.513982 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.513958    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:38.523095 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.523074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:16:38.531334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.531315    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vb4mq"
Sep 09 20:16:38.540296 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.540276    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt"
Sep 09 20:16:38.550962 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.550945    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ksjxg"
Sep 09 20:16:38.559729 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.559711    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c7df5"
Sep 09 20:16:38.566482 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.566459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c7mx5"
Sep 09 20:16:38.799565 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.799480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:38.799749 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.799666    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:38.799819 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.799750    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:39.799725816 +0000 UTC m=+4.026676573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:38.900446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:38.900412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:38.900588 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.900540    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:38.900637 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:38.900598    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:39.900581117 +0000 UTC m=+4.127531857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:39.001220 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:39.001179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:39.001435 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.001408    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:16:39.001487 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.001445    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:16:39.001487 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.001471    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:39.001559 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.001530    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:40.001515964 +0000 UTC m=+4.228466705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:39.228174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:39.228124    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:11:38 +0000 UTC" deadline="2028-05-18 00:14:26.858141688 +0000 UTC"
Sep 09 20:16:39.228174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:39.228154    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14787h57m47.629991466s"
Sep 09 20:16:39.385025 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.384995    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932fba7c_f20f_46c5_993b_fdcf80892c41.slice/crio-6b98ec69c177cfbf0d955daa2b9ee6dbc82f6683dda477876227ea9a9e9a990b WatchSource:0}: Error finding container 6b98ec69c177cfbf0d955daa2b9ee6dbc82f6683dda477876227ea9a9e9a990b: Status 404 returned error can't find the container with id 6b98ec69c177cfbf0d955daa2b9ee6dbc82f6683dda477876227ea9a9e9a990b
Sep 09 20:16:39.386412 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.386352    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ffdb09_39cc_4c7e_8806_b0c577204982.slice/crio-2d7a93c03bd88dfec698e14f3c2052dd192bb242267a0a5ba5dacca871f25d70 WatchSource:0}: Error finding container 2d7a93c03bd88dfec698e14f3c2052dd192bb242267a0a5ba5dacca871f25d70: Status 404 returned error can't find the container with id 2d7a93c03bd88dfec698e14f3c2052dd192bb242267a0a5ba5dacca871f25d70
Sep 09 20:16:39.417154 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.417123    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392511ae_8f1a_483b_a17e_164fc8d84f91.slice/crio-c9be390273626df349072802aa58a8f5815eb4590da016fea94b027d24fa6758 WatchSource:0}: Error finding container c9be390273626df349072802aa58a8f5815eb4590da016fea94b027d24fa6758: Status 404 returned error can't find the container with id c9be390273626df349072802aa58a8f5815eb4590da016fea94b027d24fa6758
Sep 09 20:16:39.419108 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.417913    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac44618_f6eb_442b_a437_440d1b19e431.slice/crio-bfb5114bad8fd6c03cd35c66138637b8ec9f33a0077bbdd1e22ab219bf0ac334 WatchSource:0}: Error finding container bfb5114bad8fd6c03cd35c66138637b8ec9f33a0077bbdd1e22ab219bf0ac334: Status 404 returned error can't find the container with id bfb5114bad8fd6c03cd35c66138637b8ec9f33a0077bbdd1e22ab219bf0ac334
Sep 09 20:16:39.430411 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.430388    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ee5668_f149_473d_941e_7516cf2c4b4e.slice/crio-d36d9d8839975178270f5e6c857538c5a3a51c5159df86e2b8606b2598f98a63 WatchSource:0}: Error finding container d36d9d8839975178270f5e6c857538c5a3a51c5159df86e2b8606b2598f98a63: Status 404 returned error can't find the container with id d36d9d8839975178270f5e6c857538c5a3a51c5159df86e2b8606b2598f98a63
Sep 09 20:16:39.432083 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.432059    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55da36f3_5875_4fe6_94ef_5cfd122f0226.slice/crio-4b42331355df7d7dc93084b144ad7217c9b38c0a826d41a4c508aa3be41baa89 WatchSource:0}: Error finding container 4b42331355df7d7dc93084b144ad7217c9b38c0a826d41a4c508aa3be41baa89: Status 404 returned error can't find the container with id 4b42331355df7d7dc93084b144ad7217c9b38c0a826d41a4c508aa3be41baa89
Sep 09 20:16:39.437349 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:16:39.437328    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b6de42_915f_4699_85a2_23b6c7e6144e.slice/crio-15b0ec2bf21a21b3b97aac568dc080131662d3c9ad84541ac681de6a79a8d177 WatchSource:0}: Error finding container 15b0ec2bf21a21b3b97aac568dc080131662d3c9ad84541ac681de6a79a8d177: Status 404 returned error can't find the container with id 15b0ec2bf21a21b3b97aac568dc080131662d3c9ad84541ac681de6a79a8d177
Sep 09 20:16:39.809780 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:39.809683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:39.809939 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.809819    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:39.809939 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.809903    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:41.809882363 +0000 UTC m=+6.036833119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:39.910897 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:39.910848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:39.911104 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.911059    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:39.911174 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:39.911128    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:41.91110792 +0000 UTC m=+6.138058678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:40.012680 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.012040    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:40.012680 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.012214    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:16:40.012680 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.012237    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:16:40.012680 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.012250    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:40.012680 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.012314    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:42.012294395 +0000 UTC m=+6.239245152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:40.229053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.228955    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:11:38 +0000 UTC" deadline="2028-05-07 18:50:09.197647328 +0000 UTC"
Sep 09 20:16:40.229053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.229019    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14542h33m28.968633172s"
Sep 09 20:16:40.301020 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.300674    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:40.301020 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.300724    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:40.301020 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.300674    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:40.301020 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.300848    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:40.301020 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.300977    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:40.301422 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:40.301071    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:40.333399 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.333332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zxxv" event={"ID":"7ae726c6-c452-4061-89c4-62d84001cbd7","Type":"ContainerStarted","Data":"431054d549575ab93c5cd173bc05a0eeecbcfc9198174952d57af3a39d8a07a8"}
Sep 09 20:16:40.337577 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.335873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6ltm" event={"ID":"73ee5668-f149-473d-941e-7516cf2c4b4e","Type":"ContainerStarted","Data":"d36d9d8839975178270f5e6c857538c5a3a51c5159df86e2b8606b2598f98a63"}
Sep 09 20:16:40.337718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.337680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"c9be390273626df349072802aa58a8f5815eb4590da016fea94b027d24fa6758"}
Sep 09 20:16:40.341566 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.340710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ksjxg" event={"ID":"aac44618-f6eb-442b-a437-440d1b19e431","Type":"ContainerStarted","Data":"bfb5114bad8fd6c03cd35c66138637b8ec9f33a0077bbdd1e22ab219bf0ac334"}
Sep 09 20:16:40.350239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.349351    2570 generic.go:356] "Generic (PLEG): container finished" podID="11bf9f3ccd74d0bfd486476c54631513" containerID="d92c070ae120f23b026a6d6ecd70f76159f313219567bef005e8cbb1807830a0" exitCode=0
Sep 09 20:16:40.350239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.349433    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" event={"ID":"11bf9f3ccd74d0bfd486476c54631513","Type":"ContainerDied","Data":"d92c070ae120f23b026a6d6ecd70f76159f313219567bef005e8cbb1807830a0"}
Sep 09 20:16:40.360555 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.360526    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c7mx5" event={"ID":"34ffdb09-39cc-4c7e-8806-b0c577204982","Type":"ContainerStarted","Data":"2d7a93c03bd88dfec698e14f3c2052dd192bb242267a0a5ba5dacca871f25d70"}
Sep 09 20:16:40.368265 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.368234    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vb4mq" event={"ID":"55da36f3-5875-4fe6-94ef-5cfd122f0226","Type":"ContainerStarted","Data":"4b42331355df7d7dc93084b144ad7217c9b38c0a826d41a4c508aa3be41baa89"}
Sep 09 20:16:40.382215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.374706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerStarted","Data":"6b98ec69c177cfbf0d955daa2b9ee6dbc82f6683dda477876227ea9a9e9a990b"}
Sep 09 20:16:40.383815 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.383756    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal" event={"ID":"200c6fd4f46529840321e03c7f401cfd","Type":"ContainerStarted","Data":"411be4d3f4d02b82bbfe2f152f1718ec15359d58ddba254b09c7d1e3a36b494f"}
Sep 09 20:16:40.392164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.392138    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8wgsl" event={"ID":"b7b6de42-915f-4699-85a2-23b6c7e6144e","Type":"ContainerStarted","Data":"15b0ec2bf21a21b3b97aac568dc080131662d3c9ad84541ac681de6a79a8d177"}
Sep 09 20:16:40.408918 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:40.408895    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt" event={"ID":"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac","Type":"ContainerStarted","Data":"8ccfa27c0f7c9b974f683a775c907238ecbfb0474bcbf399842aaf314bee60ae"}
Sep 09 20:16:41.430672 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:41.430500    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" event={"ID":"11bf9f3ccd74d0bfd486476c54631513","Type":"ContainerStarted","Data":"51c09dd2f354db7e688c89be1c97270d49082a83b91bd75b6f80e26f9b6dbad8"}
Sep 09 20:16:41.451776 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:41.451715    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-224.ec2.internal" podStartSLOduration=3.451692237 podStartE2EDuration="3.451692237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:40.402253545 +0000 UTC m=+4.629204311" watchObservedRunningTime="2026-09-09 20:16:41.451692237 +0000 UTC m=+5.678643004"
Sep 09 20:16:41.835785 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:41.835678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:41.835993 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:41.835890    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:41.835993 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:41.835963    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:45.835942516 +0000 UTC m=+10.062893265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:41.936392 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:41.936352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:41.936580 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:41.936569    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:41.936656 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:41.936639    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:45.936618595 +0000 UTC m=+10.163569337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:42.037273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:42.037229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:42.037474 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.037446    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:16:42.037474 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.037473    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:16:42.037598 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.037487    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:42.037598 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.037552    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:46.037532148 +0000 UTC m=+10.264482896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:42.303062 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:42.302261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:42.303062 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.302403    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:42.303062 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:42.302708    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:42.303062 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.302807    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:42.303062 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:42.302871    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:42.303062 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:42.302974    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:44.303002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:44.302969    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:44.303435 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:44.303040    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:44.303435 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:44.303071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:44.303435 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:44.303190    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:44.303435 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:44.303253    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:44.303435 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:44.303339    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:45.869679 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:45.869638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:45.870068 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:45.869801    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:45.870068 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:45.869864    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:53.869848578 +0000 UTC m=+18.096799319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:45.972546 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:45.971069    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:45.972546 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:45.971366    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:45.972546 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:45.971893    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:53.97141721 +0000 UTC m=+18.198367964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:46.072044 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:46.072003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:46.072251 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.072205    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:16:46.072251 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.072235    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:16:46.072251 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.072249    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:46.072439 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.072307    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:54.072287884 +0000 UTC m=+18.299238645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:46.301201 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:46.301111    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:46.301342 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:46.301224    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:46.301408 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.301227    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:46.301408 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.301347    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:46.301408 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:46.301399    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:46.301543 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:46.301470    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:48.300541 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:48.300454    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:48.300953 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:48.300458    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:48.300953 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:48.300580    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:48.300953 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:48.300580    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:48.300953 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:48.300690    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:48.300953 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:48.300786    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:50.300810 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:50.300786    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:50.301293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:50.300782    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:50.301293 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:50.301009    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:50.301293 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:50.300889    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:50.301293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:50.301059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:50.301293 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:50.301133    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:52.300710 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:52.300668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:52.301186 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:52.300677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:52.301186 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:52.300817    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:52.301186 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:52.300679    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:52.301186 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:52.300920    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:52.301186 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:52.300976    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:53.932822 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:53.932781    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:53.933324 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:53.932970    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:53.933324 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:53.933040    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:09.933018539 +0000 UTC m=+34.159969279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:16:54.033796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:54.033763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:54.033996 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.033900    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:54.033996 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.033976    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:10.033963847 +0000 UTC m=+34.260914599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:16:54.134677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:54.134634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:54.134832 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.134771    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:16:54.134832 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.134805    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:16:54.134832 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.134815    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:54.134959 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.134871    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:10.134852782 +0000 UTC m=+34.361803540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:16:54.300197 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:54.300110    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:54.300197 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:54.300170    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:54.300439 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:54.300113    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:54.300439 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.300272    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:54.300439 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.300393    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:54.300602 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:54.300490    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:56.301298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:56.301263    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:56.301725 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:56.301374    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:56.301725 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:56.301476    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:56.301725 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:56.301595    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:56.301725 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:56.301640    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:56.301725 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:56.301715    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:58.300769 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.300621    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:16:58.301318 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.300645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:16:58.301318 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:58.300870    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:16:58.301318 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:58.300918    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:16:58.301318 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.300645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:16:58.301318 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:16:58.301046    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:16:58.465936 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.465907    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8wgsl" event={"ID":"b7b6de42-915f-4699-85a2-23b6c7e6144e","Type":"ContainerStarted","Data":"f77e9c475fcdcc6080eda1ab6f9182c9ea8e452677754d456b21b76df569f4be"}
Sep 09 20:16:58.468604 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.468578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt" event={"ID":"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac","Type":"ContainerStarted","Data":"c441a730f1a5adcce69c5aeff85d5ba44df434d9162bdb6ba1f0c59bdf188289"}
Sep 09 20:16:58.470359 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.470331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zxxv" event={"ID":"7ae726c6-c452-4061-89c4-62d84001cbd7","Type":"ContainerStarted","Data":"b763b6b28bfb2560733c4c34bb92bd23f0f5dc946eea02ecfd7d475b80e2c884"}
Sep 09 20:16:58.472327 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.472302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6ltm" event={"ID":"73ee5668-f149-473d-941e-7516cf2c4b4e","Type":"ContainerStarted","Data":"a66c67db8965128030d96bea6b68c0548b86f047b20ca7626732403d7ffb71cb"}
Sep 09 20:16:58.477205 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.477178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"a63081581c1dd4f350ce78aafadf270c10c49a195ccbb15af4409dd2ff583724"}
Sep 09 20:16:58.477301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.477288    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"87fdc550f2056375c1adedc369a0d77f848639e1e5337542ecff5e04ee033a93"}
Sep 09 20:16:58.477373 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.477339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"11690cc2ce3ef1ca1e37bc899b25639ad96187afdaaf72b3937db3ea4b79b4cc"}
Sep 09 20:16:58.477425 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.477384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"e294e8e1a9acbd44bf0f0434b240df6814176d5deffaf7700f8b948fc3bd459a"}
Sep 09 20:16:58.477476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.477428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"f71c0ffae35154f6268ff7f94a9af07af2bf0f48d036c78e57e3ec5a493a791d"}
Sep 09 20:16:58.478850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.478821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c7mx5" event={"ID":"34ffdb09-39cc-4c7e-8806-b0c577204982","Type":"ContainerStarted","Data":"a433e3380f122c8c91c6786d32e4d217402a511e3cd7b057e07e8cf9c72de909"}
Sep 09 20:16:58.480554 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.480532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vb4mq" event={"ID":"55da36f3-5875-4fe6-94ef-5cfd122f0226","Type":"ContainerStarted","Data":"804a4209832a45f91da013cdb87481d511f4e6e2168831346fcda1836eb6f086"}
Sep 09 20:16:58.482340 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.482305    2570 generic.go:356] "Generic (PLEG): container finished" podID="932fba7c-f20f-46c5-993b-fdcf80892c41" containerID="77392a628d3d0b5bf1a0b5cba6121e7863cbb7af5714ca12c116f211898f1116" exitCode=0
Sep 09 20:16:58.482458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.482349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerDied","Data":"77392a628d3d0b5bf1a0b5cba6121e7863cbb7af5714ca12c116f211898f1116"}
Sep 09 20:16:58.487224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.487181    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-224.ec2.internal" podStartSLOduration=20.487164451 podStartE2EDuration="20.487164451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:41.452884791 +0000 UTC m=+5.679835553" watchObservedRunningTime="2026-09-09 20:16:58.487164451 +0000 UTC m=+22.714115213"
Sep 09 20:16:58.487908 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.487873    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8wgsl" podStartSLOduration=4.051524955 podStartE2EDuration="22.487862375s" totalImagesPullingTime="18.43633742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:58.487055584 +0000 UTC m=+22.714006345" watchObservedRunningTime="2026-09-09 20:16:58.487862375 +0000 UTC m=+22.714813146"
Sep 09 20:16:58.529487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.529451    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c7mx5" podStartSLOduration=3.049622884 podStartE2EDuration="21.529439973s" totalImagesPullingTime="18.479817089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:58.529228892 +0000 UTC m=+22.756179653" watchObservedRunningTime="2026-09-09 20:16:58.529439973 +0000 UTC m=+22.756390733"
Sep 09 20:16:58.547450 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.547410    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4zxxv" podStartSLOduration=4.061338839 podStartE2EDuration="22.547394598s" totalImagesPullingTime="18.486055759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:58.547367341 +0000 UTC m=+22.774318101" watchObservedRunningTime="2026-09-09 20:16:58.547394598 +0000 UTC m=+22.774345359"
Sep 09 20:16:58.562258 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.562201    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k6ltm" podStartSLOduration=7.829003392 podStartE2EDuration="22.562182902s" totalImagesPullingTime="14.73317951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:58.561729171 +0000 UTC m=+22.788680052" watchObservedRunningTime="2026-09-09 20:16:58.562182902 +0000 UTC m=+22.789133664"
Sep 09 20:16:58.577277 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:58.577233    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vb4mq" podStartSLOduration=4.147782939 podStartE2EDuration="22.577215441s" totalImagesPullingTime="18.429432502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:58.576503315 +0000 UTC m=+22.803454080" watchObservedRunningTime="2026-09-09 20:16:58.577215441 +0000 UTC m=+22.804166205"
Sep 09 20:16:59.112974 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.112791    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 20:16:59.229050 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.228911    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:59.229559 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.229536    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:16:59.247707 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.247605    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:16:59.112969827Z","UUID":"037e2da7-d922-47d8-9780-002984a3c9a1","Handler":null,"Name":"","Endpoint":""}
Sep 09 20:16:59.249053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.249028    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 20:16:59.249146 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.249059    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 20:16:59.487065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.486954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt" event={"ID":"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac","Type":"ContainerStarted","Data":"2d1d811065c9c95c24f6435d1947ccafbb6147498607b438cf1fc487e9c22207"}
Sep 09 20:16:59.490497 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.490472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"a8c9b1e2edcdeb9807d32136eb7a54d2fbdc019f98c73b7689ceaa7d9b59ef70"}
Sep 09 20:16:59.492334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.492212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ksjxg" event={"ID":"aac44618-f6eb-442b-a437-440d1b19e431","Type":"ContainerStarted","Data":"705ee17f5867977ffcc661cde2365b53b19e9bfa1748898185fda9b6fcab3b94"}
Sep 09 20:16:59.510466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:16:59.510419    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ksjxg" podStartSLOduration=4.072894429 podStartE2EDuration="22.510401329s" totalImagesPullingTime="18.4375069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:59.510100343 +0000 UTC m=+23.737051105" watchObservedRunningTime="2026-09-09 20:16:59.510401329 +0000 UTC m=+23.737352090"
Sep 09 20:17:00.300557 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:00.300529    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:00.300675 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:00.300532    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:00.300675 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:00.300627    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:00.300796 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:00.300702    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:00.300796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:00.300757    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:00.301084 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:00.300801    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:00.497132 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:00.497050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt" event={"ID":"0cd0fd8a-9919-4e63-8c52-84fa3a7237ac","Type":"ContainerStarted","Data":"f68c074f1a4b2ac0b365b6dd1be0951de07aa0e7ed2ec1be93282481334bec68"}
Sep 09 20:17:00.497132 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:00.497125    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:17:00.517057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:00.516999    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czkzt" podStartSLOduration=3.110408876 podStartE2EDuration="23.51698452s" totalImagesPullingTime="20.406575644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:00.516538626 +0000 UTC m=+24.743489388" watchObservedRunningTime="2026-09-09 20:17:00.51698452 +0000 UTC m=+24.743935314"
Sep 09 20:17:01.503900 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:01.503864    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"271c4bf2a95ac35d4ba4d36122eb3d480ee1d873a2fd532d18a1aa3ad4c4aff7"}
Sep 09 20:17:02.300701 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:02.300660    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:02.300872 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:02.300662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:02.300872 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:02.300786    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:02.301029 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:02.300660    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:02.301029 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:02.300899    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:02.301029 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:02.301022    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:03.512142 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:03.511896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" event={"ID":"392511ae-8f1a-483b-a17e-164fc8d84f91","Type":"ContainerStarted","Data":"3dbf9363f3c6a65f712b9af8c62d4782adc4a299a84b6fad654aac920878bc84"}
Sep 09 20:17:03.512536 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:03.512169    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:17:03.514293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:03.514267    2570 generic.go:356] "Generic (PLEG): container finished" podID="932fba7c-f20f-46c5-993b-fdcf80892c41" containerID="d37db0d5eefd7eef2af318e503d213229402e01733a7b28ea42cc1634b68f9ee" exitCode=0
Sep 09 20:17:03.514293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:03.514297    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerDied","Data":"d37db0d5eefd7eef2af318e503d213229402e01733a7b28ea42cc1634b68f9ee"}
Sep 09 20:17:03.527833 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:03.527816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:17:03.540818 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:03.540782    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" podStartSLOduration=9.022653777 podStartE2EDuration="27.540770784s" totalImagesPullingTime="18.518117007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:03.539195699 +0000 UTC m=+27.766146461" watchObservedRunningTime="2026-09-09 20:17:03.540770784 +0000 UTC m=+27.767721544"
Sep 09 20:17:04.300230 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.300198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:04.300461 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.300321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:04.300461 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.300360    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:04.300461 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:04.300335    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:04.300642 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:04.300514    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:04.300642 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:04.300618    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:04.516587 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.516556    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:17:04.517193 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.517053    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:17:04.533988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.533888    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:17:04.784403 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.784375    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k66nc"]
Sep 09 20:17:04.784547 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.784500    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:04.784609 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:04.784583    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:04.786672 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.786643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lgw5x"]
Sep 09 20:17:04.786806 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.786749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:04.786890 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:04.786862    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:04.787336 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.787316    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4dq2s"]
Sep 09 20:17:04.787451 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:04.787411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:04.787514 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:04.787493    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:05.520211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:05.520175    2570 generic.go:356] "Generic (PLEG): container finished" podID="932fba7c-f20f-46c5-993b-fdcf80892c41" containerID="bba42c476696ce5d333b7b20e1164283dfcbdce19cec5a53f2c55e8bb2301839" exitCode=0
Sep 09 20:17:05.520818 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:05.520261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerDied","Data":"bba42c476696ce5d333b7b20e1164283dfcbdce19cec5a53f2c55e8bb2301839"}
Sep 09 20:17:05.520818 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:05.520313    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:17:06.301338 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:06.301157    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:06.301477 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:06.301227    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:06.301477 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:06.301427    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:06.301559 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:06.301244    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:06.301595 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:06.301480    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:06.301595 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:06.301577    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:06.522156 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:06.522127    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:17:07.182512 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.182488    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8wgsl_b7b6de42-915f-4699-85a2-23b6c7e6144e/dns-node-resolver/0.log"
Sep 09 20:17:07.198913 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.198886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:17:07.215323 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.215253    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" podUID="392511ae-8f1a-483b-a17e-164fc8d84f91" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:17:07.223957 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.223917    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" podUID="392511ae-8f1a-483b-a17e-164fc8d84f91" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:17:07.526706 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.526633    2570 generic.go:356] "Generic (PLEG): container finished" podID="932fba7c-f20f-46c5-993b-fdcf80892c41" containerID="abbfaf43589fef7504f2ddd074b8a48093743afff9aa17c15c1379c3a75e9404" exitCode=0
Sep 09 20:17:07.527136 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.526716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerDied","Data":"abbfaf43589fef7504f2ddd074b8a48093743afff9aa17c15c1379c3a75e9404"}
Sep 09 20:17:07.536315 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:07.536294    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc" podUID="392511ae-8f1a-483b-a17e-164fc8d84f91" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 20:17:08.109317 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.109285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:17:08.109509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.109410    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 20:17:08.109879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.109860    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k6ltm"
Sep 09 20:17:08.300838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.300802    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:08.301016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.300840    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:08.301016 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:08.300982    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:08.301135 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:08.301040    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:08.301135 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.301076    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:08.301237 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:08.301172    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:08.381078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:08.381009    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vb4mq_55da36f3-5875-4fe6-94ef-5cfd122f0226/node-ca/0.log"
Sep 09 20:17:09.960956 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:09.960874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:09.961379 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:09.961071    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:17:09.961379 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:09.961123    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs podName:e1ba5c78-7a8b-42f2-8c67-557040a43ef1 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:41.961108832 +0000 UTC m=+66.188059572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs") pod "network-metrics-daemon-4dq2s" (UID: "e1ba5c78-7a8b-42f2-8c67-557040a43ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 20:17:10.061871 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:10.061838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:10.062049 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.062031    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 20:17:10.062123 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.062109    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret podName:a6d2414e-c9b5-4aa6-a125-8b397fa50821 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:42.06208723 +0000 UTC m=+66.289037983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret") pod "global-pull-secret-syncer-lgw5x" (UID: "a6d2414e-c9b5-4aa6-a125-8b397fa50821") : object "kube-system"/"original-pull-secret" not registered
Sep 09 20:17:10.163244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:10.163211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:10.163423 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.163380    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 20:17:10.163423 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.163404    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 20:17:10.163423 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.163416    2570 projected.go:196] Error preparing data for projected volume kube-api-access-kqfks for pod openshift-network-diagnostics/network-check-target-k66nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:17:10.163570 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.163480    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks podName:225effb0-8de6-4707-9a78-8425b70af7b2 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:42.163461419 +0000 UTC m=+66.390412177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kqfks" (UniqueName: "kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks") pod "network-check-target-k66nc" (UID: "225effb0-8de6-4707-9a78-8425b70af7b2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 20:17:10.300712 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:10.300621    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:10.300862 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:10.300622    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:10.300862 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.300751    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:10.300862 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:10.300800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:10.301044 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.300904    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:10.301044 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:10.300994    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:12.300388 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:12.300162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:12.300746 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:12.300182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:12.300746 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:12.300495    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:12.300746 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:12.300605    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:12.300746 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:12.300233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:12.300746 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:12.300698    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:12.540675 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:12.540602    2570 generic.go:356] "Generic (PLEG): container finished" podID="932fba7c-f20f-46c5-993b-fdcf80892c41" containerID="bc90ecd51f7ad34f239550602a3c4f68e4882ca87074b49778080e5af09a7ae9" exitCode=0
Sep 09 20:17:12.540675 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:12.540660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerDied","Data":"bc90ecd51f7ad34f239550602a3c4f68e4882ca87074b49778080e5af09a7ae9"}
Sep 09 20:17:13.546147 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:13.546115    2570 generic.go:356] "Generic (PLEG): container finished" podID="932fba7c-f20f-46c5-993b-fdcf80892c41" containerID="c227e2f795d68c1a7816f907c38446f73b59f556b92bf5e954f7b2877802bd0a" exitCode=0
Sep 09 20:17:13.546468 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:13.546179    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerDied","Data":"c227e2f795d68c1a7816f907c38446f73b59f556b92bf5e954f7b2877802bd0a"}
Sep 09 20:17:14.300301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:14.300273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:14.300479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:14.300313    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:14.300479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:14.300273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:14.300479 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:14.300387    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:14.300595 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:14.300490    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:14.300595 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:14.300577    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:14.551285 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:14.551214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c7df5" event={"ID":"932fba7c-f20f-46c5-993b-fdcf80892c41","Type":"ContainerStarted","Data":"f4f345f078e1bd671eec491b9b5ee167179457bee70c6804c3e07366aa51afb3"}
Sep 09 20:17:14.583593 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:14.583554    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c7df5" podStartSLOduration=8.00815277 podStartE2EDuration="37.583540623s" totalImagesPullingTime="29.575387853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:14.583205104 +0000 UTC m=+38.810155863" watchObservedRunningTime="2026-09-09 20:17:14.583540623 +0000 UTC m=+38.810491384"
Sep 09 20:17:16.301104 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:16.301075    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:16.301504 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:16.301167    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:16.301504 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:16.301264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:16.301504 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:16.301352    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:16.301504 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:16.301432    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:16.301628 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:16.301514    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:18.300093 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:18.300066    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:18.300093 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:18.300085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:18.300481 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:18.300066    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:18.300481 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:18.300161    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:18.300481 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:18.300276    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:18.300481 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:18.300315    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:20.300992 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:20.300957    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:20.300992 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:20.300991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:20.301483 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:20.301029    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:20.301483 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:20.301127    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:20.301483 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:20.301236    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:20.301483 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:20.301329    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:22.300159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:22.300124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:22.300159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:22.300147    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:22.300651 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:22.300124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:22.300651 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:22.300253    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:22.300651 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:22.300378    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:22.300651 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:22.300530    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:24.300678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:24.300640    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:24.301177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:24.300640    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:24.301177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:24.300766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:24.301177 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:24.300770    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:24.301177 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:24.300847    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:24.301177 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:24.300948    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:26.302379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:26.302343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:26.302875 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:26.302486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:26.302875 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:26.302512    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:26.302875 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:26.302572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:26.302875 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:26.302569    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:26.302875 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:26.302698    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:28.300500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:28.300465    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:28.300982 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:28.300465    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:28.300982 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:28.300570    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:28.300982 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:28.300665    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:28.300982 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:28.300472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:28.300982 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:28.300771    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:30.300784 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:30.300745    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:30.300784 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:30.300769    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:30.301368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:30.300745    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:30.301368 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:30.300861    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:30.301368 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:30.300995    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:30.301368 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:30.301081    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:32.300532 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.300497    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:32.301102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.300509    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:32.301102 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:32.300631    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4dq2s" podUID="e1ba5c78-7a8b-42f2-8c67-557040a43ef1"
Sep 09 20:17:32.301102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.300509    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:32.301102 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:32.300704    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k66nc" podUID="225effb0-8de6-4707-9a78-8425b70af7b2"
Sep 09 20:17:32.301102 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:32.300774    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lgw5x" podUID="a6d2414e-c9b5-4aa6-a125-8b397fa50821"
Sep 09 20:17:32.554459 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.554368    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-224.ec2.internal" event="NodeReady"
Sep 09 20:17:32.554623 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.554515    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 20:17:32.605319 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.605287    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w9z5n"]
Sep 09 20:17:32.608763 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.608446    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.610141 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.610109    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sbhxq"]
Sep 09 20:17:32.611404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.611380    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 20:17:32.611510 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.611417    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pv6p\""
Sep 09 20:17:32.611659 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.611645    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 20:17:32.611767 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.611751    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.614374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.614352    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mt874\""
Sep 09 20:17:32.614491 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.614475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 20:17:32.615141 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.615124    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 20:17:32.615218 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.615193    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 20:17:32.619514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.619494    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9z5n"]
Sep 09 20:17:32.623729 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.623707    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbhxq"]
Sep 09 20:17:32.707631 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.707596    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mlpw9"]
Sep 09 20:17:32.709483 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.709466    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.712519 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.712495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s82pj\""
Sep 09 20:17:32.712644 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.712586    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 20:17:32.712829 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.712812    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 20:17:32.712962 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.712859    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 20:17:32.712962 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.712939    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 20:17:32.723141 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.723115    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mlpw9"]
Sep 09 20:17:32.727530 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.727503    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll45z\" (UniqueName: \"kubernetes.io/projected/35d90237-edc3-494c-8baf-a91fca26ec9a-kube-api-access-ll45z\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.727664 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.727554    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35d90237-edc3-494c-8baf-a91fca26ec9a-metrics-tls\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.727664 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.727583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35d90237-edc3-494c-8baf-a91fca26ec9a-config-volume\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.727664 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.727635    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95mnm\" (UniqueName: \"kubernetes.io/projected/57fcc175-91c6-4500-b8e3-4ee251fdc142-kube-api-access-95mnm\") pod \"ingress-canary-sbhxq\" (UID: \"57fcc175-91c6-4500-b8e3-4ee251fdc142\") " pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.727781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.727665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57fcc175-91c6-4500-b8e3-4ee251fdc142-cert\") pod \"ingress-canary-sbhxq\" (UID: \"57fcc175-91c6-4500-b8e3-4ee251fdc142\") " pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.727781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.727707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d90237-edc3-494c-8baf-a91fca26ec9a-tmp-dir\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.828262 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/280fd9e3-6edf-4d5c-a020-125722b9520b-crio-socket\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.828262 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll45z\" (UniqueName: \"kubernetes.io/projected/35d90237-edc3-494c-8baf-a91fca26ec9a-kube-api-access-ll45z\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.828495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/280fd9e3-6edf-4d5c-a020-125722b9520b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.828495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35d90237-edc3-494c-8baf-a91fca26ec9a-metrics-tls\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.828495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/280fd9e3-6edf-4d5c-a020-125722b9520b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.828495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35d90237-edc3-494c-8baf-a91fca26ec9a-config-volume\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.828695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95mnm\" (UniqueName: \"kubernetes.io/projected/57fcc175-91c6-4500-b8e3-4ee251fdc142-kube-api-access-95mnm\") pod \"ingress-canary-sbhxq\" (UID: \"57fcc175-91c6-4500-b8e3-4ee251fdc142\") " pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.828695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57fcc175-91c6-4500-b8e3-4ee251fdc142-cert\") pod \"ingress-canary-sbhxq\" (UID: \"57fcc175-91c6-4500-b8e3-4ee251fdc142\") " pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.828695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828571    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/280fd9e3-6edf-4d5c-a020-125722b9520b-data-volume\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.828695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828613    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfqxj\" (UniqueName: \"kubernetes.io/projected/280fd9e3-6edf-4d5c-a020-125722b9520b-kube-api-access-jfqxj\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.828695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828658    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d90237-edc3-494c-8baf-a91fca26ec9a-tmp-dir\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.828978 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.828958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d90237-edc3-494c-8baf-a91fca26ec9a-tmp-dir\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.829074 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.829060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35d90237-edc3-494c-8baf-a91fca26ec9a-config-volume\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.832442 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.832417    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35d90237-edc3-494c-8baf-a91fca26ec9a-metrics-tls\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.832557 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.832506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57fcc175-91c6-4500-b8e3-4ee251fdc142-cert\") pod \"ingress-canary-sbhxq\" (UID: \"57fcc175-91c6-4500-b8e3-4ee251fdc142\") " pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.837893 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.837866    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll45z\" (UniqueName: \"kubernetes.io/projected/35d90237-edc3-494c-8baf-a91fca26ec9a-kube-api-access-ll45z\") pod \"dns-default-w9z5n\" (UID: \"35d90237-edc3-494c-8baf-a91fca26ec9a\") " pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.838505 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.838484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95mnm\" (UniqueName: \"kubernetes.io/projected/57fcc175-91c6-4500-b8e3-4ee251fdc142-kube-api-access-95mnm\") pod \"ingress-canary-sbhxq\" (UID: \"57fcc175-91c6-4500-b8e3-4ee251fdc142\") " pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.919720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.919682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:32.926074 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.926052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbhxq"
Sep 09 20:17:32.929240 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.929212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/280fd9e3-6edf-4d5c-a020-125722b9520b-data-volume\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.929349 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.929271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfqxj\" (UniqueName: \"kubernetes.io/projected/280fd9e3-6edf-4d5c-a020-125722b9520b-kube-api-access-jfqxj\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.929349 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.929332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/280fd9e3-6edf-4d5c-a020-125722b9520b-crio-socket\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.929465 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.929372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/280fd9e3-6edf-4d5c-a020-125722b9520b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.929465 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.929404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/280fd9e3-6edf-4d5c-a020-125722b9520b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.929871 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.929840    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/280fd9e3-6edf-4d5c-a020-125722b9520b-crio-socket\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.930379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.930355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/280fd9e3-6edf-4d5c-a020-125722b9520b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.930664 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.930644    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/280fd9e3-6edf-4d5c-a020-125722b9520b-data-volume\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.931837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.931816    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/280fd9e3-6edf-4d5c-a020-125722b9520b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:32.938459 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:32.938429    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfqxj\" (UniqueName: \"kubernetes.io/projected/280fd9e3-6edf-4d5c-a020-125722b9520b-kube-api-access-jfqxj\") pod \"insights-runtime-extractor-mlpw9\" (UID: \"280fd9e3-6edf-4d5c-a020-125722b9520b\") " pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:33.018624 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.018596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mlpw9"
Sep 09 20:17:33.206480 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.206445    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbhxq"]
Sep 09 20:17:33.209568 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:33.209545    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57fcc175_91c6_4500_b8e3_4ee251fdc142.slice/crio-a43590d61f523e08deeadc6f3c65c44bc76f6a7badde4315b80093a7f16e7848 WatchSource:0}: Error finding container a43590d61f523e08deeadc6f3c65c44bc76f6a7badde4315b80093a7f16e7848: Status 404 returned error can't find the container with id a43590d61f523e08deeadc6f3c65c44bc76f6a7badde4315b80093a7f16e7848
Sep 09 20:17:33.212859 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.212834    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9z5n"]
Sep 09 20:17:33.214888 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:33.214852    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d90237_edc3_494c_8baf_a91fca26ec9a.slice/crio-2d0bc62a7995b4ca92c62ea1c7d37a9c4ba37ff1e42a9e48226ce6ce91dc3ffb WatchSource:0}: Error finding container 2d0bc62a7995b4ca92c62ea1c7d37a9c4ba37ff1e42a9e48226ce6ce91dc3ffb: Status 404 returned error can't find the container with id 2d0bc62a7995b4ca92c62ea1c7d37a9c4ba37ff1e42a9e48226ce6ce91dc3ffb
Sep 09 20:17:33.293116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.293087    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mlpw9"]
Sep 09 20:17:33.296727 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:33.296694    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280fd9e3_6edf_4d5c_a020_125722b9520b.slice/crio-09f94e2a3fa025f9b5161860b9fdaa8daddf87e5170d65c173b18678a8cc216d WatchSource:0}: Error finding container 09f94e2a3fa025f9b5161860b9fdaa8daddf87e5170d65c173b18678a8cc216d: Status 404 returned error can't find the container with id 09f94e2a3fa025f9b5161860b9fdaa8daddf87e5170d65c173b18678a8cc216d
Sep 09 20:17:33.593009 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.592902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlpw9" event={"ID":"280fd9e3-6edf-4d5c-a020-125722b9520b","Type":"ContainerStarted","Data":"88bc80eb371288841f1832de643e0589d19643468a6a2c10fcff2fe8fc4b22e7"}
Sep 09 20:17:33.593009 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.592988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlpw9" event={"ID":"280fd9e3-6edf-4d5c-a020-125722b9520b","Type":"ContainerStarted","Data":"09f94e2a3fa025f9b5161860b9fdaa8daddf87e5170d65c173b18678a8cc216d"}
Sep 09 20:17:33.594033 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.594004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbhxq" event={"ID":"57fcc175-91c6-4500-b8e3-4ee251fdc142","Type":"ContainerStarted","Data":"a43590d61f523e08deeadc6f3c65c44bc76f6a7badde4315b80093a7f16e7848"}
Sep 09 20:17:33.595046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.595022    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9z5n" event={"ID":"35d90237-edc3-494c-8baf-a91fca26ec9a","Type":"ContainerStarted","Data":"2d0bc62a7995b4ca92c62ea1c7d37a9c4ba37ff1e42a9e48226ce6ce91dc3ffb"}
Sep 09 20:17:33.699294 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.699256    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"]
Sep 09 20:17:33.701133 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.701116    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:33.703637 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.703618    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 20:17:33.703693 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.703629    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fnfk7\""
Sep 09 20:17:33.712784 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.712759    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"]
Sep 09 20:17:33.735626 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.735580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0f0ec81a-535d-4ec5-9992-5441e3e8efda-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dtlbf\" (UID: \"0f0ec81a-535d-4ec5-9992-5441e3e8efda\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:33.836918 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.836868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0f0ec81a-535d-4ec5-9992-5441e3e8efda-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dtlbf\" (UID: \"0f0ec81a-535d-4ec5-9992-5441e3e8efda\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:33.839478 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:33.839446    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0f0ec81a-535d-4ec5-9992-5441e3e8efda-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-dtlbf\" (UID: \"0f0ec81a-535d-4ec5-9992-5441e3e8efda\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:34.009419 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.009382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:34.294024 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.293987    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"]
Sep 09 20:17:34.300031 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.300008    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:34.300422 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.300400    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:34.300594 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.300577    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:34.303302 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.303228    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:17:34.304540 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.304522    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:17:34.304761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.304745    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 20:17:34.305394 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.304902    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wv6m4\""
Sep 09 20:17:34.305394 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.304986    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 20:17:34.305394 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.304914    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c88hn\""
Sep 09 20:17:34.601034 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.600991    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlpw9" event={"ID":"280fd9e3-6edf-4d5c-a020-125722b9520b","Type":"ContainerStarted","Data":"fb43cba4753e86fefa8c31fe2c63062416410338bde83ef4a632e720794cce3d"}
Sep 09 20:17:34.602642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:34.602611    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf" event={"ID":"0f0ec81a-535d-4ec5-9992-5441e3e8efda","Type":"ContainerStarted","Data":"3650592454c8e9b30380e69021d5e547ce3eeea98318abbb935f9c2737ebf01a"}
Sep 09 20:17:36.610258 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:36.610219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9z5n" event={"ID":"35d90237-edc3-494c-8baf-a91fca26ec9a","Type":"ContainerStarted","Data":"f494c14b2e6b8165af5ab3e61f11b518de24c77c98878bfce48a7d86e888e748"}
Sep 09 20:17:37.537353 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.537279    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jkrc"
Sep 09 20:17:37.614623 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.614585    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbhxq" event={"ID":"57fcc175-91c6-4500-b8e3-4ee251fdc142","Type":"ContainerStarted","Data":"0f408af954e392c90675e1fef92505b84817c90a78ce5f2e798a1a4cb875d0c2"}
Sep 09 20:17:37.616666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.616642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlpw9" event={"ID":"280fd9e3-6edf-4d5c-a020-125722b9520b","Type":"ContainerStarted","Data":"d2ae72b1dbd0a7cefd04709d66b203fbfab9233ec1614877244292cb79560cc3"}
Sep 09 20:17:37.618495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.618475    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9z5n" event={"ID":"35d90237-edc3-494c-8baf-a91fca26ec9a","Type":"ContainerStarted","Data":"cca211fc877005de8b68a2d15f33985524262ff745e729febb640bea6b63c2fb"}
Sep 09 20:17:37.618622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.618607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:37.620057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.620039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf" event={"ID":"0f0ec81a-535d-4ec5-9992-5441e3e8efda","Type":"ContainerStarted","Data":"c4509f39f09d2495a7b184a7c91abbe7e038fe2845597b6140ceceb1deb658aa"}
Sep 09 20:17:37.620215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.620204    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:37.624713 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.624696    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf"
Sep 09 20:17:37.632992 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.632959    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sbhxq" podStartSLOduration=1.610541715 podStartE2EDuration="5.632947556s" totalImagesPullingTime="4.022405841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:37.632199482 +0000 UTC m=+61.859150254" watchObservedRunningTime="2026-09-09 20:17:37.632947556 +0000 UTC m=+61.859898314"
Sep 09 20:17:37.650211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.650158    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-dtlbf" podStartSLOduration=1.7167513479999998 podStartE2EDuration="4.650141152s" totalImagesPullingTime="2.933389804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:37.649417795 +0000 UTC m=+61.876368551" watchObservedRunningTime="2026-09-09 20:17:37.650141152 +0000 UTC m=+61.877091919"
Sep 09 20:17:37.683591 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.683531    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mlpw9" podStartSLOduration=1.895150078 podStartE2EDuration="5.683510265s" totalImagesPullingTime="3.788360187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:17:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:37.68233935 +0000 UTC m=+61.909290114" watchObservedRunningTime="2026-09-09 20:17:37.683510265 +0000 UTC m=+61.910461027"
Sep 09 20:17:37.705731 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.705680    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w9z5n" podStartSLOduration=3.374670808 podStartE2EDuration="5.705659828s" totalImagesPullingTime="2.33098902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:37.705221163 +0000 UTC m=+61.932171924" watchObservedRunningTime="2026-09-09 20:17:37.705659828 +0000 UTC m=+61.932610583"
Sep 09 20:17:37.789942 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.789847    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-shhgj"]
Sep 09 20:17:37.792846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.792830    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.795503 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.795476    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zdwjl\""
Sep 09 20:17:37.795942 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.795906    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 20:17:37.796065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.795945    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 20:17:37.796065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.795981    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 20:17:37.796174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.796098    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 20:17:37.796174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.796111    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 20:17:37.805551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.805531    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-shhgj"]
Sep 09 20:17:37.868426 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.868390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.868426 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.868425    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g22q7\" (UniqueName: \"kubernetes.io/projected/0a0a97b1-8699-49c5-83b4-8a19c2141667-kube-api-access-g22q7\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.868653 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.868511    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a0a97b1-8699-49c5-83b4-8a19c2141667-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.868653 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.868581    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.969780 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.969728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a0a97b1-8699-49c5-83b4-8a19c2141667-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.969919 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.969801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.969919 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.969836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.969919 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.969851    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g22q7\" (UniqueName: \"kubernetes.io/projected/0a0a97b1-8699-49c5-83b4-8a19c2141667-kube-api-access-g22q7\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.970110 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:37.969990    2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 09 20:17:37.970110 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:37.970054    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-tls podName:0a0a97b1-8699-49c5-83b4-8a19c2141667 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:38.470038329 +0000 UTC m=+62.696989068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-shhgj" (UID: "0a0a97b1-8699-49c5-83b4-8a19c2141667") : secret "prometheus-operator-tls" not found
Sep 09 20:17:37.970396 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.970376    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a0a97b1-8699-49c5-83b4-8a19c2141667-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.972485 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.972454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:37.978513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:37.978494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g22q7\" (UniqueName: \"kubernetes.io/projected/0a0a97b1-8699-49c5-83b4-8a19c2141667-kube-api-access-g22q7\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:38.473563 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:38.473524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:38.476113 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:38.476092    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a0a97b1-8699-49c5-83b4-8a19c2141667-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-shhgj\" (UID: \"0a0a97b1-8699-49c5-83b4-8a19c2141667\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:38.702089 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:38.702060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj"
Sep 09 20:17:38.975778 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:38.975746    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-shhgj"]
Sep 09 20:17:38.979203 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:38.979177    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0a97b1_8699_49c5_83b4_8a19c2141667.slice/crio-e2626a2bb7f90cb530e0f2904256698b895dcb32c69b2bd6b08beb73e1787344 WatchSource:0}: Error finding container e2626a2bb7f90cb530e0f2904256698b895dcb32c69b2bd6b08beb73e1787344: Status 404 returned error can't find the container with id e2626a2bb7f90cb530e0f2904256698b895dcb32c69b2bd6b08beb73e1787344
Sep 09 20:17:39.627892 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:39.627853    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj" event={"ID":"0a0a97b1-8699-49c5-83b4-8a19c2141667","Type":"ContainerStarted","Data":"e2626a2bb7f90cb530e0f2904256698b895dcb32c69b2bd6b08beb73e1787344"}
Sep 09 20:17:40.635862 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:40.635829    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj" event={"ID":"0a0a97b1-8699-49c5-83b4-8a19c2141667","Type":"ContainerStarted","Data":"b14887c3266063c666720b6b1a3c6307faceff7e7ce4b108d3c6789aeb28efdc"}
Sep 09 20:17:40.636216 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:40.635900    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj" event={"ID":"0a0a97b1-8699-49c5-83b4-8a19c2141667","Type":"ContainerStarted","Data":"03b81135a506c27b00bcbbb0253d9b45b02313bb20c890a9eaeebf99de8c009c"}
Sep 09 20:17:40.654608 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:40.654562    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-shhgj" podStartSLOduration=2.435682172 podStartE2EDuration="3.65454893s" totalImagesPullingTime="1.218866758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:40.654287518 +0000 UTC m=+64.881238279" watchObservedRunningTime="2026-09-09 20:17:40.65454893 +0000 UTC m=+64.881499691"
Sep 09 20:17:41.630190 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.630156    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-zlmfh"]
Sep 09 20:17:41.633084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.633068    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:17:41.635689 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.635657    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 20:17:41.635805 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.635723    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 20:17:41.635805 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.635728    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xfxv6\""
Sep 09 20:17:41.655409 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.655387    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-zlmfh"]
Sep 09 20:17:41.698821 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.698793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7vcr\" (UniqueName: \"kubernetes.io/projected/c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d-kube-api-access-r7vcr\") pod \"downloads-85d98c998f-zlmfh\" (UID: \"c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d\") " pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:17:41.800091 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.800055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7vcr\" (UniqueName: \"kubernetes.io/projected/c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d-kube-api-access-r7vcr\") pod \"downloads-85d98c998f-zlmfh\" (UID: \"c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d\") " pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:17:41.808721 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.808690    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7vcr\" (UniqueName: \"kubernetes.io/projected/c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d-kube-api-access-r7vcr\") pod \"downloads-85d98c998f-zlmfh\" (UID: \"c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d\") " pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:17:41.942250 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:41.942185    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:17:42.002395 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.002365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:42.006348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.006116    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 20:17:42.015702 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.015676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1ba5c78-7a8b-42f2-8c67-557040a43ef1-metrics-certs\") pod \"network-metrics-daemon-4dq2s\" (UID: \"e1ba5c78-7a8b-42f2-8c67-557040a43ef1\") " pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:42.103059 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.103021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:42.105589 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.105570    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 20:17:42.116120 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.116094    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6d2414e-c9b5-4aa6-a125-8b397fa50821-original-pull-secret\") pod \"global-pull-secret-syncer-lgw5x\" (UID: \"a6d2414e-c9b5-4aa6-a125-8b397fa50821\") " pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:42.118015 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.117993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lgw5x"
Sep 09 20:17:42.141021 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.141001    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wv6m4\""
Sep 09 20:17:42.149336 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.149316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4dq2s"
Sep 09 20:17:42.167870 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.167704    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"]
Sep 09 20:17:42.172009 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.171975    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.177506 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.176787    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 20:17:42.177506 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.177025    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q8tzp\""
Sep 09 20:17:42.177506 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.177231    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 20:17:42.184139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.184118    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"]
Sep 09 20:17:42.204173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.204024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:42.204173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.204045    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"]
Sep 09 20:17:42.204173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.204150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.204806 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.204739    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"]
Sep 09 20:17:42.208567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.207571    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 20:17:42.208567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.207801    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 20:17:42.208567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.208139    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 20:17:42.208567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.208340    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 20:17:42.208567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.208385    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-km8d9\""
Sep 09 20:17:42.217130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.216940    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 20:17:42.219950 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.219909    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qjjn"]
Sep 09 20:17:42.228114 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.228067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqfks\" (UniqueName: \"kubernetes.io/projected/225effb0-8de6-4707-9a78-8425b70af7b2-kube-api-access-kqfks\") pod \"network-check-target-k66nc\" (UID: \"225effb0-8de6-4707-9a78-8425b70af7b2\") " pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:42.229013 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:42.228973    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c8015b_5dc4_4e7f_b9f5_fe9bcafaeb5d.slice/crio-780915ece7f7c0f604a4ce7c65e002da7aa8b5db0c00cc690e89d3d521258839 WatchSource:0}: Error finding container 780915ece7f7c0f604a4ce7c65e002da7aa8b5db0c00cc690e89d3d521258839: Status 404 returned error can't find the container with id 780915ece7f7c0f604a4ce7c65e002da7aa8b5db0c00cc690e89d3d521258839
Sep 09 20:17:42.241831 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.241812    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-zlmfh"]
Sep 09 20:17:42.241992 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.241917    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.244673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.244641    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 20:17:42.245174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.244842    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 20:17:42.245225 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.245205    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lpcq2\""
Sep 09 20:17:42.245447 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.245432    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 20:17:42.304370 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-tls\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304486 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-textfile\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304486 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34520952-484e-4bf0-8d98-c129d47bf85a-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.304486 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/34520952-484e-4bf0-8d98-c129d47bf85a-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.304486 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304457    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-root\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-sys\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304552    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.304695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.304695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.304695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-wtmp\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdvc\" (UniqueName: \"kubernetes.io/projected/05389ef5-0585-4d83-b5c0-2534efecc5fa-kube-api-access-kcdvc\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304731    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2nr\" (UniqueName: \"kubernetes.io/projected/44064230-a2e2-426a-9d5d-6fc643aba0c0-kube-api-access-wk2nr\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304762    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbrh\" (UniqueName: \"kubernetes.io/projected/34520952-484e-4bf0-8d98-c129d47bf85a-kube-api-access-gfbrh\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44064230-a2e2-426a-9d5d-6fc643aba0c0-metrics-client-ca\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05389ef5-0585-4d83-b5c0-2534efecc5fa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.304948 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.304907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.389631 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.389601    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lgw5x"]
Sep 09 20:17:42.392669 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:42.392643    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d2414e_c9b5_4aa6_a125_8b397fa50821.slice/crio-3faa3196207e87b4b86d7def494d72ee0f61fa5de67e073fb79d5c5814f40e82 WatchSource:0}: Error finding container 3faa3196207e87b4b86d7def494d72ee0f61fa5de67e073fb79d5c5814f40e82: Status 404 returned error can't find the container with id 3faa3196207e87b4b86d7def494d72ee0f61fa5de67e073fb79d5c5814f40e82
Sep 09 20:17:42.406004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.405984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbrh\" (UniqueName: \"kubernetes.io/projected/34520952-484e-4bf0-8d98-c129d47bf85a-kube-api-access-gfbrh\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.406078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406011    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44064230-a2e2-426a-9d5d-6fc643aba0c0-metrics-client-ca\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.406078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05389ef5-0585-4d83-b5c0-2534efecc5fa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.406278 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:42.406157    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 09 20:17:42.406278 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:42.406218    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-tls podName:05389ef5-0585-4d83-b5c0-2534efecc5fa nodeName:}" failed. No retries permitted until 2026-09-09 20:17:42.906198384 +0000 UTC m=+67.133149143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-cfxqr" (UID: "05389ef5-0585-4d83-b5c0-2534efecc5fa") : secret "openshift-state-metrics-tls" not found
Sep 09 20:17:42.406441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.406543 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-tls\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406595 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-textfile\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406652 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34520952-484e-4bf0-8d98-c129d47bf85a-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.406704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/34520952-484e-4bf0-8d98-c129d47bf85a-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.406704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44064230-a2e2-426a-9d5d-6fc643aba0c0-metrics-client-ca\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406794 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406794 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-root\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406794 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-sys\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406810    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-root\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05389ef5-0585-4d83-b5c0-2534efecc5fa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406864    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-sys\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.406976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406922    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.406987    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-wtmp\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.407015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdvc\" (UniqueName: \"kubernetes.io/projected/05389ef5-0585-4d83-b5c0-2534efecc5fa-kube-api-access-kcdvc\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.407046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2nr\" (UniqueName: \"kubernetes.io/projected/44064230-a2e2-426a-9d5d-6fc643aba0c0-kube-api-access-wk2nr\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.407189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-textfile\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.407295    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:42.407430    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 09 20:17:42.407473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.407454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-wtmp\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.407794 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:17:42.407492    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-tls podName:34520952-484e-4bf0-8d98-c129d47bf85a nodeName:}" failed. No retries permitted until 2026-09-09 20:17:42.907467447 +0000 UTC m=+67.134418188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-xwzv6" (UID: "34520952-484e-4bf0-8d98-c129d47bf85a") : secret "kube-state-metrics-tls" not found
Sep 09 20:17:42.407879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.407856    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34520952-484e-4bf0-8d98-c129d47bf85a-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.408032 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.408009    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/34520952-484e-4bf0-8d98-c129d47bf85a-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.409186 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.409161    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.409647 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.409622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.409751 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.409670    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44064230-a2e2-426a-9d5d-6fc643aba0c0-node-exporter-tls\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.410141 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.410122    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.414463 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.414438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbrh\" (UniqueName: \"kubernetes.io/projected/34520952-484e-4bf0-8d98-c129d47bf85a-kube-api-access-gfbrh\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.418631 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.418609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdvc\" (UniqueName: \"kubernetes.io/projected/05389ef5-0585-4d83-b5c0-2534efecc5fa-kube-api-access-kcdvc\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.418697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.418668    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2nr\" (UniqueName: \"kubernetes.io/projected/44064230-a2e2-426a-9d5d-6fc643aba0c0-kube-api-access-wk2nr\") pod \"node-exporter-4qjjn\" (UID: \"44064230-a2e2-426a-9d5d-6fc643aba0c0\") " pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.435581 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.431527    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4dq2s"]
Sep 09 20:17:42.448127 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.448103    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c88hn\""
Sep 09 20:17:42.456384 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.456324    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:42.551252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.551224    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qjjn"
Sep 09 20:17:42.582293 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:42.582264    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44064230_a2e2_426a_9d5d_6fc643aba0c0.slice/crio-3eebd518c37ebbe0608e8a440137e20c5a408029a097660462d89fc7c9d94cc0 WatchSource:0}: Error finding container 3eebd518c37ebbe0608e8a440137e20c5a408029a097660462d89fc7c9d94cc0: Status 404 returned error can't find the container with id 3eebd518c37ebbe0608e8a440137e20c5a408029a097660462d89fc7c9d94cc0
Sep 09 20:17:42.643084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.643047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4dq2s" event={"ID":"e1ba5c78-7a8b-42f2-8c67-557040a43ef1","Type":"ContainerStarted","Data":"15845e812ae4af275b06be0a8e9a5631e0bcd38e6815df562f5d78dec28e335e"}
Sep 09 20:17:42.644189 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.644165    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lgw5x" event={"ID":"a6d2414e-c9b5-4aa6-a125-8b397fa50821","Type":"ContainerStarted","Data":"3faa3196207e87b4b86d7def494d72ee0f61fa5de67e073fb79d5c5814f40e82"}
Sep 09 20:17:42.645222 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.645200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-zlmfh" event={"ID":"c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d","Type":"ContainerStarted","Data":"780915ece7f7c0f604a4ce7c65e002da7aa8b5db0c00cc690e89d3d521258839"}
Sep 09 20:17:42.646247 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.646215    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qjjn" event={"ID":"44064230-a2e2-426a-9d5d-6fc643aba0c0","Type":"ContainerStarted","Data":"3eebd518c37ebbe0608e8a440137e20c5a408029a097660462d89fc7c9d94cc0"}
Sep 09 20:17:42.746308 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.746284    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k66nc"]
Sep 09 20:17:42.750235 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:42.750200    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225effb0_8de6_4707_9a78_8425b70af7b2.slice/crio-b4d7949c48e9b52c53cec1ac009e07f37dc143beab8fd9aca203a84dfa9f5b88 WatchSource:0}: Error finding container b4d7949c48e9b52c53cec1ac009e07f37dc143beab8fd9aca203a84dfa9f5b88: Status 404 returned error can't find the container with id b4d7949c48e9b52c53cec1ac009e07f37dc143beab8fd9aca203a84dfa9f5b88
Sep 09 20:17:42.912809 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.912768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:42.913002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.912852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.915796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.915773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34520952-484e-4bf0-8d98-c129d47bf85a-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xwzv6\" (UID: \"34520952-484e-4bf0-8d98-c129d47bf85a\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:42.915945 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:42.915820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05389ef5-0585-4d83-b5c0-2534efecc5fa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-cfxqr\" (UID: \"05389ef5-0585-4d83-b5c0-2534efecc5fa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:43.085002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.084727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"
Sep 09 20:17:43.125584 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.116690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"
Sep 09 20:17:43.286028 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.285105    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:17:43.302672 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.302644    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.307426 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.307354    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:17:43.309964 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.309914    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 20:17:43.310218 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310196    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bv6lw\""
Sep 09 20:17:43.310327 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310309    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 20:17:43.310418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310401    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 20:17:43.310502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310486    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 20:17:43.310586 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310571    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 20:17:43.310672 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310657    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 20:17:43.310755 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310740    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 20:17:43.310849 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310835    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 20:17:43.310973 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.310908    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419116    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419186    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419292    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419315    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-web-config\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419350    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-out\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.421697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.419513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grjdw\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-kube-api-access-grjdw\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.447256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.447157    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr"]
Sep 09 20:17:43.469322 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.469294    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6"]
Sep 09 20:17:43.520274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520376 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520376 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520376 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-out\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grjdw\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-kube-api-access-grjdw\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520623 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520623 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520683 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-web-config\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.520683 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.520664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.522451 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.521984    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.523997 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.522655    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.524980 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.524884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.526686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.526611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.527391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.527338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.528791 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.528745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-web-config\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.528791 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.528769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-out\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.528979 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.528963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.529445 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.529407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.530072 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.529900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.530535 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.530490    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.533521 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.533432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.540837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.540796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grjdw\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-kube-api-access-grjdw\") pod \"alertmanager-main-0\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.617363 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.617096    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:17:43.654016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:43.653954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k66nc" event={"ID":"225effb0-8de6-4707-9a78-8425b70af7b2","Type":"ContainerStarted","Data":"b4d7949c48e9b52c53cec1ac009e07f37dc143beab8fd9aca203a84dfa9f5b88"}
Sep 09 20:17:44.097989 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:44.097904    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05389ef5_0585_4d83_b5c0_2534efecc5fa.slice/crio-82439c63ec7ddaa01999734c4677c27aec11114b5f9d5f3a9b065bf2a5475643 WatchSource:0}: Error finding container 82439c63ec7ddaa01999734c4677c27aec11114b5f9d5f3a9b065bf2a5475643: Status 404 returned error can't find the container with id 82439c63ec7ddaa01999734c4677c27aec11114b5f9d5f3a9b065bf2a5475643
Sep 09 20:17:44.115825 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:44.115779    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34520952_484e_4bf0_8d98_c129d47bf85a.slice/crio-9fdce556f6302223a7d2ff32bb8a32d3c78ec6fe49832f02c4c972dc05c9f4c9 WatchSource:0}: Error finding container 9fdce556f6302223a7d2ff32bb8a32d3c78ec6fe49832f02c4c972dc05c9f4c9: Status 404 returned error can't find the container with id 9fdce556f6302223a7d2ff32bb8a32d3c78ec6fe49832f02c4c972dc05c9f4c9
Sep 09 20:17:44.459976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.459857    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:17:44.463764 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:44.463736    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f660d06_57a1_4b9e_99ec_ef7521df5a7f.slice/crio-12b4c0fc6a6f0711635f808d52ac337a0691533adc34c7c96eddbd8981980103 WatchSource:0}: Error finding container 12b4c0fc6a6f0711635f808d52ac337a0691533adc34c7c96eddbd8981980103: Status 404 returned error can't find the container with id 12b4c0fc6a6f0711635f808d52ac337a0691533adc34c7c96eddbd8981980103
Sep 09 20:17:44.662635 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.662547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr" event={"ID":"05389ef5-0585-4d83-b5c0-2534efecc5fa","Type":"ContainerStarted","Data":"26f07bd2ac4558a3452320ab76ca9b663d655d027bce94ce17c40b9d5d852736"}
Sep 09 20:17:44.662635 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.662625    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr" event={"ID":"05389ef5-0585-4d83-b5c0-2534efecc5fa","Type":"ContainerStarted","Data":"2d2b217f794632974ab6240a7391876fa89dee84e7b13e381d93c0025897b4d6"}
Sep 09 20:17:44.662850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.662653    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr" event={"ID":"05389ef5-0585-4d83-b5c0-2534efecc5fa","Type":"ContainerStarted","Data":"82439c63ec7ddaa01999734c4677c27aec11114b5f9d5f3a9b065bf2a5475643"}
Sep 09 20:17:44.665101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.664982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"12b4c0fc6a6f0711635f808d52ac337a0691533adc34c7c96eddbd8981980103"}
Sep 09 20:17:44.667097 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.667066    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6" event={"ID":"34520952-484e-4bf0-8d98-c129d47bf85a","Type":"ContainerStarted","Data":"9fdce556f6302223a7d2ff32bb8a32d3c78ec6fe49832f02c4c972dc05c9f4c9"}
Sep 09 20:17:44.669474 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.669443    2570 generic.go:356] "Generic (PLEG): container finished" podID="44064230-a2e2-426a-9d5d-6fc643aba0c0" containerID="5463599c30dad814e74ada7470374fd88cc1b48b31244285a4a1316410ca0850" exitCode=0
Sep 09 20:17:44.669617 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.669578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qjjn" event={"ID":"44064230-a2e2-426a-9d5d-6fc643aba0c0","Type":"ContainerDied","Data":"5463599c30dad814e74ada7470374fd88cc1b48b31244285a4a1316410ca0850"}
Sep 09 20:17:44.672089 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.672059    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4dq2s" event={"ID":"e1ba5c78-7a8b-42f2-8c67-557040a43ef1","Type":"ContainerStarted","Data":"0425be60b887b77cee5066c92bad7463ae30a7dfb4b27db799c0110f4b8a6b7c"}
Sep 09 20:17:44.672219 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:44.672109    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4dq2s" event={"ID":"e1ba5c78-7a8b-42f2-8c67-557040a43ef1","Type":"ContainerStarted","Data":"0c35bbadce808ba29c5bc90b2b12ea0b8b4677355d91cbe49cc333099eb5d851"}
Sep 09 20:17:45.365724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.363455    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4dq2s" podStartSLOduration=67.649696704 podStartE2EDuration="1m9.3634307s" totalImagesPullingTime="1.713733996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:44.706118065 +0000 UTC m=+68.933068827" watchObservedRunningTime="2026-09-09 20:17:45.3634307 +0000 UTC m=+69.590381465"
Sep 09 20:17:45.365724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.364143    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-744d9bc747-q66r8"]
Sep 09 20:17:45.367327 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.367303    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.371755 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.371610    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 20:17:45.372185 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.371907    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 20:17:45.372280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.372219    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 20:17:45.373279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.372613    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 20:17:45.373279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.372852    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-effsbs9gfvdkf\""
Sep 09 20:17:45.374089 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.373566    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 20:17:45.374089 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.373791    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-42fmc\""
Sep 09 20:17:45.381219 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.381138    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-744d9bc747-q66r8"]
Sep 09 20:17:45.436866 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.436829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.436881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e51332b8-4013-4a38-920f-bd3682bb1e39-metrics-client-ca\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.436973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-tls\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.437004    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.437070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-grpc-tls\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437130 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.437107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.437149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvg4\" (UniqueName: \"kubernetes.io/projected/e51332b8-4013-4a38-920f-bd3682bb1e39-kube-api-access-zqvg4\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.437458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.437205    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538182 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538134    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e51332b8-4013-4a38-920f-bd3682bb1e39-metrics-client-ca\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-tls\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-grpc-tls\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538620 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.538620 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.538428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvg4\" (UniqueName: \"kubernetes.io/projected/e51332b8-4013-4a38-920f-bd3682bb1e39-kube-api-access-zqvg4\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.541060 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.541011    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e51332b8-4013-4a38-920f-bd3682bb1e39-metrics-client-ca\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.546052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.546024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.547707 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.547661    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-grpc-tls\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.547838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.547819    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvg4\" (UniqueName: \"kubernetes.io/projected/e51332b8-4013-4a38-920f-bd3682bb1e39-kube-api-access-zqvg4\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.549631 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.549590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-tls\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.554009 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.553738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.554362 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.554323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.567594 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.567568    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e51332b8-4013-4a38-920f-bd3682bb1e39-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-744d9bc747-q66r8\" (UID: \"e51332b8-4013-4a38-920f-bd3682bb1e39\") " pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:45.682239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.682157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qjjn" event={"ID":"44064230-a2e2-426a-9d5d-6fc643aba0c0","Type":"ContainerStarted","Data":"141e7dc578845a9ef8d11471e0dc04d829f5462955876a477446cd1994ddc553"}
Sep 09 20:17:45.682239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.682220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qjjn" event={"ID":"44064230-a2e2-426a-9d5d-6fc643aba0c0","Type":"ContainerStarted","Data":"029114a5446b40302981b8f03d81f70bbd66915d82027755db59d1a1bc6dd044"}
Sep 09 20:17:45.686346 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:45.686159    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:17:46.674517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.674451    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qjjn" podStartSLOduration=2.9925676709999998 podStartE2EDuration="4.674424466s" totalImagesPullingTime="1.567164294s" totalInitContainerRuntime="114.692501ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:45.703517968 +0000 UTC m=+69.930468732" watchObservedRunningTime="2026-09-09 20:17:46.674424466 +0000 UTC m=+70.901375227"
Sep 09 20:17:46.675092 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.675065    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"]
Sep 09 20:17:46.678383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.678361    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.680900 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.680878    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 20:17:46.682161 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.681987    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 20:17:46.682558 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.682323    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 20:17:46.682558 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.682354    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q2wdz\""
Sep 09 20:17:46.682558 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.682418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 20:17:46.682558 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.682325    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f4gq8o1g226od\""
Sep 09 20:17:46.688487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.688434    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"]
Sep 09 20:17:46.749804 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.749675    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-secret-metrics-server-tls\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.749804 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.749752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-client-ca-bundle\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.749804 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.749784    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-secret-metrics-server-client-certs\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.750035 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.749813    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27ae7b6a-7e49-4546-89a6-addb283660e3-audit-log\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.750035 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.749881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ae7b6a-7e49-4546-89a6-addb283660e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.750035 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.749920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27ae7b6a-7e49-4546-89a6-addb283660e3-metrics-server-audit-profiles\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.750161 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.750045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmklh\" (UniqueName: \"kubernetes.io/projected/27ae7b6a-7e49-4546-89a6-addb283660e3-kube-api-access-dmklh\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851019 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.850971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-secret-metrics-server-tls\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851019 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-client-ca-bundle\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851221 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-secret-metrics-server-client-certs\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851221 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27ae7b6a-7e49-4546-89a6-addb283660e3-audit-log\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ae7b6a-7e49-4546-89a6-addb283660e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851278    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27ae7b6a-7e49-4546-89a6-addb283660e3-metrics-server-audit-profiles\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851398 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmklh\" (UniqueName: \"kubernetes.io/projected/27ae7b6a-7e49-4546-89a6-addb283660e3-kube-api-access-dmklh\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.851672 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.851635    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27ae7b6a-7e49-4546-89a6-addb283660e3-audit-log\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.852363 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.852335    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ae7b6a-7e49-4546-89a6-addb283660e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.852797 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.852749    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27ae7b6a-7e49-4546-89a6-addb283660e3-metrics-server-audit-profiles\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.853846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.853827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-secret-metrics-server-tls\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.854110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.854092    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-secret-metrics-server-client-certs\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.854163 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.854111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27ae7b6a-7e49-4546-89a6-addb283660e3-client-ca-bundle\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.866836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.866816    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmklh\" (UniqueName: \"kubernetes.io/projected/27ae7b6a-7e49-4546-89a6-addb283660e3-kube-api-access-dmklh\") pod \"metrics-server-7b5df9d7f8-n6dc8\" (UID: \"27ae7b6a-7e49-4546-89a6-addb283660e3\") " pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:46.945634 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.945550    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"]
Sep 09 20:17:46.951460 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.950671    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:46.954328 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.953868    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 20:17:46.954328 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.954087    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4724c\""
Sep 09 20:17:46.961383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.961271    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"]
Sep 09 20:17:46.990439 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:46.990256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:17:47.054052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.053844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a38d07f7-f482-4f15-bce5-4b6dc43d6554-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lf2vf\" (UID: \"a38d07f7-f482-4f15-bce5-4b6dc43d6554\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.054052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.053969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htrmg\" (UniqueName: \"kubernetes.io/projected/a38d07f7-f482-4f15-bce5-4b6dc43d6554-kube-api-access-htrmg\") pod \"monitoring-plugin-85bbbbbf4-lf2vf\" (UID: \"a38d07f7-f482-4f15-bce5-4b6dc43d6554\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.154550 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.154510    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htrmg\" (UniqueName: \"kubernetes.io/projected/a38d07f7-f482-4f15-bce5-4b6dc43d6554-kube-api-access-htrmg\") pod \"monitoring-plugin-85bbbbbf4-lf2vf\" (UID: \"a38d07f7-f482-4f15-bce5-4b6dc43d6554\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.154712 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.154583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a38d07f7-f482-4f15-bce5-4b6dc43d6554-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lf2vf\" (UID: \"a38d07f7-f482-4f15-bce5-4b6dc43d6554\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.157802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.157740    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a38d07f7-f482-4f15-bce5-4b6dc43d6554-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lf2vf\" (UID: \"a38d07f7-f482-4f15-bce5-4b6dc43d6554\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.163848 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.163826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htrmg\" (UniqueName: \"kubernetes.io/projected/a38d07f7-f482-4f15-bce5-4b6dc43d6554-kube-api-access-htrmg\") pod \"monitoring-plugin-85bbbbbf4-lf2vf\" (UID: \"a38d07f7-f482-4f15-bce5-4b6dc43d6554\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.266035 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.265951    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:47.625537 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:47.625503    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w9z5n"
Sep 09 20:17:48.596460 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.595691    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:17:48.600530 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.600506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.606080    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.606595    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.606779    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.606806    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.606958    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607010    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607008    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 20:17:48.607099 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607068    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 20:17:48.607528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607145    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4q1hau8p0r286\""
Sep 09 20:17:48.607528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607272    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 20:17:48.607637 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607597    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dqxl5\""
Sep 09 20:17:48.608094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607789    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 20:17:48.608094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607842    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 20:17:48.608094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.607917    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 20:17:48.608094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.608003    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 20:17:48.613018 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.612794    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 20:17:48.620580 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.620496    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:17:48.670443 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr54s\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-kube-api-access-fr54s\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.670999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.670916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.671431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.671002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.671431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.671178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.671431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.671215    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772514    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.772781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772766    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.773004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.773004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772813    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.773004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.773004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.773004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772883    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.773004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.772903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr54s\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-kube-api-access-fr54s\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775177    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775241    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775476    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.775671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.775510    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.776219 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.776024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.778087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.777063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.778087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.777544    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.778087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.777826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.778289 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.778096    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.780092 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.780067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.781232 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.781205    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.781768 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.781739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.782556 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.782535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.782837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.782814    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.783702 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.783659    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.783702 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.783682    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.783852 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.783769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.784118 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.784098    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.784200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.784123    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.784468 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.784431    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.785772 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.785517    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.785772 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.785729    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr54s\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-kube-api-access-fr54s\") pod \"prometheus-k8s-0\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:48.915158 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:48.914878    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:17:50.064002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.061713    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-744d9bc747-q66r8"]
Sep 09 20:17:50.064002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.063827    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"]
Sep 09 20:17:50.092371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.092161    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:17:50.097347 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:50.097289    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685cb1cd_eb1d_421b_a86b_f442aa9774dd.slice/crio-4fbff6fed702ec1d00229dc41cdbd3ba4dcebf049d1cdf0f27b4d8c1a339d277 WatchSource:0}: Error finding container 4fbff6fed702ec1d00229dc41cdbd3ba4dcebf049d1cdf0f27b4d8c1a339d277: Status 404 returned error can't find the container with id 4fbff6fed702ec1d00229dc41cdbd3ba4dcebf049d1cdf0f27b4d8c1a339d277
Sep 09 20:17:50.117257 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.117080    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"]
Sep 09 20:17:50.122588 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:17:50.122560    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ae7b6a_7e49_4546_89a6_addb283660e3.slice/crio-1ac19ea2e501ddbfa6351ef3bcf3c409ccc7e4a71ad7a57a8bfd41888dba71d6 WatchSource:0}: Error finding container 1ac19ea2e501ddbfa6351ef3bcf3c409ccc7e4a71ad7a57a8bfd41888dba71d6: Status 404 returned error can't find the container with id 1ac19ea2e501ddbfa6351ef3bcf3c409ccc7e4a71ad7a57a8bfd41888dba71d6
Sep 09 20:17:50.705492 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.705445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k66nc" event={"ID":"225effb0-8de6-4707-9a78-8425b70af7b2","Type":"ContainerStarted","Data":"5e1acaec35dd0a08d5056af61c492370383d6b4c45117fd00beeda6bba6b63b0"}
Sep 09 20:17:50.706123 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.706019    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:17:50.708988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.708274    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7" exitCode=0
Sep 09 20:17:50.708988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.708364    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7"}
Sep 09 20:17:50.712459 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.712426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6" event={"ID":"34520952-484e-4bf0-8d98-c129d47bf85a","Type":"ContainerStarted","Data":"e99f843b0d9ea164db080a9ff31df64249a265f1d4e91c5d6b6e013f5dac6ae8"}
Sep 09 20:17:50.715570 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.715539    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6" event={"ID":"34520952-484e-4bf0-8d98-c129d47bf85a","Type":"ContainerStarted","Data":"1d36a4821a8a29f0193478cc62da063b2aff1c9a8071ff218989b7b81d9be0bb"}
Sep 09 20:17:50.715662 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.715599    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6" event={"ID":"34520952-484e-4bf0-8d98-c129d47bf85a","Type":"ContainerStarted","Data":"879f4825ba60773dfdff73ad462395776bbcdeeb83d3594633cb7d6f60243290"}
Sep 09 20:17:50.720955 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.719506    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf" exitCode=0
Sep 09 20:17:50.720955 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.719629    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf"}
Sep 09 20:17:50.720955 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.719713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"4fbff6fed702ec1d00229dc41cdbd3ba4dcebf049d1cdf0f27b4d8c1a339d277"}
Sep 09 20:17:50.723101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.723007    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k66nc" podStartSLOduration=67.72682678 podStartE2EDuration="1m14.722971503s" totalImagesPullingTime="6.996144723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:50.722095675 +0000 UTC m=+74.949046453" watchObservedRunningTime="2026-09-09 20:17:50.722971503 +0000 UTC m=+74.949922266"
Sep 09 20:17:50.724806 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.724780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr" event={"ID":"05389ef5-0585-4d83-b5c0-2534efecc5fa","Type":"ContainerStarted","Data":"cde5caf84a977f817654ec0f568f0e4d0531f0a389930e5dd99b746b455714c0"}
Sep 09 20:17:50.729433 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.729405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lgw5x" event={"ID":"a6d2414e-c9b5-4aa6-a125-8b397fa50821","Type":"ContainerStarted","Data":"fd18f96cb13ee26e0a4e6cd64af918dea0b4388751e913d69f6f86980729811f"}
Sep 09 20:17:50.731055 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.730993    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf" event={"ID":"a38d07f7-f482-4f15-bce5-4b6dc43d6554","Type":"ContainerStarted","Data":"0173aa9606b63412170103acb1d75b22faf35be113197d28d378e93e4e0c12ea"}
Sep 09 20:17:50.733624 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.733594    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8" event={"ID":"27ae7b6a-7e49-4546-89a6-addb283660e3","Type":"ContainerStarted","Data":"1ac19ea2e501ddbfa6351ef3bcf3c409ccc7e4a71ad7a57a8bfd41888dba71d6"}
Sep 09 20:17:50.735139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.735115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"ca273eea0604c73528f5d467e800a7d0651c3b68edf97284ac9b12e03ce5705a"}
Sep 09 20:17:50.743836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.742507    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xwzv6" podStartSLOduration=3.1367245759999998 podStartE2EDuration="8.742491633s" totalImagesPullingTime="5.605767057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:50.741966613 +0000 UTC m=+74.968917375" watchObservedRunningTime="2026-09-09 20:17:50.742491633 +0000 UTC m=+74.969442399"
Sep 09 20:17:50.833493 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.832542    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-cfxqr" podStartSLOduration=3.430672925 podStartE2EDuration="8.832522216s" totalImagesPullingTime="5.401849291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:50.831906594 +0000 UTC m=+75.058857356" watchObservedRunningTime="2026-09-09 20:17:50.832522216 +0000 UTC m=+75.059472977"
Sep 09 20:17:50.850869 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:50.848892    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lgw5x" podStartSLOduration=66.478457424 podStartE2EDuration="1m13.848870976s" totalImagesPullingTime="7.370413552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:50.848595888 +0000 UTC m=+75.075546650" watchObservedRunningTime="2026-09-09 20:17:50.848870976 +0000 UTC m=+75.075821732"
Sep 09 20:17:55.770512 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.769278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8" event={"ID":"27ae7b6a-7e49-4546-89a6-addb283660e3","Type":"ContainerStarted","Data":"12b231b1749033cce9843303de9db3c41554b11517718977c14cf7b0b9777d86"}
Sep 09 20:17:55.773309 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.773281    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"5f70a2968302a88884073e4327f451ed72e746d21624a541d05647dc4da24766"}
Sep 09 20:17:55.773402 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.773363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"7251acd918f45d6ec748691834d1648d2aad5faede28c734539cbd2ef067e2ba"}
Sep 09 20:17:55.773438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.773413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"b46ca093e67c7e6abc2a03c8f509e8e4711c29aca6fd431477ecfac9b278777b"}
Sep 09 20:17:55.778506 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.778476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6"}
Sep 09 20:17:55.778601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.778563    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165"}
Sep 09 20:17:55.778652 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.778607    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1"}
Sep 09 20:17:55.778689 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.778656    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862"}
Sep 09 20:17:55.778724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.778704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f"}
Sep 09 20:17:55.784062 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.784040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924"}
Sep 09 20:17:55.784170 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.784108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f"}
Sep 09 20:17:55.784170 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.784149    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68"}
Sep 09 20:17:55.784274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.784187    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de"}
Sep 09 20:17:55.784274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.784226    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460"}
Sep 09 20:17:55.786363 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.786293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf" event={"ID":"a38d07f7-f482-4f15-bce5-4b6dc43d6554","Type":"ContainerStarted","Data":"e39de863e60f51bf329bcb64ef2df48972723b1d7a626b1256f5716427924bf2"}
Sep 09 20:17:55.786629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.786611    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:55.792830 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.792782    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf"
Sep 09 20:17:55.813034 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.812992    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8" podStartSLOduration=4.770357774 podStartE2EDuration="9.812976865s" totalImagesPullingTime="5.042619091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:55.811703477 +0000 UTC m=+80.038654238" watchObservedRunningTime="2026-09-09 20:17:55.812976865 +0000 UTC m=+80.039927617"
Sep 09 20:17:55.845250 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:55.845186    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lf2vf" podStartSLOduration=4.749247298 podStartE2EDuration="9.845160104s" totalImagesPullingTime="5.095912806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:55.84259951 +0000 UTC m=+80.069550278" watchObservedRunningTime="2026-09-09 20:17:55.845160104 +0000 UTC m=+80.072110872"
Sep 09 20:17:56.795475 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:56.795428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerStarted","Data":"f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55"}
Sep 09 20:17:56.841011 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:56.840943    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.317327717 podStartE2EDuration="8.840900541s" totalImagesPullingTime="4.495994055s" totalInitContainerRuntime="27.578769ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:56.840556665 +0000 UTC m=+81.067507428" watchObservedRunningTime="2026-09-09 20:17:56.840900541 +0000 UTC m=+81.067851303"
Sep 09 20:17:58.915330 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:17:58.915223    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:18:04.836595 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.836546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"a4ebc73237491358f8a7e2965bd4b0d45282e4f6196fb1d9102c55f2a6982d5f"}
Sep 09 20:18:04.837108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.836647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"f69ef977218395022220c6a95687f32c28660c672be25dfb7436da476759c163"}
Sep 09 20:18:04.837108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.836681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" event={"ID":"e51332b8-4013-4a38-920f-bd3682bb1e39","Type":"ContainerStarted","Data":"ccd41d318dfb8b73ef01053f3583368ed4bbdc015b049e0edc2dbad9b213c45c"}
Sep 09 20:18:04.837108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.836877    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:18:04.838648 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.838618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-zlmfh" event={"ID":"c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d","Type":"ContainerStarted","Data":"040ccab7c4140156fc5f58a2a67f71cd7cce89f3d17c7b5fe43cbbc1c48ddbe7"}
Sep 09 20:18:04.838810 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.838788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:18:04.843447 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.843416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerStarted","Data":"0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c"}
Sep 09 20:18:04.846170 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.846153    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8"
Sep 09 20:18:04.855572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.855540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-zlmfh"
Sep 09 20:18:04.868305 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.868260    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-744d9bc747-q66r8" podStartSLOduration=6.33243899 podStartE2EDuration="19.868240665s" totalImagesPullingTime="13.535801675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:18:04.866044721 +0000 UTC m=+89.092995483" watchObservedRunningTime="2026-09-09 20:18:04.868240665 +0000 UTC m=+89.095191429"
Sep 09 20:18:04.906556 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.906501    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.892213225 podStartE2EDuration="21.906478789s" totalImagesPullingTime="17.976826093s" totalInitContainerRuntime="37.439471ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:18:04.90416364 +0000 UTC m=+89.131114424" watchObservedRunningTime="2026-09-09 20:18:04.906478789 +0000 UTC m=+89.133429552"
Sep 09 20:18:04.977949 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:04.977862    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-zlmfh" podStartSLOduration=2.230851351 podStartE2EDuration="23.977838814s" totalImagesPullingTime="21.746987463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:18:04.971547452 +0000 UTC m=+89.198498216" watchObservedRunningTime="2026-09-09 20:18:04.977838814 +0000 UTC m=+89.204789576"
Sep 09 20:18:06.990567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:06.990520    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:18:06.991119 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:06.990637    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:18:22.754401 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:22.754365    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k66nc"
Sep 09 20:18:26.996607 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:26.996580    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:18:27.000305 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:27.000284    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b5df9d7f8-n6dc8"
Sep 09 20:18:48.915845 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:48.915802    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:18:48.984847 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:48.984816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:18:49.057084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:18:49.057047    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:02.696453 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696418    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:19:02.696837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696688    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="alertmanager" containerID="cri-o://40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f" gracePeriod=120
Sep 09 20:19:02.696837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696781    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-metric" containerID="cri-o://4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6" gracePeriod=120
Sep 09 20:19:02.697108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696851    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy" containerID="cri-o://cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165" gracePeriod=120
Sep 09 20:19:02.697108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696847    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-web" containerID="cri-o://b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1" gracePeriod=120
Sep 09 20:19:02.697108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696883    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="config-reloader" containerID="cri-o://c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862" gracePeriod=120
Sep 09 20:19:02.697108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:02.696800    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="prom-label-proxy" containerID="cri-o://0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c" gracePeriod=120
Sep 09 20:19:03.098666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098582    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c" exitCode=0
Sep 09 20:19:03.098666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098607    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6" exitCode=0
Sep 09 20:19:03.098666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098613    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165" exitCode=0
Sep 09 20:19:03.098666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098619    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862" exitCode=0
Sep 09 20:19:03.098666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098625    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f" exitCode=0
Sep 09 20:19:03.098916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c"}
Sep 09 20:19:03.098916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6"}
Sep 09 20:19:03.098916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098757    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165"}
Sep 09 20:19:03.098916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862"}
Sep 09 20:19:03.098916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.098805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f"}
Sep 09 20:19:03.936958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:03.936917    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.063787 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063720    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-tls-assets\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.063787 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063769    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063800    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063821    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-main-db\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063836    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-metrics-client-ca\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063868    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-web-config\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063889    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-out\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063961    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-trusted-ca-bundle\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.063992    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-volume\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.064039    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-main-tls\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.064070    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-cluster-tls-config\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.064113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grjdw\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-kube-api-access-grjdw\") pod \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\" (UID: \"8f660d06-57a1-4b9e-99ec-ef7521df5a7f\") "
Sep 09 20:19:04.064391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.064190    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:19:04.064586 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.064412    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-main-db\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.065263 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.064772    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:04.065263 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.065043    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:04.067309 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.067265    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.067836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.067734    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.068087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.068062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:19:04.068371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.068346    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.068371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.068353    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-out" (OuterVolumeSpecName: "config-out") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:19:04.068546 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.068432    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-volume" (OuterVolumeSpecName: "config-volume") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.068546 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.068514    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.068973 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.068957    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-kube-api-access-grjdw" (OuterVolumeSpecName: "kube-api-access-grjdw") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "kube-api-access-grjdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:19:04.073609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.073585    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.080181 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.080157    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-web-config" (OuterVolumeSpecName: "web-config") pod "8f660d06-57a1-4b9e-99ec-ef7521df5a7f" (UID: "8f660d06-57a1-4b9e-99ec-ef7521df5a7f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:04.105747 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.105721    2570 generic.go:356] "Generic (PLEG): container finished" podID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerID="b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1" exitCode=0
Sep 09 20:19:04.105820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.105755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1"}
Sep 09 20:19:04.105820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.105808    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.105887 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.105823    2570 scope.go:117] "RemoveContainer" containerID="0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c"
Sep 09 20:19:04.105958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.105811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f660d06-57a1-4b9e-99ec-ef7521df5a7f","Type":"ContainerDied","Data":"12b4c0fc6a6f0711635f808d52ac337a0691533adc34c7c96eddbd8981980103"}
Sep 09 20:19:04.113435 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.113419    2570 scope.go:117] "RemoveContainer" containerID="4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6"
Sep 09 20:19:04.120561 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.120543    2570 scope.go:117] "RemoveContainer" containerID="cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165"
Sep 09 20:19:04.128264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.128248    2570 scope.go:117] "RemoveContainer" containerID="b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1"
Sep 09 20:19:04.128689 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.128671    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:19:04.134264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.134244    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:19:04.136748 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.136693    2570 scope.go:117] "RemoveContainer" containerID="c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862"
Sep 09 20:19:04.144744 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.144724    2570 scope.go:117] "RemoveContainer" containerID="40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f"
Sep 09 20:19:04.151821 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.151802    2570 scope.go:117] "RemoveContainer" containerID="d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7"
Sep 09 20:19:04.158882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.158864    2570 scope.go:117] "RemoveContainer" containerID="0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c"
Sep 09 20:19:04.159209 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.159188    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c\": container with ID starting with 0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c not found: ID does not exist" containerID="0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c"
Sep 09 20:19:04.159290 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.159218    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c"} err="failed to get container status \"0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c\": rpc error: code = NotFound desc = could not find container \"0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c\": container with ID starting with 0119b6c3e34f8a855ddfd3bc91632e6bb7d95a1279d18b4c9bbcb4e14907107c not found: ID does not exist"
Sep 09 20:19:04.159290 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.159255    2570 scope.go:117] "RemoveContainer" containerID="4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6"
Sep 09 20:19:04.159540 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.159522    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6\": container with ID starting with 4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6 not found: ID does not exist" containerID="4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6"
Sep 09 20:19:04.159597 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.159549    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6"} err="failed to get container status \"4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6\": rpc error: code = NotFound desc = could not find container \"4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6\": container with ID starting with 4009e0ef734faed604c04cd7d04fe3e02ab0750b0e7076fc1bce78fea32974f6 not found: ID does not exist"
Sep 09 20:19:04.159597 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.159565    2570 scope.go:117] "RemoveContainer" containerID="cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165"
Sep 09 20:19:04.159808 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.159794    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165\": container with ID starting with cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165 not found: ID does not exist" containerID="cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165"
Sep 09 20:19:04.159864 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.159817    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165"} err="failed to get container status \"cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165\": rpc error: code = NotFound desc = could not find container \"cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165\": container with ID starting with cdbd883665065e15c689518b2a467ad9c875df65ad326136ad91d51c0cb79165 not found: ID does not exist"
Sep 09 20:19:04.159864 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.159829    2570 scope.go:117] "RemoveContainer" containerID="b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1"
Sep 09 20:19:04.160093 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.160076    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1\": container with ID starting with b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1 not found: ID does not exist" containerID="b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1"
Sep 09 20:19:04.160157 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160099    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1"} err="failed to get container status \"b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1\": rpc error: code = NotFound desc = could not find container \"b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1\": container with ID starting with b057d54a09c8abac0abcf229a37e1c900fe3c7a4156fb3918a60d11cb4b2c4c1 not found: ID does not exist"
Sep 09 20:19:04.160157 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160118    2570 scope.go:117] "RemoveContainer" containerID="c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862"
Sep 09 20:19:04.160157 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160133    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:19:04.160343 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.160327    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862\": container with ID starting with c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862 not found: ID does not exist" containerID="c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862"
Sep 09 20:19:04.160396 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160345    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862"} err="failed to get container status \"c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862\": rpc error: code = NotFound desc = could not find container \"c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862\": container with ID starting with c97ad1388b02c4676cbf362bd84ef4cf3f8740088b120dd7e183926466f4e862 not found: ID does not exist"
Sep 09 20:19:04.160396 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160360    2570 scope.go:117] "RemoveContainer" containerID="40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f"
Sep 09 20:19:04.160544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160529    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="alertmanager"
Sep 09 20:19:04.160601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160550    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="alertmanager"
Sep 09 20:19:04.160601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160562    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="prom-label-proxy"
Sep 09 20:19:04.160601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160572    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="prom-label-proxy"
Sep 09 20:19:04.160601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160586    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-metric"
Sep 09 20:19:04.160601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160596    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-metric"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.160599    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f\": container with ID starting with 40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f not found: ID does not exist" containerID="40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160612    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="init-config-reloader"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160614    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f"} err="failed to get container status \"40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f\": rpc error: code = NotFound desc = could not find container \"40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f\": container with ID starting with 40032753c330195eb2d0f541a3dd06f0510d80c4cffada10ea63b03c2439fb5f not found: ID does not exist"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160629    2570 scope.go:117] "RemoveContainer" containerID="d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160621    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="init-config-reloader"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160669    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="config-reloader"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160677    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="config-reloader"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160693    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160698    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160716    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-web"
Sep 09 20:19:04.160777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160723    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-web"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160813    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-metric"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160827    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy-web"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160837    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="config-reloader"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160846    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="kube-rbac-proxy"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160856    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="prom-label-proxy"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160863    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" containerName="alertmanager"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:04.160877    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7\": container with ID starting with d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7 not found: ID does not exist" containerID="d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7"
Sep 09 20:19:04.161187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.160898    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7"} err="failed to get container status \"d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7\": rpc error: code = NotFound desc = could not find container \"d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7\": container with ID starting with d9adf95bba5736339263b43f43aa0190723cddd87cc0ffc46166b228400f40a7 not found: ID does not exist"
Sep 09 20:19:04.164261 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164244    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.164837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164818    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-web-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164839    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-out\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164849    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164858    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164866    2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-config-volume\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164875    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-main-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164884    2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-cluster-tls-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164892    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grjdw\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-kube-api-access-grjdw\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.164905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164900    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-tls-assets\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.165222 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164909    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.165222 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164918    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.165222 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.164959    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f660d06-57a1-4b9e-99ec-ef7521df5a7f-metrics-client-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170037    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170048    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170040    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170087    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170143    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170040    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 20:19:04.170248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170037    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bv6lw\""
Sep 09 20:19:04.170631 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.170412    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 20:19:04.176193 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.176176    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 20:19:04.181615 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.181596    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:19:04.265456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2a939eb-cb64-467e-b96d-ec3c72d458ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b2a939eb-cb64-467e-b96d-ec3c72d458ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a939eb-cb64-467e-b96d-ec3c72d458ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265571    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265611    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265632    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2a939eb-cb64-467e-b96d-ec3c72d458ea-config-out\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265961 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265961 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265717    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265961 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hvk\" (UniqueName: \"kubernetes.io/projected/b2a939eb-cb64-467e-b96d-ec3c72d458ea-kube-api-access-42hvk\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265961 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-web-config\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.265961 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.265853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2a939eb-cb64-467e-b96d-ec3c72d458ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.304851 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.304829    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f660d06-57a1-4b9e-99ec-ef7521df5a7f" path="/var/lib/kubelet/pods/8f660d06-57a1-4b9e-99ec-ef7521df5a7f/volumes"
Sep 09 20:19:04.366581 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.366678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.366678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hvk\" (UniqueName: \"kubernetes.io/projected/b2a939eb-cb64-467e-b96d-ec3c72d458ea-kube-api-access-42hvk\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.366678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-web-config\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.366678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2a939eb-cb64-467e-b96d-ec3c72d458ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.366849 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.366849 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2a939eb-cb64-467e-b96d-ec3c72d458ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367011 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.366994    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b2a939eb-cb64-467e-b96d-ec3c72d458ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367076 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a939eb-cb64-467e-b96d-ec3c72d458ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367237 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2a939eb-cb64-467e-b96d-ec3c72d458ea-config-out\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367237 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367579    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b2a939eb-cb64-467e-b96d-ec3c72d458ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.367905 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.367630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2a939eb-cb64-467e-b96d-ec3c72d458ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.368872 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.368846    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a939eb-cb64-467e-b96d-ec3c72d458ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.369896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.369769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2a939eb-cb64-467e-b96d-ec3c72d458ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.369896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.369799    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.370230 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.370206    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.370495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.370475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.370567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.370505    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.370567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.370508    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-web-config\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.370838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.370823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.371248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.371228    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b2a939eb-cb64-467e-b96d-ec3c72d458ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.371360 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.371344    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2a939eb-cb64-467e-b96d-ec3c72d458ea-config-out\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.379429 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.379412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hvk\" (UniqueName: \"kubernetes.io/projected/b2a939eb-cb64-467e-b96d-ec3c72d458ea-kube-api-access-42hvk\") pod \"alertmanager-main-0\" (UID: \"b2a939eb-cb64-467e-b96d-ec3c72d458ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.474545 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.474527    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:19:04.755546 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:04.755520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:19:04.758031 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:19:04.758001    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a939eb_cb64_467e_b96d_ec3c72d458ea.slice/crio-bb258233013eea4150fe04eb2062d9f3a5726140a9229831494f17525a16a425 WatchSource:0}: Error finding container bb258233013eea4150fe04eb2062d9f3a5726140a9229831494f17525a16a425: Status 404 returned error can't find the container with id bb258233013eea4150fe04eb2062d9f3a5726140a9229831494f17525a16a425
Sep 09 20:19:05.112371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:05.112337    2570 generic.go:356] "Generic (PLEG): container finished" podID="b2a939eb-cb64-467e-b96d-ec3c72d458ea" containerID="60558e9cea21072003a771bfcd81adfc474f49ab831c12583265278dca052922" exitCode=0
Sep 09 20:19:05.112729 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:05.112431    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerDied","Data":"60558e9cea21072003a771bfcd81adfc474f49ab831c12583265278dca052922"}
Sep 09 20:19:05.112729 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:05.112500    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"bb258233013eea4150fe04eb2062d9f3a5726140a9229831494f17525a16a425"}
Sep 09 20:19:06.120400 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.120362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"bdc966cb4db7ed08018106158bb15bc3b5199085a5077e57682f28f27c19491c"}
Sep 09 20:19:06.120743 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.120445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"f84cea4ffdfcae383476d6b71d3613fa8736348257e0fa7c7956db3e20aa86e9"}
Sep 09 20:19:06.120743 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.120487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"3cf58a8e84d49f9fc3fed4f05573a5482bb4c0bf64cf974f3b0c868163939dfe"}
Sep 09 20:19:06.120743 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.120528    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"b863e948864315e759e70a3629d431e9960681bce86287e661a3c8dc548c2200"}
Sep 09 20:19:06.120743 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.120565    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"262f2c19f5bc7f77f4a2287c8d872c22d7390dd1ccddebf083776c982a7111d4"}
Sep 09 20:19:06.120743 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.120601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b2a939eb-cb64-467e-b96d-ec3c72d458ea","Type":"ContainerStarted","Data":"445abb51e8d68d2ac52ce428e849a2f1dde960502ff750236ceccfeed8701e1c"}
Sep 09 20:19:06.152123 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.152073    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.13698673 podStartE2EDuration="2.152051044s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.064314ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:19:06.149890243 +0000 UTC m=+150.376841006" watchObservedRunningTime="2026-09-09 20:19:06.152051044 +0000 UTC m=+150.379001806"
Sep 09 20:19:06.694814 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.694772    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"]
Sep 09 20:19:06.700483 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.700451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.703700 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.703673    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 20:19:06.703700 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.703695    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 20:19:06.704046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.704019    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 20:19:06.704143 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.704051    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 20:19:06.704143 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.704085    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 20:19:06.704341 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.704324    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9xzc5\""
Sep 09 20:19:06.710106 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.710082    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 20:19:06.712489 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.712466    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"]
Sep 09 20:19:06.790328 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-telemeter-client-tls\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790501 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790334    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-federate-client-tls\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790501 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdbb4\" (UniqueName: \"kubernetes.io/projected/80114dbb-e308-4cab-9c37-b7b6f0a1739a-kube-api-access-vdbb4\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790501 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-secret-telemeter-client\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790501 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-serving-certs-ca-bundle\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790501 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-metrics-client-ca\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.790658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.790544    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.890984    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-telemeter-client-tls\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891086    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-federate-client-tls\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdbb4\" (UniqueName: \"kubernetes.io/projected/80114dbb-e308-4cab-9c37-b7b6f0a1739a-kube-api-access-vdbb4\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-secret-telemeter-client\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891274    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-serving-certs-ca-bundle\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891360 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891415 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-metrics-client-ca\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.891467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.891423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.892121 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.892096    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-metrics-client-ca\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.892300 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.892102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-serving-certs-ca-bundle\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.892434 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.892412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80114dbb-e308-4cab-9c37-b7b6f0a1739a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.893863 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.893843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-secret-telemeter-client\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.894124 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.894102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-telemeter-client-tls\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.894172 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.894119    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-federate-client-tls\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.894172 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.894132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80114dbb-e308-4cab-9c37-b7b6f0a1739a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:06.903676 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:06.903646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdbb4\" (UniqueName: \"kubernetes.io/projected/80114dbb-e308-4cab-9c37-b7b6f0a1739a-kube-api-access-vdbb4\") pod \"telemeter-client-7b94cbdcf9-c4t4j\" (UID: \"80114dbb-e308-4cab-9c37-b7b6f0a1739a\") " pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:07.004992 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.004882    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:19:07.005275 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.005218    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="prometheus" containerID="cri-o://07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460" gracePeriod=600
Sep 09 20:19:07.005380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.005268    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="config-reloader" containerID="cri-o://02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de" gracePeriod=600
Sep 09 20:19:07.005380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.005244    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy" containerID="cri-o://1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924" gracePeriod=600
Sep 09 20:19:07.005502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.005273    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55" gracePeriod=600
Sep 09 20:19:07.005502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.005264    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-web" containerID="cri-o://00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f" gracePeriod=600
Sep 09 20:19:07.005617 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.005496    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="thanos-sidecar" containerID="cri-o://c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68" gracePeriod=600
Sep 09 20:19:07.015815 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.015788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130010    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924" exitCode=0
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130040    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f" exitCode=0
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130049    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68" exitCode=0
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130060    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de" exitCode=0
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130068    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460" exitCode=0
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924"}
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130242    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f"}
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130281    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68"}
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130317    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de"}
Sep 09 20:19:07.130404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.130351    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460"}
Sep 09 20:19:07.262588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.262516    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:07.310320 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.310297    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j"]
Sep 09 20:19:07.312389 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:19:07.312360    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80114dbb_e308_4cab_9c37_b7b6f0a1739a.slice/crio-00988e6713bb4e9c5e5499447d53851c9f61e1fe0269788aeb9ff23f0e2f9380 WatchSource:0}: Error finding container 00988e6713bb4e9c5e5499447d53851c9f61e1fe0269788aeb9ff23f0e2f9380: Status 404 returned error can't find the container with id 00988e6713bb4e9c5e5499447d53851c9f61e1fe0269788aeb9ff23f0e2f9380
Sep 09 20:19:07.396418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396382    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396421    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-thanos-prometheus-http-client-file\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396440    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-0\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396456    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-trusted-ca-bundle\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396482    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-tls-assets\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396613    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-tls\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396672    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-serving-certs-ca-bundle\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396708    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396746    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config-out\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396789    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-metrics-client-ca\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.396836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-kubelet-serving-ca-bundle\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396871    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-metrics-client-certs\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396908    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-kube-rbac-proxy\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396961    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-1\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.396999    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-web-config\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.397032    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.397073    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr54s\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-kube-api-access-fr54s\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.397110    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-grpc-tls\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.397154    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-2\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.397187    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-db\") pod \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\" (UID: \"685cb1cd-eb1d-421b-a86b-f442aa9774dd\") "
Sep 09 20:19:07.397550 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.397526    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.398230 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.398149    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.398592 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.398300    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.399208 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.399181    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.400131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.399864    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.400131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.399953    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:19:07.400456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.400311    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.400456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.400420    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:19:07.400680 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.400647    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config" (OuterVolumeSpecName: "config") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.400908 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.400866    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.401716 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.401691    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-kube-api-access-fr54s" (OuterVolumeSpecName: "kube-api-access-fr54s") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "kube-api-access-fr54s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:19:07.401810 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.401748    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.401810 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.401788    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config-out" (OuterVolumeSpecName: "config-out") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:19:07.401951 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.401870    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.402028 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.401985    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.402115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.402094    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:19:07.402158 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.402135    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.402360 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.402342    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.402790 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.402771    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.412245 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.412222    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-web-config" (OuterVolumeSpecName: "web-config") pod "685cb1cd-eb1d-421b-a86b-f442aa9774dd" (UID: "685cb1cd-eb1d-421b-a86b-f442aa9774dd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:19:07.498795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498745    2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-kube-rbac-proxy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.498795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498786    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.498795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498797    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-web-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.498795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498807    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.498795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498815    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr54s\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-kube-api-access-fr54s\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498823    2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-grpc-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498831    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498838    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-db\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498846    2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498855    2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498863    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498871    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/685cb1cd-eb1d-421b-a86b-f442aa9774dd-tls-assets\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498879    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498886    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498895    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498904    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/685cb1cd-eb1d-421b-a86b-f442aa9774dd-config-out\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498911    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-metrics-client-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498919    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/685cb1cd-eb1d-421b-a86b-f442aa9774dd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:07.499122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:07.498953    2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/685cb1cd-eb1d-421b-a86b-f442aa9774dd-secret-metrics-client-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:19:08.136764 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.136733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j" event={"ID":"80114dbb-e308-4cab-9c37-b7b6f0a1739a","Type":"ContainerStarted","Data":"00988e6713bb4e9c5e5499447d53851c9f61e1fe0269788aeb9ff23f0e2f9380"}
Sep 09 20:19:08.139887 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.139852    2570 generic.go:356] "Generic (PLEG): container finished" podID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerID="f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55" exitCode=0
Sep 09 20:19:08.140035 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.139947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55"}
Sep 09 20:19:08.140096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.140032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"685cb1cd-eb1d-421b-a86b-f442aa9774dd","Type":"ContainerDied","Data":"4fbff6fed702ec1d00229dc41cdbd3ba4dcebf049d1cdf0f27b4d8c1a339d277"}
Sep 09 20:19:08.140096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.140049    2570 scope.go:117] "RemoveContainer" containerID="f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55"
Sep 09 20:19:08.140096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.139959    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.150831 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.150812    2570 scope.go:117] "RemoveContainer" containerID="1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924"
Sep 09 20:19:08.158037 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.158018    2570 scope.go:117] "RemoveContainer" containerID="00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f"
Sep 09 20:19:08.164962 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.164918    2570 scope.go:117] "RemoveContainer" containerID="c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68"
Sep 09 20:19:08.167102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.167080    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:19:08.172325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.172309    2570 scope.go:117] "RemoveContainer" containerID="02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de"
Sep 09 20:19:08.176719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.176700    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:19:08.179550 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.179526    2570 scope.go:117] "RemoveContainer" containerID="07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460"
Sep 09 20:19:08.186549 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.186534    2570 scope.go:117] "RemoveContainer" containerID="c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf"
Sep 09 20:19:08.193264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.193233    2570 scope.go:117] "RemoveContainer" containerID="f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55"
Sep 09 20:19:08.193532 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.193516    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55\": container with ID starting with f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55 not found: ID does not exist" containerID="f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55"
Sep 09 20:19:08.193581 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.193542    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55"} err="failed to get container status \"f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55\": rpc error: code = NotFound desc = could not find container \"f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55\": container with ID starting with f3dd03e1193fedcc32ed3b98ce998981219a29e469ff619de77352919eb7bd55 not found: ID does not exist"
Sep 09 20:19:08.193581 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.193559    2570 scope.go:117] "RemoveContainer" containerID="1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924"
Sep 09 20:19:08.193842 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.193824    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924\": container with ID starting with 1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924 not found: ID does not exist" containerID="1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924"
Sep 09 20:19:08.193891 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.193847    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924"} err="failed to get container status \"1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924\": rpc error: code = NotFound desc = could not find container \"1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924\": container with ID starting with 1c03f7f0ecb0994ab288cd0e4e833023023f98e4a2dd7cd77a17afe957751924 not found: ID does not exist"
Sep 09 20:19:08.193891 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.193864    2570 scope.go:117] "RemoveContainer" containerID="00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f"
Sep 09 20:19:08.194105 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.194089    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f\": container with ID starting with 00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f not found: ID does not exist" containerID="00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f"
Sep 09 20:19:08.194147 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194107    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f"} err="failed to get container status \"00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f\": rpc error: code = NotFound desc = could not find container \"00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f\": container with ID starting with 00da23adff15af080101f8c9050d9491cb780e9977c94ef909615f167d42099f not found: ID does not exist"
Sep 09 20:19:08.194147 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194119    2570 scope.go:117] "RemoveContainer" containerID="c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68"
Sep 09 20:19:08.194352 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.194336    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68\": container with ID starting with c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68 not found: ID does not exist" containerID="c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68"
Sep 09 20:19:08.194393 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194354    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68"} err="failed to get container status \"c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68\": rpc error: code = NotFound desc = could not find container \"c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68\": container with ID starting with c044813d10358f4a0c05b6685d45a45dc8dec42f0c6076015c3ea2443211bc68 not found: ID does not exist"
Sep 09 20:19:08.194393 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194365    2570 scope.go:117] "RemoveContainer" containerID="02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de"
Sep 09 20:19:08.194568 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.194552    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de\": container with ID starting with 02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de not found: ID does not exist" containerID="02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de"
Sep 09 20:19:08.194608 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194573    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de"} err="failed to get container status \"02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de\": rpc error: code = NotFound desc = could not find container \"02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de\": container with ID starting with 02c4405081a87fc60a41e78d2440eb2096e953189abfa2ab79896978560c80de not found: ID does not exist"
Sep 09 20:19:08.194608 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194587    2570 scope.go:117] "RemoveContainer" containerID="07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460"
Sep 09 20:19:08.194823 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.194802    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460\": container with ID starting with 07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460 not found: ID does not exist" containerID="07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460"
Sep 09 20:19:08.194857 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194829    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460"} err="failed to get container status \"07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460\": rpc error: code = NotFound desc = could not find container \"07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460\": container with ID starting with 07bcdbabd06dc02d3ddbc6b563fda5a13fd3a8cc52e74f08db258c0a24c47460 not found: ID does not exist"
Sep 09 20:19:08.194857 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.194845    2570 scope.go:117] "RemoveContainer" containerID="c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf"
Sep 09 20:19:08.195084 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:19:08.195068    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf\": container with ID starting with c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf not found: ID does not exist" containerID="c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf"
Sep 09 20:19:08.195141 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.195087    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf"} err="failed to get container status \"c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf\": rpc error: code = NotFound desc = could not find container \"c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf\": container with ID starting with c7606ca69bbfff16a86fb0e3da77818271a3999ab8e84e51129b08df349977bf not found: ID does not exist"
Sep 09 20:19:08.211887 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.211866    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:19:08.212269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212240    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="init-config-reloader"
Sep 09 20:19:08.212269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212255    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="init-config-reloader"
Sep 09 20:19:08.212269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212272    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212282    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212302    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-thanos"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212307    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-thanos"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212322    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="thanos-sidecar"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212329    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="thanos-sidecar"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212337    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-web"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212342    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-web"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212349    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="prometheus"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212354    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="prometheus"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212360    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="config-reloader"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212365    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="config-reloader"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212418    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="prometheus"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212426    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="config-reloader"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212434    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-web"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212440    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy-thanos"
Sep 09 20:19:08.212440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212445    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="thanos-sidecar"
Sep 09 20:19:08.213015 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.212451    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" containerName="kube-rbac-proxy"
Sep 09 20:19:08.218708 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.218052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.223476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.223454    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 20:19:08.223719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.223698    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 20:19:08.225397 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.224244    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 20:19:08.225397 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.224482    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 20:19:08.225785 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.225760    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 20:19:08.225895 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.225877    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 20:19:08.226012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.225995    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 20:19:08.226107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.225999    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dqxl5\""
Sep 09 20:19:08.226263 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.226216    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 20:19:08.226355 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.226276    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4q1hau8p0r286\""
Sep 09 20:19:08.226455 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.226440    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 20:19:08.226903 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.226881    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 20:19:08.227363 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.227345    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 20:19:08.227547 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.227530    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 20:19:08.228016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.227997    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 20:19:08.229380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.229359    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 20:19:08.250467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.250444    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:19:08.306022 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.305989    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306160 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306160 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306160 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306141    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306310 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac69531f-5cbb-4e98-bed9-11d944053466-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306310 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306215    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306310 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306323    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306377    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306401    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwwv\" (UniqueName: \"kubernetes.io/projected/ac69531f-5cbb-4e98-bed9-11d944053466-kube-api-access-njwwv\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306430    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac69531f-5cbb-4e98-bed9-11d944053466-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306504    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306584    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306639    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-config\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.306720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.306661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.307861 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.307831    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="685cb1cd-eb1d-421b-a86b-f442aa9774dd" path="/var/lib/kubelet/pods/685cb1cd-eb1d-421b-a86b-f442aa9774dd/volumes"
Sep 09 20:19:08.407540 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407540 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407540 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njwwv\" (UniqueName: \"kubernetes.io/projected/ac69531f-5cbb-4e98-bed9-11d944053466-kube-api-access-njwwv\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac69531f-5cbb-4e98-bed9-11d944053466-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407756    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.407820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-config\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407913    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.407985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.408022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.408077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac69531f-5cbb-4e98-bed9-11d944053466-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408224 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.408116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.408670 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.408246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.409356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.408998    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.409356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.409168    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.409548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.409482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.410088 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.410060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.411095 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.411051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.411516 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.411491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.411683 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.411543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.412143 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.412093    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.412332 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.412305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.413700 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.413656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.413784 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.413698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-config\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414069 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414045    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac69531f-5cbb-4e98-bed9-11d944053466-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414162 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414246 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414477 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac69531f-5cbb-4e98-bed9-11d944053466-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414477 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414431    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414526    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac69531f-5cbb-4e98-bed9-11d944053466-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.414809 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.414782    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac69531f-5cbb-4e98-bed9-11d944053466-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.417736 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.417717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwwv\" (UniqueName: \"kubernetes.io/projected/ac69531f-5cbb-4e98-bed9-11d944053466-kube-api-access-njwwv\") pod \"prometheus-k8s-0\" (UID: \"ac69531f-5cbb-4e98-bed9-11d944053466\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.530633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.530588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:19:08.825131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:08.825103    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 20:19:09.220010 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:19:09.219975    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac69531f_5cbb_4e98_bed9_11d944053466.slice/crio-1e7eb4b844c9ab030b85eb7cfb14337c286e89dbc35be0705480d10367866370 WatchSource:0}: Error finding container 1e7eb4b844c9ab030b85eb7cfb14337c286e89dbc35be0705480d10367866370: Status 404 returned error can't find the container with id 1e7eb4b844c9ab030b85eb7cfb14337c286e89dbc35be0705480d10367866370
Sep 09 20:19:10.152446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.152409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j" event={"ID":"80114dbb-e308-4cab-9c37-b7b6f0a1739a","Type":"ContainerStarted","Data":"e26b56e9151ab0a74f9c67a5af7533c0447660e2a9b8762142a5de63ed2df464"}
Sep 09 20:19:10.152640 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.152471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j" event={"ID":"80114dbb-e308-4cab-9c37-b7b6f0a1739a","Type":"ContainerStarted","Data":"85dec7792943fce28c5e0a54357aa46e6819a570a3aa349483cb8a8ef41303fa"}
Sep 09 20:19:10.152640 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.152498    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j" event={"ID":"80114dbb-e308-4cab-9c37-b7b6f0a1739a","Type":"ContainerStarted","Data":"78fa4d280cdf7e204b2c1231147cf0c6a8df15aa463ad93b25638f7a71c05775"}
Sep 09 20:19:10.153989 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.153964    2570 generic.go:356] "Generic (PLEG): container finished" podID="ac69531f-5cbb-4e98-bed9-11d944053466" containerID="7dccf3644c3b0b2c0c15e453a2f8e068b3d8e2fbe677239d172a2136992cd8f7" exitCode=0
Sep 09 20:19:10.154096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.154001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerDied","Data":"7dccf3644c3b0b2c0c15e453a2f8e068b3d8e2fbe677239d172a2136992cd8f7"}
Sep 09 20:19:10.154096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.154045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"1e7eb4b844c9ab030b85eb7cfb14337c286e89dbc35be0705480d10367866370"}
Sep 09 20:19:10.179360 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:10.179319    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b94cbdcf9-c4t4j" podStartSLOduration=2.244135576 podStartE2EDuration="4.179303419s" totalImagesPullingTime="1.935167843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:19:10.177207626 +0000 UTC m=+154.404158387" watchObservedRunningTime="2026-09-09 20:19:10.179303419 +0000 UTC m=+154.406254182"
Sep 09 20:19:11.162610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.162571    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"83941726a889aff56f6f6d98d56b10c97a819769ae8b9c982ba982f36d88acf7"}
Sep 09 20:19:11.162988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.162637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"41f5c39ae70a91f41e7efdb5a27ed0982bb4cc6e868f4fd752dd319b2f4ec682"}
Sep 09 20:19:11.162988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.162666    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"27ec98133289a3778b7c83a715c1b8937e2f546bafafbaebc0d35a56b6edbfff"}
Sep 09 20:19:11.162988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.162691    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"ba6f13b141f8f6af9d49c22b16e0990b5e90c70cb7722465d319c95ed668731a"}
Sep 09 20:19:11.162988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.162742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"73e53bff7b266202ea2240dadd995cc7d95dcd51fe941abe2407a24fc2671fe1"}
Sep 09 20:19:11.162988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.162766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac69531f-5cbb-4e98-bed9-11d944053466","Type":"ContainerStarted","Data":"c8a3a5f4e89385ffd87d3fbe2ec4f2e545f76cba05ed6bb6be54292e17a28490"}
Sep 09 20:19:11.193288 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:11.193206    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.172108708 podStartE2EDuration="3.193185252s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.076544ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:19:11.19160718 +0000 UTC m=+155.418557978" watchObservedRunningTime="2026-09-09 20:19:11.193185252 +0000 UTC m=+155.420136087"
Sep 09 20:19:13.530863 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:19:13.530836    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:20:08.530958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:20:08.530903    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:20:08.547066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:20:08.547044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:20:09.419307 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:20:09.419281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 20:21:36.202568 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:36.202540    2570 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 20:21:56.930755 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.930716    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"]
Sep 09 20:21:56.933894 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.933878    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:56.938866 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.938847    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 20:21:56.940200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.940180    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zxprq\""
Sep 09 20:21:56.940256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.940180    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 20:21:56.950049 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.950029    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"]
Sep 09 20:21:56.994066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.994032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f8f3c4e-2444-47ab-ae23-79dd466fc084-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ptj4w\" (UID: \"3f8f3c4e-2444-47ab-ae23-79dd466fc084\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:56.994066 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:56.994063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndhr5\" (UniqueName: \"kubernetes.io/projected/3f8f3c4e-2444-47ab-ae23-79dd466fc084-kube-api-access-ndhr5\") pod \"cert-manager-cainjector-559cdd8c87-ptj4w\" (UID: \"3f8f3c4e-2444-47ab-ae23-79dd466fc084\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:57.094663 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.094634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f8f3c4e-2444-47ab-ae23-79dd466fc084-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ptj4w\" (UID: \"3f8f3c4e-2444-47ab-ae23-79dd466fc084\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:57.094663 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.094664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndhr5\" (UniqueName: \"kubernetes.io/projected/3f8f3c4e-2444-47ab-ae23-79dd466fc084-kube-api-access-ndhr5\") pod \"cert-manager-cainjector-559cdd8c87-ptj4w\" (UID: \"3f8f3c4e-2444-47ab-ae23-79dd466fc084\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:57.103674 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.103644    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3f8f3c4e-2444-47ab-ae23-79dd466fc084-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ptj4w\" (UID: \"3f8f3c4e-2444-47ab-ae23-79dd466fc084\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:57.103773 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.103717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndhr5\" (UniqueName: \"kubernetes.io/projected/3f8f3c4e-2444-47ab-ae23-79dd466fc084-kube-api-access-ndhr5\") pod \"cert-manager-cainjector-559cdd8c87-ptj4w\" (UID: \"3f8f3c4e-2444-47ab-ae23-79dd466fc084\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:57.254361 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.254276    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"
Sep 09 20:21:57.525388 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.525364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w"]
Sep 09 20:21:57.527327 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:21:57.527286    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f8f3c4e_2444_47ab_ae23_79dd466fc084.slice/crio-b4e2fc45abd26e4cf80398537c50292423750726800ff58d0b0e4ea59690fc5c WatchSource:0}: Error finding container b4e2fc45abd26e4cf80398537c50292423750726800ff58d0b0e4ea59690fc5c: Status 404 returned error can't find the container with id b4e2fc45abd26e4cf80398537c50292423750726800ff58d0b0e4ea59690fc5c
Sep 09 20:21:57.529174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.529158    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:21:57.835406 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:21:57.835322    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w" event={"ID":"3f8f3c4e-2444-47ab-ae23-79dd466fc084","Type":"ContainerStarted","Data":"b4e2fc45abd26e4cf80398537c50292423750726800ff58d0b0e4ea59690fc5c"}
Sep 09 20:22:00.853725 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:00.853696    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w" event={"ID":"3f8f3c4e-2444-47ab-ae23-79dd466fc084","Type":"ContainerStarted","Data":"34e58b9e42012a1ea5fed2cc19ccf49558e7625a63e3c8ff621c6c6262e70c59"}
Sep 09 20:22:00.871766 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:00.871718    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ptj4w" podStartSLOduration=1.943005215 podStartE2EDuration="4.871703296s" totalImagesPullingTime="2.928698081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:22:00.871062759 +0000 UTC m=+325.098013521" watchObservedRunningTime="2026-09-09 20:22:00.871703296 +0000 UTC m=+325.098654058"
Sep 09 20:22:05.827629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:05.827588    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7hlrp"]
Sep 09 20:22:05.831083 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:05.831067    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:05.833722 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:05.833703    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qjjzb\""
Sep 09 20:22:05.841504 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:05.841483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7hlrp"]
Sep 09 20:22:05.970379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:05.970339    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d15e05a9-c307-42b2-8cf0-6f55c98e77a0-bound-sa-token\") pod \"cert-manager-55b4d954d5-7hlrp\" (UID: \"d15e05a9-c307-42b2-8cf0-6f55c98e77a0\") " pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:05.970558 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:05.970430    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-792nw\" (UniqueName: \"kubernetes.io/projected/d15e05a9-c307-42b2-8cf0-6f55c98e77a0-kube-api-access-792nw\") pod \"cert-manager-55b4d954d5-7hlrp\" (UID: \"d15e05a9-c307-42b2-8cf0-6f55c98e77a0\") " pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:06.071682 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.071643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-792nw\" (UniqueName: \"kubernetes.io/projected/d15e05a9-c307-42b2-8cf0-6f55c98e77a0-kube-api-access-792nw\") pod \"cert-manager-55b4d954d5-7hlrp\" (UID: \"d15e05a9-c307-42b2-8cf0-6f55c98e77a0\") " pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:06.071851 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.071710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d15e05a9-c307-42b2-8cf0-6f55c98e77a0-bound-sa-token\") pod \"cert-manager-55b4d954d5-7hlrp\" (UID: \"d15e05a9-c307-42b2-8cf0-6f55c98e77a0\") " pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:06.080470 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.080410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d15e05a9-c307-42b2-8cf0-6f55c98e77a0-bound-sa-token\") pod \"cert-manager-55b4d954d5-7hlrp\" (UID: \"d15e05a9-c307-42b2-8cf0-6f55c98e77a0\") " pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:06.080470 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.080467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-792nw\" (UniqueName: \"kubernetes.io/projected/d15e05a9-c307-42b2-8cf0-6f55c98e77a0-kube-api-access-792nw\") pod \"cert-manager-55b4d954d5-7hlrp\" (UID: \"d15e05a9-c307-42b2-8cf0-6f55c98e77a0\") " pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:06.140065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.140026    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7hlrp"
Sep 09 20:22:06.412755 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.412733    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7hlrp"]
Sep 09 20:22:06.414861 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:22:06.414838    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd15e05a9_c307_42b2_8cf0_6f55c98e77a0.slice/crio-32167f3c2c65e885e708a45239d0cbb9e856e77ef4a2ff345384c30dc0153309 WatchSource:0}: Error finding container 32167f3c2c65e885e708a45239d0cbb9e856e77ef4a2ff345384c30dc0153309: Status 404 returned error can't find the container with id 32167f3c2c65e885e708a45239d0cbb9e856e77ef4a2ff345384c30dc0153309
Sep 09 20:22:06.881025 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.880989    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7hlrp" event={"ID":"d15e05a9-c307-42b2-8cf0-6f55c98e77a0","Type":"ContainerStarted","Data":"73799463e675a94140b9c97ad625a57b1c9d72298451b2980e48bf74d5df72db"}
Sep 09 20:22:06.881025 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.881031    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7hlrp" event={"ID":"d15e05a9-c307-42b2-8cf0-6f55c98e77a0","Type":"ContainerStarted","Data":"32167f3c2c65e885e708a45239d0cbb9e856e77ef4a2ff345384c30dc0153309"}
Sep 09 20:22:06.907554 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:06.907503    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7hlrp" podStartSLOduration=1.907488169 podStartE2EDuration="1.907488169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:22:06.905662156 +0000 UTC m=+331.132612918" watchObservedRunningTime="2026-09-09 20:22:06.907488169 +0000 UTC m=+331.134438930"
Sep 09 20:22:27.629858 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.629767    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"]
Sep 09 20:22:27.633362 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.633342    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.637833 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.637814    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 20:22:27.637947 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.637833    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 20:22:27.638101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.638086    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p75md\""
Sep 09 20:22:27.638199 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.638183    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 20:22:27.638467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.638454    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 20:22:27.643599 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.643578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.643717 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.643648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-tmp\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.643717 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.643684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-manifests\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.643717 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.643707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.643846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.643778    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-kube-api-access-rr9x6\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.661421 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.661389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"]
Sep 09 20:22:27.744180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.744148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.744368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.744215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-tmp\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.744368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.744244    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-manifests\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.744368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.744267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.744368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.744304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-kube-api-access-rr9x6\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.744700 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.744673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-manifests\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.746652 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.746626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-tmp\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.746776 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.746715    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.746837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.746820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.801942 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.801892    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/7a4eb6f6-b155-4b68-ad9a-14d47b317b6b-kube-api-access-rr9x6\") pod \"opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf\" (UID: \"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:27.943768 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:27.943677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:28.233103 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:28.233030    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"]
Sep 09 20:22:28.236812 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:22:28.236787    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4eb6f6_b155_4b68_ad9a_14d47b317b6b.slice/crio-a00550a699f05175db080dc79f982bfe0f484286a96de5490636b85c6531abeb WatchSource:0}: Error finding container a00550a699f05175db080dc79f982bfe0f484286a96de5490636b85c6531abeb: Status 404 returned error can't find the container with id a00550a699f05175db080dc79f982bfe0f484286a96de5490636b85c6531abeb
Sep 09 20:22:28.970338 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:28.970304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf" event={"ID":"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b","Type":"ContainerStarted","Data":"a00550a699f05175db080dc79f982bfe0f484286a96de5490636b85c6531abeb"}
Sep 09 20:22:31.986889 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:31.986850    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf" event={"ID":"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b","Type":"ContainerStarted","Data":"4d09b0695cc7c186060298707625e50ad0e338e7da827678260d67619168e3aa"}
Sep 09 20:22:32.993002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:32.992969    2570 generic.go:356] "Generic (PLEG): container finished" podID="7a4eb6f6-b155-4b68-ad9a-14d47b317b6b" containerID="4d09b0695cc7c186060298707625e50ad0e338e7da827678260d67619168e3aa" exitCode=0
Sep 09 20:22:32.993382 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:32.993026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf" event={"ID":"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b","Type":"ContainerDied","Data":"4d09b0695cc7c186060298707625e50ad0e338e7da827678260d67619168e3aa"}
Sep 09 20:22:34.000056 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:34.000019    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf" event={"ID":"7a4eb6f6-b155-4b68-ad9a-14d47b317b6b","Type":"ContainerStarted","Data":"cc5a4aa1128ed5c6602ce0b7ac70710e371f5f26c011a95b3769ba9bd78e9a29"}
Sep 09 20:22:34.000426 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:34.000141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:34.024823 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:34.024774    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf" podStartSLOduration=2.307457112 podStartE2EDuration="7.024761328s" totalImagesPullingTime="3.580090876s" totalInitContainerRuntime="1.13721334s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:22:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:22:34.023027244 +0000 UTC m=+358.249978004" watchObservedRunningTime="2026-09-09 20:22:34.024761328 +0000 UTC m=+358.251712160"
Sep 09 20:22:45.006853 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:45.006820    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf"
Sep 09 20:22:58.330156 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.330125    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2g5cc"]
Sep 09 20:22:58.332213 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.332196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:58.335010 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.334991    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 20:22:58.355378 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.355346    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2g5cc"]
Sep 09 20:22:58.390994 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.390962    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9frtd\" (UniqueName: \"kubernetes.io/projected/6b888170-86e1-428e-8f9c-09f0e74cf5de-kube-api-access-9frtd\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:58.391131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.391010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b888170-86e1-428e-8f9c-09f0e74cf5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:58.492322 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.492283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9frtd\" (UniqueName: \"kubernetes.io/projected/6b888170-86e1-428e-8f9c-09f0e74cf5de-kube-api-access-9frtd\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:58.492498 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.492337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b888170-86e1-428e-8f9c-09f0e74cf5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:58.492498 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:22:58.492484    2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 09 20:22:58.492576 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:22:58.492550    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b888170-86e1-428e-8f9c-09f0e74cf5de-tls-certs podName:6b888170-86e1-428e-8f9c-09f0e74cf5de nodeName:}" failed. No retries permitted until 2026-09-09 20:22:58.992534598 +0000 UTC m=+383.219485337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6b888170-86e1-428e-8f9c-09f0e74cf5de-tls-certs") pod "model-serving-api-54d89bd5fc-2g5cc" (UID: "6b888170-86e1-428e-8f9c-09f0e74cf5de") : secret "model-serving-api-tls" not found
Sep 09 20:22:58.501007 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.500978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9frtd\" (UniqueName: \"kubernetes.io/projected/6b888170-86e1-428e-8f9c-09f0e74cf5de-kube-api-access-9frtd\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:58.997732 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:58.997684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b888170-86e1-428e-8f9c-09f0e74cf5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:59.001507 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:59.001469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b888170-86e1-428e-8f9c-09f0e74cf5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-2g5cc\" (UID: \"6b888170-86e1-428e-8f9c-09f0e74cf5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:59.241719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:59.241680    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:22:59.511203 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:22:59.511181    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2g5cc"]
Sep 09 20:22:59.513868 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:22:59.513837    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b888170_86e1_428e_8f9c_09f0e74cf5de.slice/crio-e2b006a577e4c6cd8f8e7718bb170cebe73726eac53c539aae4126603f9845e0 WatchSource:0}: Error finding container e2b006a577e4c6cd8f8e7718bb170cebe73726eac53c539aae4126603f9845e0: Status 404 returned error can't find the container with id e2b006a577e4c6cd8f8e7718bb170cebe73726eac53c539aae4126603f9845e0
Sep 09 20:23:00.123232 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:00.123201    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc" event={"ID":"6b888170-86e1-428e-8f9c-09f0e74cf5de","Type":"ContainerStarted","Data":"e2b006a577e4c6cd8f8e7718bb170cebe73726eac53c539aae4126603f9845e0"}
Sep 09 20:23:03.140750 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:03.140704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc" event={"ID":"6b888170-86e1-428e-8f9c-09f0e74cf5de","Type":"ContainerStarted","Data":"aeecc3eca4886f237e2316970f8a4bedb4f1b9be96768911f548b6fdc2380246"}
Sep 09 20:23:03.141150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:03.140791    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:23:03.158584 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:03.158534    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc" podStartSLOduration=2.551073007 podStartE2EDuration="5.15852019s" totalImagesPullingTime="2.607447183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:23:03.157264306 +0000 UTC m=+387.384215071" watchObservedRunningTime="2026-09-09 20:23:03.15852019 +0000 UTC m=+387.385470951"
Sep 09 20:23:05.177663 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.177628    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"]
Sep 09 20:23:05.181173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.181154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.184385 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.184358    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 20:23:05.184385 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.184378    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 20:23:05.185629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.185608    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 20:23:05.185740 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.185630    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 20:23:05.185740 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.185696    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 20:23:05.192374 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.192356    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-28cn9\""
Sep 09 20:23:05.202621 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.202598    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"]
Sep 09 20:23:05.252128 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.252090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-manager-config\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.252128 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.252128    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-cert\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.252367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.252154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-metrics-cert\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.252367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.252211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qsnx\" (UniqueName: \"kubernetes.io/projected/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-kube-api-access-4qsnx\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.353482 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.353451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-manager-config\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.353482 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.353482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-cert\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.353714 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.353503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-metrics-cert\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.353714 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.353524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qsnx\" (UniqueName: \"kubernetes.io/projected/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-kube-api-access-4qsnx\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.354123 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.354100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-manager-config\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.356211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.356189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-cert\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.356273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.356237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-metrics-cert\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.362084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.362062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qsnx\" (UniqueName: \"kubernetes.io/projected/5f344e90-9d9c-4f52-81b7-d366b86f9c4e-kube-api-access-4qsnx\") pod \"lws-controller-manager-5bc9df88-677vw\" (UID: \"5f344e90-9d9c-4f52-81b7-d366b86f9c4e\") " pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.491218 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.491145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:05.773370 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:05.773346    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"]
Sep 09 20:23:05.775269 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:23:05.775243    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f344e90_9d9c_4f52_81b7_d366b86f9c4e.slice/crio-c00992db47391ffd165cc4d18f3bf939e09737aa94a8e9d2a93b9fc3502d5f01 WatchSource:0}: Error finding container c00992db47391ffd165cc4d18f3bf939e09737aa94a8e9d2a93b9fc3502d5f01: Status 404 returned error can't find the container with id c00992db47391ffd165cc4d18f3bf939e09737aa94a8e9d2a93b9fc3502d5f01
Sep 09 20:23:06.154910 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:06.154880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw" event={"ID":"5f344e90-9d9c-4f52-81b7-d366b86f9c4e","Type":"ContainerStarted","Data":"c00992db47391ffd165cc4d18f3bf939e09737aa94a8e9d2a93b9fc3502d5f01"}
Sep 09 20:23:07.556632 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.556598    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"]
Sep 09 20:23:07.563024 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.563003    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.566355 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.566331    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 20:23:07.567797 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.567776    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qp97b\""
Sep 09 20:23:07.580707 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.580676    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"]
Sep 09 20:23:07.583230 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.583212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"]
Sep 09 20:23:07.583334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.583297    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.591021 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.590998    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 20:23:07.591168 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.591136    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hlhkb\""
Sep 09 20:23:07.614437 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.614408    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"]
Sep 09 20:23:07.675886 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.675849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36bee04e-e724-4561-bc8b-32b7d61ea780-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kb5xm\" (UID: \"36bee04e-e724-4561-bc8b-32b7d61ea780\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.676078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.675917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7sg2\" (UniqueName: \"kubernetes.io/projected/2017f025-fef8-406d-81e9-27483cac3cbc-kube-api-access-j7sg2\") pod \"kserve-controller-manager-d6f4b65b8-2dmsj\" (UID: \"2017f025-fef8-406d-81e9-27483cac3cbc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.676078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.675991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qjkw\" (UniqueName: \"kubernetes.io/projected/36bee04e-e724-4561-bc8b-32b7d61ea780-kube-api-access-4qjkw\") pod \"llmisvc-controller-manager-777c6bd7d5-kb5xm\" (UID: \"36bee04e-e724-4561-bc8b-32b7d61ea780\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.676205 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.676082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2017f025-fef8-406d-81e9-27483cac3cbc-cert\") pod \"kserve-controller-manager-d6f4b65b8-2dmsj\" (UID: \"2017f025-fef8-406d-81e9-27483cac3cbc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.777228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.777194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2017f025-fef8-406d-81e9-27483cac3cbc-cert\") pod \"kserve-controller-manager-d6f4b65b8-2dmsj\" (UID: \"2017f025-fef8-406d-81e9-27483cac3cbc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.777428 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.777279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36bee04e-e724-4561-bc8b-32b7d61ea780-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kb5xm\" (UID: \"36bee04e-e724-4561-bc8b-32b7d61ea780\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.777428 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.777336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7sg2\" (UniqueName: \"kubernetes.io/projected/2017f025-fef8-406d-81e9-27483cac3cbc-kube-api-access-j7sg2\") pod \"kserve-controller-manager-d6f4b65b8-2dmsj\" (UID: \"2017f025-fef8-406d-81e9-27483cac3cbc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.777428 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.777358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qjkw\" (UniqueName: \"kubernetes.io/projected/36bee04e-e724-4561-bc8b-32b7d61ea780-kube-api-access-4qjkw\") pod \"llmisvc-controller-manager-777c6bd7d5-kb5xm\" (UID: \"36bee04e-e724-4561-bc8b-32b7d61ea780\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.780350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.780324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36bee04e-e724-4561-bc8b-32b7d61ea780-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kb5xm\" (UID: \"36bee04e-e724-4561-bc8b-32b7d61ea780\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.780490 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.780464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2017f025-fef8-406d-81e9-27483cac3cbc-cert\") pod \"kserve-controller-manager-d6f4b65b8-2dmsj\" (UID: \"2017f025-fef8-406d-81e9-27483cac3cbc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.795026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.794995    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7sg2\" (UniqueName: \"kubernetes.io/projected/2017f025-fef8-406d-81e9-27483cac3cbc-kube-api-access-j7sg2\") pod \"kserve-controller-manager-d6f4b65b8-2dmsj\" (UID: \"2017f025-fef8-406d-81e9-27483cac3cbc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.801479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.801449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qjkw\" (UniqueName: \"kubernetes.io/projected/36bee04e-e724-4561-bc8b-32b7d61ea780-kube-api-access-4qjkw\") pod \"llmisvc-controller-manager-777c6bd7d5-kb5xm\" (UID: \"36bee04e-e724-4561-bc8b-32b7d61ea780\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:07.875352 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.875319    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:07.894718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:07.894691    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:08.572750 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:08.572717    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"]
Sep 09 20:23:08.574331 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:23:08.574289    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36bee04e_e724_4561_bc8b_32b7d61ea780.slice/crio-65ea9babb78fafd50c157f011246c1c8a805e2da7c966b69392891accc70701f WatchSource:0}: Error finding container 65ea9babb78fafd50c157f011246c1c8a805e2da7c966b69392891accc70701f: Status 404 returned error can't find the container with id 65ea9babb78fafd50c157f011246c1c8a805e2da7c966b69392891accc70701f
Sep 09 20:23:08.576645 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:08.576616    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"]
Sep 09 20:23:08.580014 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:23:08.579997    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2017f025_fef8_406d_81e9_27483cac3cbc.slice/crio-65d672d271cc1c621d8c5ac8301f88d92960c221f4c0f98bcf13465d72dc78a7 WatchSource:0}: Error finding container 65d672d271cc1c621d8c5ac8301f88d92960c221f4c0f98bcf13465d72dc78a7: Status 404 returned error can't find the container with id 65d672d271cc1c621d8c5ac8301f88d92960c221f4c0f98bcf13465d72dc78a7
Sep 09 20:23:09.172284 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:09.172255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm" event={"ID":"36bee04e-e724-4561-bc8b-32b7d61ea780","Type":"ContainerStarted","Data":"65ea9babb78fafd50c157f011246c1c8a805e2da7c966b69392891accc70701f"}
Sep 09 20:23:09.173407 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:09.173381    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj" event={"ID":"2017f025-fef8-406d-81e9-27483cac3cbc","Type":"ContainerStarted","Data":"65d672d271cc1c621d8c5ac8301f88d92960c221f4c0f98bcf13465d72dc78a7"}
Sep 09 20:23:09.174769 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:09.174749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw" event={"ID":"5f344e90-9d9c-4f52-81b7-d366b86f9c4e","Type":"ContainerStarted","Data":"c446101c8801cf791990886a1436dc9bbea47dc10bfbb83ee083758150aefb28"}
Sep 09 20:23:09.174907 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:09.174894    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:09.205908 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:09.205863    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw" podStartSLOduration=1.672872452 podStartE2EDuration="4.205848161s" totalImagesPullingTime="2.532975709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:23:09.204032036 +0000 UTC m=+393.430982797" watchObservedRunningTime="2026-09-09 20:23:09.205848161 +0000 UTC m=+393.432798922"
Sep 09 20:23:12.196059 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:12.196026    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj" event={"ID":"2017f025-fef8-406d-81e9-27483cac3cbc","Type":"ContainerStarted","Data":"74ce888533911c94a5a3a95486e8cf169b15d9ce4110ba61c2d9f69904c33791"}
Sep 09 20:23:12.196499 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:12.196132    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:23:12.197596 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:12.197570    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm" event={"ID":"36bee04e-e724-4561-bc8b-32b7d61ea780","Type":"ContainerStarted","Data":"a58d0e782e7dd4f65c1b1026714d3c07d58c4eb4efcb7dec81c7c49251deb296"}
Sep 09 20:23:12.197718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:12.197705    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:12.231293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:12.231246    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj" podStartSLOduration=2.18017997 podStartE2EDuration="5.231232276s" totalImagesPullingTime="3.051052306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:23:12.229515805 +0000 UTC m=+396.456466566" watchObservedRunningTime="2026-09-09 20:23:12.231232276 +0000 UTC m=+396.458183036"
Sep 09 20:23:12.261380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:12.261341    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm" podStartSLOduration=2.202359058 podStartE2EDuration="5.261329148s" totalImagesPullingTime="3.05897009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:23:12.260906575 +0000 UTC m=+396.487857336" watchObservedRunningTime="2026-09-09 20:23:12.261329148 +0000 UTC m=+396.488279956"
Sep 09 20:23:14.148946 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:14.148906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2g5cc"
Sep 09 20:23:20.186348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:20.186318    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bc9df88-677vw"
Sep 09 20:23:43.204945 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:43.204894    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kb5xm"
Sep 09 20:23:43.208305 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:23:43.208286    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2dmsj"
Sep 09 20:24:29.747049 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.747016    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"]
Sep 09 20:24:29.750364 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.750345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:29.753112 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.753093    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 20:24:29.753198 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.753139    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 20:24:29.754238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.754219    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g6lhz\""
Sep 09 20:24:29.764227 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.764209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjp9\" (UniqueName: \"kubernetes.io/projected/528be5c5-db57-45fe-b18b-233fbc487145-kube-api-access-npjp9\") pod \"limitador-operator-controller-manager-74495c69f8-crnnn\" (UID: \"528be5c5-db57-45fe-b18b-233fbc487145\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:29.771485 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.771467    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"]
Sep 09 20:24:29.864906 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.864884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjp9\" (UniqueName: \"kubernetes.io/projected/528be5c5-db57-45fe-b18b-233fbc487145-kube-api-access-npjp9\") pod \"limitador-operator-controller-manager-74495c69f8-crnnn\" (UID: \"528be5c5-db57-45fe-b18b-233fbc487145\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:29.880793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:29.880763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjp9\" (UniqueName: \"kubernetes.io/projected/528be5c5-db57-45fe-b18b-233fbc487145-kube-api-access-npjp9\") pod \"limitador-operator-controller-manager-74495c69f8-crnnn\" (UID: \"528be5c5-db57-45fe-b18b-233fbc487145\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:30.060334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:30.060256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:30.350298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:30.350277    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"]
Sep 09 20:24:30.353038 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:24:30.353005    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528be5c5_db57_45fe_b18b_233fbc487145.slice/crio-7fe9908e2c10b0d5a420832bfafa05a242268d8a751cadee2c686ccc9a2821ce WatchSource:0}: Error finding container 7fe9908e2c10b0d5a420832bfafa05a242268d8a751cadee2c686ccc9a2821ce: Status 404 returned error can't find the container with id 7fe9908e2c10b0d5a420832bfafa05a242268d8a751cadee2c686ccc9a2821ce
Sep 09 20:24:30.551270 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:30.551239    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn" event={"ID":"528be5c5-db57-45fe-b18b-233fbc487145","Type":"ContainerStarted","Data":"7fe9908e2c10b0d5a420832bfafa05a242268d8a751cadee2c686ccc9a2821ce"}
Sep 09 20:24:33.570065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:33.570032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn" event={"ID":"528be5c5-db57-45fe-b18b-233fbc487145","Type":"ContainerStarted","Data":"66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89"}
Sep 09 20:24:33.570405 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:33.570151    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:33.588537 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:33.588492    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn" podStartSLOduration=1.605672689 podStartE2EDuration="4.58847635s" totalImagesPullingTime="2.982803661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:33.587877104 +0000 UTC m=+477.814827868" watchObservedRunningTime="2026-09-09 20:24:33.58847635 +0000 UTC m=+477.815427111"
Sep 09 20:24:39.275589 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.275558    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"]
Sep 09 20:24:39.278688 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.278672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:39.281675 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.281654    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gftv4\""
Sep 09 20:24:39.281882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.281869    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 20:24:39.291273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.291254    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"]
Sep 09 20:24:39.346210 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.346188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74jw\" (UniqueName: \"kubernetes.io/projected/979628ba-ea6e-4b9f-bb2a-f0032867137d-kube-api-access-z74jw\") pod \"dns-operator-controller-manager-7b84cd7c9c-xwkhl\" (UID: \"979628ba-ea6e-4b9f-bb2a-f0032867137d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:39.447518 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.447486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74jw\" (UniqueName: \"kubernetes.io/projected/979628ba-ea6e-4b9f-bb2a-f0032867137d-kube-api-access-z74jw\") pod \"dns-operator-controller-manager-7b84cd7c9c-xwkhl\" (UID: \"979628ba-ea6e-4b9f-bb2a-f0032867137d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:39.461368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.461348    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74jw\" (UniqueName: \"kubernetes.io/projected/979628ba-ea6e-4b9f-bb2a-f0032867137d-kube-api-access-z74jw\") pod \"dns-operator-controller-manager-7b84cd7c9c-xwkhl\" (UID: \"979628ba-ea6e-4b9f-bb2a-f0032867137d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:39.588841 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.588749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:39.861626 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:39.861608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"]
Sep 09 20:24:39.863942 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:24:39.863904    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979628ba_ea6e_4b9f_bb2a_f0032867137d.slice/crio-ab1d1dbb63206223055ca6f586e6383def75497516102aba323de23c7cf5e0da WatchSource:0}: Error finding container ab1d1dbb63206223055ca6f586e6383def75497516102aba323de23c7cf5e0da: Status 404 returned error can't find the container with id ab1d1dbb63206223055ca6f586e6383def75497516102aba323de23c7cf5e0da
Sep 09 20:24:40.605210 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:40.605174    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl" event={"ID":"979628ba-ea6e-4b9f-bb2a-f0032867137d","Type":"ContainerStarted","Data":"ab1d1dbb63206223055ca6f586e6383def75497516102aba323de23c7cf5e0da"}
Sep 09 20:24:41.611159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:41.611130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl" event={"ID":"979628ba-ea6e-4b9f-bb2a-f0032867137d","Type":"ContainerStarted","Data":"ff557d0817ef916df672dae7315be1c4523230857a39c494dedf3decebce82d4"}
Sep 09 20:24:41.611566 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:41.611314    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:41.660020 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:41.659977    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl" podStartSLOduration=1.016458506 podStartE2EDuration="2.659960079s" totalImagesPullingTime="1.643501573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:41.657621809 +0000 UTC m=+485.884572569" watchObservedRunningTime="2026-09-09 20:24:41.659960079 +0000 UTC m=+485.886910845"
Sep 09 20:24:44.577314 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:44.577283    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:52.618742 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:52.618705    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xwkhl"
Sep 09 20:24:54.826827 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:54.826792    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"]
Sep 09 20:24:54.830367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:54.830351    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:54.833178 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:54.833157    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qngs9\""
Sep 09 20:24:54.844695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:54.844672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"]
Sep 09 20:24:54.990223 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:54.990192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfb8\" (UniqueName: \"kubernetes.io/projected/a06cc550-5af4-4aa6-b1a4-a36077397d6c-kube-api-access-xvfb8\") pod \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:54.990378 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:54.990232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a06cc550-5af4-4aa6-b1a4-a36077397d6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:55.091007 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.090916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfb8\" (UniqueName: \"kubernetes.io/projected/a06cc550-5af4-4aa6-b1a4-a36077397d6c-kube-api-access-xvfb8\") pod \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:55.091007 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.090987    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a06cc550-5af4-4aa6-b1a4-a36077397d6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:55.091356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.091336    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a06cc550-5af4-4aa6-b1a4-a36077397d6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:55.100514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.100488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfb8\" (UniqueName: \"kubernetes.io/projected/a06cc550-5af4-4aa6-b1a4-a36077397d6c-kube-api-access-xvfb8\") pod \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:55.141111 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.141091    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:55.423168 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.422870    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"]
Sep 09 20:24:55.426470 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:24:55.426439    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06cc550_5af4_4aa6_b1a4_a36077397d6c.slice/crio-501b5f566dbecd1ae1f221a471bf6dbef8d71e8b9cf93997ecb917cfa82f213f WatchSource:0}: Error finding container 501b5f566dbecd1ae1f221a471bf6dbef8d71e8b9cf93997ecb917cfa82f213f: Status 404 returned error can't find the container with id 501b5f566dbecd1ae1f221a471bf6dbef8d71e8b9cf93997ecb917cfa82f213f
Sep 09 20:24:55.540701 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.540673    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"]
Sep 09 20:24:55.545691 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.545672    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"]
Sep 09 20:24:55.599163 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.599124    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"]
Sep 09 20:24:55.599391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.599367    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn" podUID="528be5c5-db57-45fe-b18b-233fbc487145" containerName="manager" containerID="cri-o://66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89" gracePeriod=2
Sep 09 20:24:55.606656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.606632    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"]
Sep 09 20:24:55.613942 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.613900    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"]
Sep 09 20:24:55.614525 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.614504    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528be5c5-db57-45fe-b18b-233fbc487145" containerName="manager"
Sep 09 20:24:55.614525 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.614525    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="528be5c5-db57-45fe-b18b-233fbc487145" containerName="manager"
Sep 09 20:24:55.614705 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.614619    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="528be5c5-db57-45fe-b18b-233fbc487145" containerName="manager"
Sep 09 20:24:55.618149 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.618130    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.623209 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:24:55.623180    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-crnnn\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="528be5c5-db57-45fe-b18b-233fbc487145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:55.643670 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.643648    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"]
Sep 09 20:24:55.663275 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.663254    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"]
Sep 09 20:24:55.666547 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.666531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:24:55.686683 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.686664    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"]
Sep 09 20:24:55.696524 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.696497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e301a2b-895c-4ff9-91be-275af203812c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lnw8w\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.696649 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.696627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vskrt\" (UniqueName: \"kubernetes.io/projected/4e301a2b-895c-4ff9-91be-275af203812c-kube-api-access-vskrt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lnw8w\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.718083 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:24:55.718048    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-crnnn\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="528be5c5-db57-45fe-b18b-233fbc487145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:55.798036 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.798000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlmb\" (UniqueName: \"kubernetes.io/projected/e2d0bbef-dbd6-42ee-813c-0982203cfde6-kube-api-access-smlmb\") pod \"limitador-operator-controller-manager-74495c69f8-ntvjv\" (UID: \"e2d0bbef-dbd6-42ee-813c-0982203cfde6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:24:55.798183 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.798050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e301a2b-895c-4ff9-91be-275af203812c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lnw8w\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.798183 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.798138    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vskrt\" (UniqueName: \"kubernetes.io/projected/4e301a2b-895c-4ff9-91be-275af203812c-kube-api-access-vskrt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lnw8w\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.798375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.798358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e301a2b-895c-4ff9-91be-275af203812c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lnw8w\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.807831 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.807800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vskrt\" (UniqueName: \"kubernetes.io/projected/4e301a2b-895c-4ff9-91be-275af203812c-kube-api-access-vskrt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lnw8w\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.833284 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.833266    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:55.836424 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:24:55.836399    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-crnnn\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="528be5c5-db57-45fe-b18b-233fbc487145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:55.899033 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.898992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smlmb\" (UniqueName: \"kubernetes.io/projected/e2d0bbef-dbd6-42ee-813c-0982203cfde6-kube-api-access-smlmb\") pod \"limitador-operator-controller-manager-74495c69f8-ntvjv\" (UID: \"e2d0bbef-dbd6-42ee-813c-0982203cfde6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:24:55.909882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.909851    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlmb\" (UniqueName: \"kubernetes.io/projected/e2d0bbef-dbd6-42ee-813c-0982203cfde6-kube-api-access-smlmb\") pod \"limitador-operator-controller-manager-74495c69f8-ntvjv\" (UID: \"e2d0bbef-dbd6-42ee-813c-0982203cfde6\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:24:55.976596 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.976517    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:55.984730 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.984699    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:24:56.000281 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:55.999910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npjp9\" (UniqueName: \"kubernetes.io/projected/528be5c5-db57-45fe-b18b-233fbc487145-kube-api-access-npjp9\") pod \"528be5c5-db57-45fe-b18b-233fbc487145\" (UID: \"528be5c5-db57-45fe-b18b-233fbc487145\") "
Sep 09 20:24:56.003621 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.003595    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528be5c5-db57-45fe-b18b-233fbc487145-kube-api-access-npjp9" (OuterVolumeSpecName: "kube-api-access-npjp9") pod "528be5c5-db57-45fe-b18b-233fbc487145" (UID: "528be5c5-db57-45fe-b18b-233fbc487145"). InnerVolumeSpecName "kube-api-access-npjp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:24:56.101749 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.101720    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npjp9\" (UniqueName: \"kubernetes.io/projected/528be5c5-db57-45fe-b18b-233fbc487145-kube-api-access-npjp9\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:24:56.271633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.271607    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"]
Sep 09 20:24:56.274902 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:24:56.274873    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e301a2b_895c_4ff9_91be_275af203812c.slice/crio-276bc31a6a7e3f0c188d9f652e5e0984d23bde17901e48a39130ecdf696662e7 WatchSource:0}: Error finding container 276bc31a6a7e3f0c188d9f652e5e0984d23bde17901e48a39130ecdf696662e7: Status 404 returned error can't find the container with id 276bc31a6a7e3f0c188d9f652e5e0984d23bde17901e48a39130ecdf696662e7
Sep 09 20:24:56.276102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.275274    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"]
Sep 09 20:24:56.278284 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:24:56.278252    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d0bbef_dbd6_42ee_813c_0982203cfde6.slice/crio-cd94521e063573f9b009fc73eb814661c67188a888fcc4cb98c2661dd2abc52d WatchSource:0}: Error finding container cd94521e063573f9b009fc73eb814661c67188a888fcc4cb98c2661dd2abc52d: Status 404 returned error can't find the container with id cd94521e063573f9b009fc73eb814661c67188a888fcc4cb98c2661dd2abc52d
Sep 09 20:24:56.305687 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:24:56.305654    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-crnnn\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="528be5c5-db57-45fe-b18b-233fbc487145" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:56.308095 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.308075    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528be5c5-db57-45fe-b18b-233fbc487145" path="/var/lib/kubelet/pods/528be5c5-db57-45fe-b18b-233fbc487145/volumes"
Sep 09 20:24:56.690348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.690307    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w" event={"ID":"4e301a2b-895c-4ff9-91be-275af203812c","Type":"ContainerStarted","Data":"276bc31a6a7e3f0c188d9f652e5e0984d23bde17901e48a39130ecdf696662e7"}
Sep 09 20:24:56.692416 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.692387    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv" event={"ID":"e2d0bbef-dbd6-42ee-813c-0982203cfde6","Type":"ContainerStarted","Data":"3fc490522e94308d446cb4e9678040cf527fdef8ed26bf79f3027170add4a247"}
Sep 09 20:24:56.692568 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.692442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv" event={"ID":"e2d0bbef-dbd6-42ee-813c-0982203cfde6","Type":"ContainerStarted","Data":"cd94521e063573f9b009fc73eb814661c67188a888fcc4cb98c2661dd2abc52d"}
Sep 09 20:24:56.692568 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.692507    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:24:56.694065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.694037    2570 generic.go:356] "Generic (PLEG): container finished" podID="528be5c5-db57-45fe-b18b-233fbc487145" containerID="66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89" exitCode=0
Sep 09 20:24:56.694201 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.694090    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-crnnn"
Sep 09 20:24:56.694201 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.694093    2570 scope.go:117] "RemoveContainer" containerID="66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89"
Sep 09 20:24:56.702683 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.702668    2570 scope.go:117] "RemoveContainer" containerID="66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89"
Sep 09 20:24:56.702996 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:24:56.702974    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89\": container with ID starting with 66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89 not found: ID does not exist" containerID="66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89"
Sep 09 20:24:56.703097 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.702999    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89"} err="failed to get container status \"66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89\": rpc error: code = NotFound desc = could not find container \"66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89\": container with ID starting with 66af6ec1ec181bb969f496b9bd4d8c3f04ad26fa344fde6cdca8c8b99d9aaa89 not found: ID does not exist"
Sep 09 20:24:56.714030 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:56.713982    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv" podStartSLOduration=1.713965416 podStartE2EDuration="1.713965416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:56.712138781 +0000 UTC m=+500.939089544" watchObservedRunningTime="2026-09-09 20:24:56.713965416 +0000 UTC m=+500.940916179"
Sep 09 20:24:59.718684 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:59.718649    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" containerName="manager" containerID="cri-o://197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2" gracePeriod=2
Sep 09 20:24:59.720584 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:59.720557    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w" event={"ID":"4e301a2b-895c-4ff9-91be-275af203812c","Type":"ContainerStarted","Data":"c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8"}
Sep 09 20:24:59.720707 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:59.720661    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:24:59.748677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:59.748633    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w" podStartSLOduration=1.540675368 podStartE2EDuration="4.748619004s" totalImagesPullingTime="3.207943636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:59.747174488 +0000 UTC m=+503.974125249" watchObservedRunningTime="2026-09-09 20:24:59.748619004 +0000 UTC m=+503.975569765"
Sep 09 20:24:59.961483 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:24:59.961462    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:24:59.963779 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:24:59.963753    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:25:00.139026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.138984    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvfb8\" (UniqueName: \"kubernetes.io/projected/a06cc550-5af4-4aa6-b1a4-a36077397d6c-kube-api-access-xvfb8\") pod \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") "
Sep 09 20:25:00.139187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.139087    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a06cc550-5af4-4aa6-b1a4-a36077397d6c-extensions-socket-volume\") pod \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\" (UID: \"a06cc550-5af4-4aa6-b1a4-a36077397d6c\") "
Sep 09 20:25:00.139383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.139350    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a06cc550-5af4-4aa6-b1a4-a36077397d6c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a06cc550-5af4-4aa6-b1a4-a36077397d6c" (UID: "a06cc550-5af4-4aa6-b1a4-a36077397d6c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:25:00.141288 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.141267    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a06cc550-5af4-4aa6-b1a4-a36077397d6c-kube-api-access-xvfb8" (OuterVolumeSpecName: "kube-api-access-xvfb8") pod "a06cc550-5af4-4aa6-b1a4-a36077397d6c" (UID: "a06cc550-5af4-4aa6-b1a4-a36077397d6c"). InnerVolumeSpecName "kube-api-access-xvfb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:25:00.239819 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.239779    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvfb8\" (UniqueName: \"kubernetes.io/projected/a06cc550-5af4-4aa6-b1a4-a36077397d6c-kube-api-access-xvfb8\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:25:00.239819 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.239814    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a06cc550-5af4-4aa6-b1a4-a36077397d6c-extensions-socket-volume\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:25:00.306609 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.306576    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" path="/var/lib/kubelet/pods/a06cc550-5af4-4aa6-b1a4-a36077397d6c/volumes"
Sep 09 20:25:00.731392 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.731355    2570 generic.go:356] "Generic (PLEG): container finished" podID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" containerID="197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2" exitCode=2
Sep 09 20:25:00.731872 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.731417    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:25:00.731872 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.731455    2570 scope.go:117] "RemoveContainer" containerID="197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2"
Sep 09 20:25:00.737140 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:25:00.737111    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-9zldf\" is forbidden: User \"system:node:ip-10-0-143-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-224.ec2.internal' and this object" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-9zldf"
Sep 09 20:25:00.739972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.739959    2570 scope.go:117] "RemoveContainer" containerID="197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2"
Sep 09 20:25:00.740220 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:25:00.740203    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2\": container with ID starting with 197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2 not found: ID does not exist" containerID="197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2"
Sep 09 20:25:00.740263 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:00.740229    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2"} err="failed to get container status \"197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2\": rpc error: code = NotFound desc = could not find container \"197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2\": container with ID starting with 197cc06ee7ac2ad3f3b946b3c77508daf74df9edd16930c6589efa12731f24a2 not found: ID does not exist"
Sep 09 20:25:07.419040 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.419007    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"]
Sep 09 20:25:07.419467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.419226    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w" podUID="4e301a2b-895c-4ff9-91be-275af203812c" containerName="manager" containerID="cri-o://c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8" gracePeriod=10
Sep 09 20:25:07.421138 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.421112    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:25:07.670367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.670312    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:25:07.700415 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.700386    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vskrt\" (UniqueName: \"kubernetes.io/projected/4e301a2b-895c-4ff9-91be-275af203812c-kube-api-access-vskrt\") pod \"4e301a2b-895c-4ff9-91be-275af203812c\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") "
Sep 09 20:25:07.700580 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.700469    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e301a2b-895c-4ff9-91be-275af203812c-extensions-socket-volume\") pod \"4e301a2b-895c-4ff9-91be-275af203812c\" (UID: \"4e301a2b-895c-4ff9-91be-275af203812c\") "
Sep 09 20:25:07.700964 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.700919    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e301a2b-895c-4ff9-91be-275af203812c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e301a2b-895c-4ff9-91be-275af203812c" (UID: "4e301a2b-895c-4ff9-91be-275af203812c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:25:07.702681 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.702658    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e301a2b-895c-4ff9-91be-275af203812c-kube-api-access-vskrt" (OuterVolumeSpecName: "kube-api-access-vskrt") pod "4e301a2b-895c-4ff9-91be-275af203812c" (UID: "4e301a2b-895c-4ff9-91be-275af203812c"). InnerVolumeSpecName "kube-api-access-vskrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:25:07.706414 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.706393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ntvjv"
Sep 09 20:25:07.768704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.768664    2570 generic.go:356] "Generic (PLEG): container finished" podID="4e301a2b-895c-4ff9-91be-275af203812c" containerID="c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8" exitCode=0
Sep 09 20:25:07.768704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.768702    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"
Sep 09 20:25:07.769054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.768766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w" event={"ID":"4e301a2b-895c-4ff9-91be-275af203812c","Type":"ContainerDied","Data":"c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8"}
Sep 09 20:25:07.769054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.768834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w" event={"ID":"4e301a2b-895c-4ff9-91be-275af203812c","Type":"ContainerDied","Data":"276bc31a6a7e3f0c188d9f652e5e0984d23bde17901e48a39130ecdf696662e7"}
Sep 09 20:25:07.769054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.768862    2570 scope.go:117] "RemoveContainer" containerID="c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8"
Sep 09 20:25:07.778353 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.778335    2570 scope.go:117] "RemoveContainer" containerID="c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8"
Sep 09 20:25:07.778682 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:25:07.778662    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8\": container with ID starting with c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8 not found: ID does not exist" containerID="c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8"
Sep 09 20:25:07.778735 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.778692    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8"} err="failed to get container status \"c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8\": rpc error: code = NotFound desc = could not find container \"c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8\": container with ID starting with c7f85f89b67a5ac0394b9f3ed53cad5263032df3922a13cc4e0af081292154d8 not found: ID does not exist"
Sep 09 20:25:07.798844 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.798820    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"]
Sep 09 20:25:07.801396 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.801378    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vskrt\" (UniqueName: \"kubernetes.io/projected/4e301a2b-895c-4ff9-91be-275af203812c-kube-api-access-vskrt\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:25:07.801508 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.801400    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e301a2b-895c-4ff9-91be-275af203812c-extensions-socket-volume\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:25:07.805372 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:07.805353    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lnw8w"]
Sep 09 20:25:08.306572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:08.306539    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e301a2b-895c-4ff9-91be-275af203812c" path="/var/lib/kubelet/pods/4e301a2b-895c-4ff9-91be-275af203812c/volumes"
Sep 09 20:25:23.864947 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.864898    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"]
Sep 09 20:25:23.865551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.865372    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" containerName="manager"
Sep 09 20:25:23.865551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.865386    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" containerName="manager"
Sep 09 20:25:23.865551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.865400    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e301a2b-895c-4ff9-91be-275af203812c" containerName="manager"
Sep 09 20:25:23.865551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.865408    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e301a2b-895c-4ff9-91be-275af203812c" containerName="manager"
Sep 09 20:25:23.865551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.865489    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e301a2b-895c-4ff9-91be-275af203812c" containerName="manager"
Sep 09 20:25:23.865551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.865501    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06cc550-5af4-4aa6-b1a4-a36077397d6c" containerName="manager"
Sep 09 20:25:23.868354 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.868334    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.871348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.871329    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kxmnx\""
Sep 09 20:25:23.871696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.871682    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 20:25:23.871972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.871958    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 20:25:23.872238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.872221    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 20:25:23.886398 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.886371    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"]
Sep 09 20:25:23.947202 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8882585-c8d8-4858-8926-8f137546bf8e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947319 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947319 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947413 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8882585-c8d8-4858-8926-8f137546bf8e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947413 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfb54\" (UniqueName: \"kubernetes.io/projected/c8882585-c8d8-4858-8926-8f137546bf8e-kube-api-access-vfb54\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947413 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8882585-c8d8-4858-8926-8f137546bf8e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:23.947528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:23.947494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048019 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.047991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8882585-c8d8-4858-8926-8f137546bf8e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfb54\" (UniqueName: \"kubernetes.io/projected/c8882585-c8d8-4858-8926-8f137546bf8e-kube-api-access-vfb54\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048111    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8882585-c8d8-4858-8926-8f137546bf8e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048301 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8882585-c8d8-4858-8926-8f137546bf8e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048499 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048387    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048499 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048389    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048499 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048457    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048607 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.048866 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.048847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8882585-c8d8-4858-8926-8f137546bf8e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.050528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.050504    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8882585-c8d8-4858-8926-8f137546bf8e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.050789 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.050767    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8882585-c8d8-4858-8926-8f137546bf8e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.056183 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.056159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8882585-c8d8-4858-8926-8f137546bf8e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.056298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.056281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfb54\" (UniqueName: \"kubernetes.io/projected/c8882585-c8d8-4858-8926-8f137546bf8e-kube-api-access-vfb54\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fstnx\" (UID: \"c8882585-c8d8-4858-8926-8f137546bf8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.178736 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.178686    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:24.462484 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.462459    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"]
Sep 09 20:25:24.463790 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:25:24.463760    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8882585_c8d8_4858_8926_8f137546bf8e.slice/crio-82240353403e32abfb32d7ec68229c755f13518afea07114f0201f50a1f96ee4 WatchSource:0}: Error finding container 82240353403e32abfb32d7ec68229c755f13518afea07114f0201f50a1f96ee4: Status 404 returned error can't find the container with id 82240353403e32abfb32d7ec68229c755f13518afea07114f0201f50a1f96ee4
Sep 09 20:25:24.854261 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:24.854226    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" event={"ID":"c8882585-c8d8-4858-8926-8f137546bf8e","Type":"ContainerStarted","Data":"82240353403e32abfb32d7ec68229c755f13518afea07114f0201f50a1f96ee4"}
Sep 09 20:25:27.076997 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:27.076957    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:25:27.077344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:27.077049    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:25:27.077344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:27.077101    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:25:27.875148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:27.875118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" event={"ID":"c8882585-c8d8-4858-8926-8f137546bf8e","Type":"ContainerStarted","Data":"6091228300bfb60d6674d1168b5e4301f18b050b565dcbfb6db695b37b03694b"}
Sep 09 20:25:27.898279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:27.898223    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podStartSLOduration=2.28784769 podStartE2EDuration="4.898207272s" totalImagesPullingTime="2.610359582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:25:27.897508454 +0000 UTC m=+532.124459216" watchObservedRunningTime="2026-09-09 20:25:27.898207272 +0000 UTC m=+532.125158032"
Sep 09 20:25:28.179031 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:28.178964    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:28.183485 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:28.183465    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:28.880002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:28.879977    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:28.880788 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:28.880769    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:25:38.032781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.032750    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:38.036540 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.036518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.039371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.039350    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xl2tw\""
Sep 09 20:25:38.039467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.039401    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 20:25:38.046466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.046447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:38.128090 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.128058    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:38.165356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.165331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-config-file\") pod \"limitador-limitador-8588749977-s465z\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") " pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.165505 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.165368    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qzqf\" (UniqueName: \"kubernetes.io/projected/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-kube-api-access-9qzqf\") pod \"limitador-limitador-8588749977-s465z\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") " pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.266208 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.266175    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-config-file\") pod \"limitador-limitador-8588749977-s465z\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") " pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.266383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.266216    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qzqf\" (UniqueName: \"kubernetes.io/projected/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-kube-api-access-9qzqf\") pod \"limitador-limitador-8588749977-s465z\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") " pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.266832 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.266808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-config-file\") pod \"limitador-limitador-8588749977-s465z\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") " pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.275121 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.275097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qzqf\" (UniqueName: \"kubernetes.io/projected/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-kube-api-access-9qzqf\") pod \"limitador-limitador-8588749977-s465z\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") " pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.347027 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.346973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:38.617211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.617186    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:38.618907 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:25:38.618873    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25a5c57_0b22_4038_993b_63ecc9e9b6d1.slice/crio-2bdfb51948cf54e40d7791322f0d0cabe07621c0909768f46c20aeb608aee275 WatchSource:0}: Error finding container 2bdfb51948cf54e40d7791322f0d0cabe07621c0909768f46c20aeb608aee275: Status 404 returned error can't find the container with id 2bdfb51948cf54e40d7791322f0d0cabe07621c0909768f46c20aeb608aee275
Sep 09 20:25:38.931442 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:38.931356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s465z" event={"ID":"e25a5c57-0b22-4038-993b-63ecc9e9b6d1","Type":"ContainerStarted","Data":"2bdfb51948cf54e40d7791322f0d0cabe07621c0909768f46c20aeb608aee275"}
Sep 09 20:25:39.938509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:39.938480    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s465z" event={"ID":"e25a5c57-0b22-4038-993b-63ecc9e9b6d1","Type":"ContainerStarted","Data":"c5969ecba5901c2f5ca5e21759cdcd8ba184415f768e63fef04fde230e903de8"}
Sep 09 20:25:39.938868 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:39.938626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:39.955560 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:39.955488    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-s465z" podStartSLOduration=0.874961893 podStartE2EDuration="1.955474767s" totalImagesPullingTime="1.080512874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:25:39.954891304 +0000 UTC m=+544.181842067" watchObservedRunningTime="2026-09-09 20:25:39.955474767 +0000 UTC m=+544.182425562"
Sep 09 20:25:50.950799 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:50.950765    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:51.526073 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:51.526036    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:51.526264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:51.526210    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-s465z" podUID="e25a5c57-0b22-4038-993b-63ecc9e9b6d1" containerName="limitador" containerID="cri-o://c5969ecba5901c2f5ca5e21759cdcd8ba184415f768e63fef04fde230e903de8" gracePeriod=30
Sep 09 20:25:52.007368 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.007337    2570 generic.go:356] "Generic (PLEG): container finished" podID="e25a5c57-0b22-4038-993b-63ecc9e9b6d1" containerID="c5969ecba5901c2f5ca5e21759cdcd8ba184415f768e63fef04fde230e903de8" exitCode=0
Sep 09 20:25:52.007736 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.007409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s465z" event={"ID":"e25a5c57-0b22-4038-993b-63ecc9e9b6d1","Type":"ContainerDied","Data":"c5969ecba5901c2f5ca5e21759cdcd8ba184415f768e63fef04fde230e903de8"}
Sep 09 20:25:52.468724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.468693    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:52.499782 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.499700    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qzqf\" (UniqueName: \"kubernetes.io/projected/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-kube-api-access-9qzqf\") pod \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") "
Sep 09 20:25:52.499915 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.499820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-config-file\") pod \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\" (UID: \"e25a5c57-0b22-4038-993b-63ecc9e9b6d1\") "
Sep 09 20:25:52.500245 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.500219    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-config-file" (OuterVolumeSpecName: "config-file") pod "e25a5c57-0b22-4038-993b-63ecc9e9b6d1" (UID: "e25a5c57-0b22-4038-993b-63ecc9e9b6d1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:25:52.501761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.501736    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-kube-api-access-9qzqf" (OuterVolumeSpecName: "kube-api-access-9qzqf") pod "e25a5c57-0b22-4038-993b-63ecc9e9b6d1" (UID: "e25a5c57-0b22-4038-993b-63ecc9e9b6d1"). InnerVolumeSpecName "kube-api-access-9qzqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:25:52.600429 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.600403    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qzqf\" (UniqueName: \"kubernetes.io/projected/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-kube-api-access-9qzqf\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:25:52.600555 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:52.600432    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e25a5c57-0b22-4038-993b-63ecc9e9b6d1-config-file\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:25:53.013096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:53.013009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s465z" event={"ID":"e25a5c57-0b22-4038-993b-63ecc9e9b6d1","Type":"ContainerDied","Data":"2bdfb51948cf54e40d7791322f0d0cabe07621c0909768f46c20aeb608aee275"}
Sep 09 20:25:53.013096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:53.013050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s465z"
Sep 09 20:25:53.013096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:53.013077    2570 scope.go:117] "RemoveContainer" containerID="c5969ecba5901c2f5ca5e21759cdcd8ba184415f768e63fef04fde230e903de8"
Sep 09 20:25:53.034309 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:53.034286    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:53.038542 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:53.038523    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s465z"]
Sep 09 20:25:54.306637 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:54.306595    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25a5c57-0b22-4038-993b-63ecc9e9b6d1" path="/var/lib/kubelet/pods/e25a5c57-0b22-4038-993b-63ecc9e9b6d1/volumes"
Sep 09 20:25:55.902094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.902055    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"]
Sep 09 20:25:55.902685 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.902670    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25a5c57-0b22-4038-993b-63ecc9e9b6d1" containerName="limitador"
Sep 09 20:25:55.902744 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.902690    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25a5c57-0b22-4038-993b-63ecc9e9b6d1" containerName="limitador"
Sep 09 20:25:55.902814 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.902804    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25a5c57-0b22-4038-993b-63ecc9e9b6d1" containerName="limitador"
Sep 09 20:25:55.905996 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.905976    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:55.909645 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.909625    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 20:25:55.910625 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.910595    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 20:25:55.910740 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.910597    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-44fw4\""
Sep 09 20:25:55.910740 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.910650    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 20:25:55.917007 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.916982    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"]
Sep 09 20:25:55.930260 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.930230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f-data\") pod \"postgres-69fb4594cf-hjhgq\" (UID: \"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:55.930362 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:55.930300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndd76\" (UniqueName: \"kubernetes.io/projected/c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f-kube-api-access-ndd76\") pod \"postgres-69fb4594cf-hjhgq\" (UID: \"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:56.030958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:56.030912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f-data\") pod \"postgres-69fb4594cf-hjhgq\" (UID: \"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:56.031142 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:56.030998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndd76\" (UniqueName: \"kubernetes.io/projected/c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f-kube-api-access-ndd76\") pod \"postgres-69fb4594cf-hjhgq\" (UID: \"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:56.031308 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:56.031278    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f-data\") pod \"postgres-69fb4594cf-hjhgq\" (UID: \"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:56.040031 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:56.040001    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndd76\" (UniqueName: \"kubernetes.io/projected/c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f-kube-api-access-ndd76\") pod \"postgres-69fb4594cf-hjhgq\" (UID: \"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:56.216647 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:56.216566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:25:56.491801 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:56.491777    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"]
Sep 09 20:25:56.494558 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:25:56.494532    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc299fedb_8dfb_4b7e_afa6_ef7cd7cdb32f.slice/crio-937ba2da1a6f63e69ba1f862f8dca8b66dc64f32457cb451f7f98f87f6021cc7 WatchSource:0}: Error finding container 937ba2da1a6f63e69ba1f862f8dca8b66dc64f32457cb451f7f98f87f6021cc7: Status 404 returned error can't find the container with id 937ba2da1a6f63e69ba1f862f8dca8b66dc64f32457cb451f7f98f87f6021cc7
Sep 09 20:25:57.036188 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:25:57.036143    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq" event={"ID":"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f","Type":"ContainerStarted","Data":"937ba2da1a6f63e69ba1f862f8dca8b66dc64f32457cb451f7f98f87f6021cc7"}
Sep 09 20:26:02.072027 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:02.071990    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq" event={"ID":"c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f","Type":"ContainerStarted","Data":"4f041afb4ec275b8148b3fc9453fb8b0a64c340fe5c2720c5b71ca7de605966b"}
Sep 09 20:26:02.072387 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:02.072125    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:26:02.088848 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:02.088805    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq" podStartSLOduration=2.263230304 podStartE2EDuration="7.088791902s" totalImagesPullingTime="4.825561598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:26:02.086967949 +0000 UTC m=+566.313918712" watchObservedRunningTime="2026-09-09 20:26:02.088791902 +0000 UTC m=+566.315742662"
Sep 09 20:26:08.106512 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:08.106481    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hjhgq"
Sep 09 20:26:15.929623 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.929585    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65cf998749-ftv6q"]
Sep 09 20:26:15.935438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.935416    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:15.937748 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.937720    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 20:26:15.937857 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.937775    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nk8km\""
Sep 09 20:26:15.938672 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.938657    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 20:26:15.938738 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.938689    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 20:26:15.943532 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:15.943476    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65cf998749-ftv6q"]
Sep 09 20:26:16.013452 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.013420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.013629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.013461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrhv\" (UniqueName: \"kubernetes.io/projected/d8b0138b-ae4f-46a5-b805-d216327e202d-kube-api-access-vdrhv\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.013629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.013574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-webhook-cert\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.114204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.114169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.114204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.114206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrhv\" (UniqueName: \"kubernetes.io/projected/d8b0138b-ae4f-46a5-b805-d216327e202d-kube-api-access-vdrhv\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.114455 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.114256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-webhook-cert\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.114455 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:16.114330    2570 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 20:26:16.114455 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:16.114424    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs podName:d8b0138b-ae4f-46a5-b805-d216327e202d nodeName:}" failed. No retries permitted until 2026-09-09 20:26:16.61440275 +0000 UTC m=+580.841353497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs") pod "maas-controller-65cf998749-ftv6q" (UID: "d8b0138b-ae4f-46a5-b805-d216327e202d") : secret "maas-controller-metrics-tls" not found
Sep 09 20:26:16.117379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.117354    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-webhook-cert\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.118808 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.118785    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c4df4974f-kpv2w"]
Sep 09 20:26:16.123183 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.123167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.124869 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.124852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrhv\" (UniqueName: \"kubernetes.io/projected/d8b0138b-ae4f-46a5-b805-d216327e202d-kube-api-access-vdrhv\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.133336 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.133317    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4df4974f-kpv2w"]
Sep 09 20:26:16.215323 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.215242    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh95m\" (UniqueName: \"kubernetes.io/projected/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-kube-api-access-bh95m\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.215323 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.215287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-webhook-cert\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.215323 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.215318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-metrics-certs\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.316408 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.316376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-metrics-certs\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.316569 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.316460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh95m\" (UniqueName: \"kubernetes.io/projected/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-kube-api-access-bh95m\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.316569 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.316485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-webhook-cert\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.319107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.319083    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-metrics-certs\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.319217 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.319167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-webhook-cert\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.329128 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.329096    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh95m\" (UniqueName: \"kubernetes.io/projected/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-kube-api-access-bh95m\") pod \"maas-controller-c4df4974f-kpv2w\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") " pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.443110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.443082    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:16.620523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.620486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.623094 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.623074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs\") pod \"maas-controller-65cf998749-ftv6q\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") " pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:16.721093 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.720758    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4df4974f-kpv2w"]
Sep 09 20:26:16.725445 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:26:16.725423    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3e5707_0d3b_4391_b533_fe6bbabaf5ac.slice/crio-09ca246fe4c77208ed6a5bce9b3e261776a2cbf9a274f99aa336fdbd04bbf6cb WatchSource:0}: Error finding container 09ca246fe4c77208ed6a5bce9b3e261776a2cbf9a274f99aa336fdbd04bbf6cb: Status 404 returned error can't find the container with id 09ca246fe4c77208ed6a5bce9b3e261776a2cbf9a274f99aa336fdbd04bbf6cb
Sep 09 20:26:16.847783 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:16.847684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:17.124072 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:17.124040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65cf998749-ftv6q"]
Sep 09 20:26:17.128867 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:26:17.128838    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b0138b_ae4f_46a5_b805_d216327e202d.slice/crio-00ec38b7c558b9c3b339ffd6160139e529bcf2262042fddfdc9431bfb8c307b0 WatchSource:0}: Error finding container 00ec38b7c558b9c3b339ffd6160139e529bcf2262042fddfdc9431bfb8c307b0: Status 404 returned error can't find the container with id 00ec38b7c558b9c3b339ffd6160139e529bcf2262042fddfdc9431bfb8c307b0
Sep 09 20:26:17.150084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:17.150054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65cf998749-ftv6q" event={"ID":"d8b0138b-ae4f-46a5-b805-d216327e202d","Type":"ContainerStarted","Data":"00ec38b7c558b9c3b339ffd6160139e529bcf2262042fddfdc9431bfb8c307b0"}
Sep 09 20:26:17.151160 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:17.151136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-kpv2w" event={"ID":"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac","Type":"ContainerStarted","Data":"09ca246fe4c77208ed6a5bce9b3e261776a2cbf9a274f99aa336fdbd04bbf6cb"}
Sep 09 20:26:20.172970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:20.172916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65cf998749-ftv6q" event={"ID":"d8b0138b-ae4f-46a5-b805-d216327e202d","Type":"ContainerStarted","Data":"cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114"}
Sep 09 20:26:20.173427 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:20.172987    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:20.174454 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:20.174429    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-kpv2w" event={"ID":"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac","Type":"ContainerStarted","Data":"0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18"}
Sep 09 20:26:20.174582 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:20.174476    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:20.191116 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:20.191070    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65cf998749-ftv6q" podStartSLOduration=2.9368183329999997 podStartE2EDuration="5.191050417s" totalImagesPullingTime="2.254232084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:26:20.190475104 +0000 UTC m=+584.417425876" watchObservedRunningTime="2026-09-09 20:26:20.191050417 +0000 UTC m=+584.418001179"
Sep 09 20:26:20.208102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:20.208060    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c4df4974f-kpv2w" podStartSLOduration=1.556526604 podStartE2EDuration="4.208044752s" totalImagesPullingTime="2.651518148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:26:20.206126322 +0000 UTC m=+584.433077084" watchObservedRunningTime="2026-09-09 20:26:20.208044752 +0000 UTC m=+584.434995727"
Sep 09 20:26:31.181986 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.181922    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:26:31.182372 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.182084    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:31.248214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.248182    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65cf998749-ftv6q"]
Sep 09 20:26:31.248455 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.248407    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65cf998749-ftv6q" podUID="d8b0138b-ae4f-46a5-b805-d216327e202d" containerName="manager" containerID="cri-o://cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114" gracePeriod=30
Sep 09 20:26:31.558390 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.558366    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:31.660252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.660223    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-webhook-cert\") pod \"d8b0138b-ae4f-46a5-b805-d216327e202d\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") "
Sep 09 20:26:31.660390 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.660293    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs\") pod \"d8b0138b-ae4f-46a5-b805-d216327e202d\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") "
Sep 09 20:26:31.660390 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.660345    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdrhv\" (UniqueName: \"kubernetes.io/projected/d8b0138b-ae4f-46a5-b805-d216327e202d-kube-api-access-vdrhv\") pod \"d8b0138b-ae4f-46a5-b805-d216327e202d\" (UID: \"d8b0138b-ae4f-46a5-b805-d216327e202d\") "
Sep 09 20:26:31.662645 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.662612    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d8b0138b-ae4f-46a5-b805-d216327e202d" (UID: "d8b0138b-ae4f-46a5-b805-d216327e202d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:26:31.662645 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.662627    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d8b0138b-ae4f-46a5-b805-d216327e202d" (UID: "d8b0138b-ae4f-46a5-b805-d216327e202d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:26:31.662795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.662623    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b0138b-ae4f-46a5-b805-d216327e202d-kube-api-access-vdrhv" (OuterVolumeSpecName: "kube-api-access-vdrhv") pod "d8b0138b-ae4f-46a5-b805-d216327e202d" (UID: "d8b0138b-ae4f-46a5-b805-d216327e202d"). InnerVolumeSpecName "kube-api-access-vdrhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:26:31.761281 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.761220    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:26:31.761281 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.761244    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdrhv\" (UniqueName: \"kubernetes.io/projected/d8b0138b-ae4f-46a5-b805-d216327e202d-kube-api-access-vdrhv\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:26:31.761281 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:31.761254    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8b0138b-ae4f-46a5-b805-d216327e202d-webhook-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:26:32.251545 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.251509    2570 generic.go:356] "Generic (PLEG): container finished" podID="d8b0138b-ae4f-46a5-b805-d216327e202d" containerID="cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114" exitCode=0
Sep 09 20:26:32.251545 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.251546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65cf998749-ftv6q" event={"ID":"d8b0138b-ae4f-46a5-b805-d216327e202d","Type":"ContainerDied","Data":"cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114"}
Sep 09 20:26:32.252129 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.251559    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65cf998749-ftv6q"
Sep 09 20:26:32.252129 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.251587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65cf998749-ftv6q" event={"ID":"d8b0138b-ae4f-46a5-b805-d216327e202d","Type":"ContainerDied","Data":"00ec38b7c558b9c3b339ffd6160139e529bcf2262042fddfdc9431bfb8c307b0"}
Sep 09 20:26:32.252129 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.251608    2570 scope.go:117] "RemoveContainer" containerID="cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114"
Sep 09 20:26:32.261401 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.261384    2570 scope.go:117] "RemoveContainer" containerID="cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114"
Sep 09 20:26:32.261653 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:32.261631    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114\": container with ID starting with cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114 not found: ID does not exist" containerID="cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114"
Sep 09 20:26:32.261711 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.261661    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114"} err="failed to get container status \"cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114\": rpc error: code = NotFound desc = could not find container \"cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114\": container with ID starting with cb8d123d1be639b586afb60c4aa7fc1db67402cc8f748d511f06245bd91c6114 not found: ID does not exist"
Sep 09 20:26:32.273627 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.273607    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65cf998749-ftv6q"]
Sep 09 20:26:32.276952 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.276912    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65cf998749-ftv6q"]
Sep 09 20:26:32.306272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:32.306244    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b0138b-ae4f-46a5-b805-d216327e202d" path="/var/lib/kubelet/pods/d8b0138b-ae4f-46a5-b805-d216327e202d/volumes"
Sep 09 20:26:51.735026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.734992    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"]
Sep 09 20:26:51.735523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.735462    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b0138b-ae4f-46a5-b805-d216327e202d" containerName="manager"
Sep 09 20:26:51.735523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.735477    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b0138b-ae4f-46a5-b805-d216327e202d" containerName="manager"
Sep 09 20:26:51.735628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.735563    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b0138b-ae4f-46a5-b805-d216327e202d" containerName="manager"
Sep 09 20:26:51.747542 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.747517    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.751600 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.751580    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 20:26:51.752194 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.752169    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 20:26:51.752506 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.752489    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bbx7f\""
Sep 09 20:26:51.754303 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.754271    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"]
Sep 09 20:26:51.831916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.831889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.831916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.831920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86279ee-b392-4f39-8986-1df60360909c-openshift-service-ca\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.832107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.832016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzss\" (UniqueName: \"kubernetes.io/projected/a86279ee-b392-4f39-8986-1df60360909c-kube-api-access-hbzss\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.832107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.832032    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.932787 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.932758    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzss\" (UniqueName: \"kubernetes.io/projected/a86279ee-b392-4f39-8986-1df60360909c-kube-api-access-hbzss\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.932787 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.932787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.932991 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.932836    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.932991 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:51.932918    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 09 20:26:51.932991 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:51.932964    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 09 20:26:51.933154 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.932997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86279ee-b392-4f39-8986-1df60360909c-openshift-service-ca\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.933154 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:51.933006    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls podName:a86279ee-b392-4f39-8986-1df60360909c nodeName:}" failed. No retries permitted until 2026-09-09 20:26:52.432987692 +0000 UTC m=+616.659938432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls") pod "maas-api-5c576cc74c-vr8b4" (UID: "a86279ee-b392-4f39-8986-1df60360909c") : secret "maas-api-serving-cert" not found
Sep 09 20:26:51.933154 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:26:51.933035    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs podName:a86279ee-b392-4f39-8986-1df60360909c nodeName:}" failed. No retries permitted until 2026-09-09 20:26:52.433022267 +0000 UTC m=+616.659973009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs") pod "maas-api-5c576cc74c-vr8b4" (UID: "a86279ee-b392-4f39-8986-1df60360909c") : secret "maas-api-metrics-tls" not found
Sep 09 20:26:51.933585 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.933564    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86279ee-b392-4f39-8986-1df60360909c-openshift-service-ca\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:51.942282 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:51.942258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzss\" (UniqueName: \"kubernetes.io/projected/a86279ee-b392-4f39-8986-1df60360909c-kube-api-access-hbzss\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:52.437145 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:52.437105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:52.437320 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:52.437228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:52.439734 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:52.439708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:52.439854 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:52.439739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs\") pod \"maas-api-5c576cc74c-vr8b4\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") " pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:52.659510 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:52.659479    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:52.934671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:52.934644    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"]
Sep 09 20:26:52.936900 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:26:52.936873    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86279ee_b392_4f39_8986_1df60360909c.slice/crio-12c3c1b269eebbda07b5d19d081b128b0a422c516c17eef1edb30acc0564c96a WatchSource:0}: Error finding container 12c3c1b269eebbda07b5d19d081b128b0a422c516c17eef1edb30acc0564c96a: Status 404 returned error can't find the container with id 12c3c1b269eebbda07b5d19d081b128b0a422c516c17eef1edb30acc0564c96a
Sep 09 20:26:53.366220 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:53.366186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4" event={"ID":"a86279ee-b392-4f39-8986-1df60360909c","Type":"ContainerStarted","Data":"12c3c1b269eebbda07b5d19d081b128b0a422c516c17eef1edb30acc0564c96a"}
Sep 09 20:26:55.379519 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:55.379487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4" event={"ID":"a86279ee-b392-4f39-8986-1df60360909c","Type":"ContainerStarted","Data":"a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f"}
Sep 09 20:26:55.379963 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:55.379608    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:26:55.398674 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:55.395564    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4" podStartSLOduration=2.6801645240000003 podStartE2EDuration="4.395548039s" totalImagesPullingTime="1.715383515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:26:55.394743262 +0000 UTC m=+619.621694025" watchObservedRunningTime="2026-09-09 20:26:55.395548039 +0000 UTC m=+619.622498801"
Sep 09 20:26:59.922120 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:59.922071    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fstnx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 20:26:59.922565 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:26:59.922153    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podUID="c8882585-c8d8-4858-8926-8f137546bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 20:27:01.390685 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:01.390648    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:27:02.420838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:02.420807    2570 generic.go:356] "Generic (PLEG): container finished" podID="c8882585-c8d8-4858-8926-8f137546bf8e" containerID="6091228300bfb60d6674d1168b5e4301f18b050b565dcbfb6db695b37b03694b" exitCode=0
Sep 09 20:27:02.421250 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:02.420877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" event={"ID":"c8882585-c8d8-4858-8926-8f137546bf8e","Type":"ContainerDied","Data":"6091228300bfb60d6674d1168b5e4301f18b050b565dcbfb6db695b37b03694b"}
Sep 09 20:27:02.421348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:02.421333    2570 scope.go:117] "RemoveContainer" containerID="6091228300bfb60d6674d1168b5e4301f18b050b565dcbfb6db695b37b03694b"
Sep 09 20:27:02.422384 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:02.422358    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:27:02.422437 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:02.422424    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:27:02.422476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:02.422462    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:27:03.428495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:03.428462    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" event={"ID":"c8882585-c8d8-4858-8926-8f137546bf8e","Type":"ContainerStarted","Data":"3329bfe7a0fe99f0871822accc4f3f9137f186dd5f616fef9ec788d6943f9853"}
Sep 09 20:27:04.179875 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:04.179831    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:27:04.180102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:04.180076    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fstnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 09 20:27:04.180203 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:04.180129    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podUID="c8882585-c8d8-4858-8926-8f137546bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 09 20:27:05.179836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:05.179799    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fstnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 09 20:27:05.180234 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:05.179869    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podUID="c8882585-c8d8-4858-8926-8f137546bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 09 20:27:06.179571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:06.179535    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fstnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 09 20:27:06.179732 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:06.179593    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podUID="c8882585-c8d8-4858-8926-8f137546bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 09 20:27:07.180085 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:07.180048    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fstnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 09 20:27:07.180467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:07.180106    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podUID="c8882585-c8d8-4858-8926-8f137546bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 09 20:27:08.179353 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:08.179309    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fstnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 09 20:27:08.179531 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:08.179377    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx" podUID="c8882585-c8d8-4858-8926-8f137546bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 09 20:27:09.183189 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:09.183157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:27:09.183633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:09.183448    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:27:09.184046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:09.184024    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx"
Sep 09 20:27:23.036126 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.036092    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"]
Sep 09 20:27:23.041802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.041785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.045457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.045432    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xlwgd\""
Sep 09 20:27:23.045457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.045446    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 20:27:23.045636 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.045465    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 20:27:23.045697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.045660    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 20:27:23.052489 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.052468    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"]
Sep 09 20:27:23.228288 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.228254    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.228446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.228327    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.228446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.228367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.228446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.228388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13c477c-ab6a-4e23-8cba-728f7b951a35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.228446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.228415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4zz\" (UniqueName: \"kubernetes.io/projected/e13c477c-ab6a-4e23-8cba-728f7b951a35-kube-api-access-kj4zz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.228584 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.228451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.329588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.329588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.329802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.329802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13c477c-ab6a-4e23-8cba-728f7b951a35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.329802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4zz\" (UniqueName: \"kubernetes.io/projected/e13c477c-ab6a-4e23-8cba-728f7b951a35-kube-api-access-kj4zz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.329802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.330043 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.329993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.330043 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.330007    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.330164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.330141    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.331999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.331980    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e13c477c-ab6a-4e23-8cba-728f7b951a35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.332384 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.332365    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e13c477c-ab6a-4e23-8cba-728f7b951a35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.338246 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.338224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4zz\" (UniqueName: \"kubernetes.io/projected/e13c477c-ab6a-4e23-8cba-728f7b951a35-kube-api-access-kj4zz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb\" (UID: \"e13c477c-ab6a-4e23-8cba-728f7b951a35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.355102 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.355075    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:23.629110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.629019    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"]
Sep 09 20:27:23.631532 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:27:23.631500    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13c477c_ab6a_4e23_8cba_728f7b951a35.slice/crio-7615fad78c99a9658345cefa30d0f4acc66b627eb66dba8274a9e72066ff994d WatchSource:0}: Error finding container 7615fad78c99a9658345cefa30d0f4acc66b627eb66dba8274a9e72066ff994d: Status 404 returned error can't find the container with id 7615fad78c99a9658345cefa30d0f4acc66b627eb66dba8274a9e72066ff994d
Sep 09 20:27:23.633093 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:23.633071    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:27:24.537028 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:24.536970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb" event={"ID":"e13c477c-ab6a-4e23-8cba-728f7b951a35","Type":"ContainerStarted","Data":"7615fad78c99a9658345cefa30d0f4acc66b627eb66dba8274a9e72066ff994d"}
Sep 09 20:27:25.543295 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:25.543259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb" event={"ID":"e13c477c-ab6a-4e23-8cba-728f7b951a35","Type":"ContainerStarted","Data":"5e5e442dc2d1cf0dc126af06b9ef6eb9e19373cf15905cd0548c0a94a14d9d3f"}
Sep 09 20:27:25.561906 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:25.561853    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb" podStartSLOduration=1.445416252 podStartE2EDuration="2.561837695s" totalImagesPullingTime="1.116421443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:27:25.559551938 +0000 UTC m=+649.786502711" watchObservedRunningTime="2026-09-09 20:27:25.561837695 +0000 UTC m=+649.788788505"
Sep 09 20:27:27.540986 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.540949    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"]
Sep 09 20:27:27.546557 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.546535    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.549020 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.548995    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 20:27:27.556448 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.556426    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"]
Sep 09 20:27:27.566979 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.566952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.567228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.567011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.567228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.567058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.567228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.567084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/899c3999-bd92-490f-845c-0fd816e97d02-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.567228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.567153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8kv\" (UniqueName: \"kubernetes.io/projected/899c3999-bd92-490f-845c-0fd816e97d02-kube-api-access-sx8kv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.567228 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.567183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.668502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668471    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.668502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668501    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/899c3999-bd92-490f-845c-0fd816e97d02-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.668686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8kv\" (UniqueName: \"kubernetes.io/projected/899c3999-bd92-490f-845c-0fd816e97d02-kube-api-access-sx8kv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.668686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.668686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.668686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.669032 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.668910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.669113 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.669051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.669113 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.669070    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.671002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.670979    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/899c3999-bd92-490f-845c-0fd816e97d02-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.671149 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.671127    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/899c3999-bd92-490f-845c-0fd816e97d02-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.676502 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.676480    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8kv\" (UniqueName: \"kubernetes.io/projected/899c3999-bd92-490f-845c-0fd816e97d02-kube-api-access-sx8kv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n95k8\" (UID: \"899c3999-bd92-490f-845c-0fd816e97d02\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:27.859975 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:27.859921    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:28.134475 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:28.134442    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"]
Sep 09 20:27:28.135536 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:27:28.135508    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899c3999_bd92_490f_845c_0fd816e97d02.slice/crio-612fdf309ea66879ca93d91568e484e6165640faeeb75680d07f8947355bcad2 WatchSource:0}: Error finding container 612fdf309ea66879ca93d91568e484e6165640faeeb75680d07f8947355bcad2: Status 404 returned error can't find the container with id 612fdf309ea66879ca93d91568e484e6165640faeeb75680d07f8947355bcad2
Sep 09 20:27:28.562901 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:28.562868    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8" event={"ID":"899c3999-bd92-490f-845c-0fd816e97d02","Type":"ContainerStarted","Data":"28cd8653b7c97a1a497d962b3c36e70e7b44876a20958d161d2b7b2758204fc7"}
Sep 09 20:27:28.563274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:28.562922    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8" event={"ID":"899c3999-bd92-490f-845c-0fd816e97d02","Type":"ContainerStarted","Data":"612fdf309ea66879ca93d91568e484e6165640faeeb75680d07f8947355bcad2"}
Sep 09 20:27:28.580299 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:28.580249    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8" podStartSLOduration=1.357412351 podStartE2EDuration="1.580237112s" totalImagesPullingTime="222.824761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:27:28.579504454 +0000 UTC m=+652.806455217" watchObservedRunningTime="2026-09-09 20:27:28.580237112 +0000 UTC m=+652.807187913"
Sep 09 20:27:33.355548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.355497    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:33.356115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.355579    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:33.367954 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.367917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:33.599338 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.599309    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb"
Sep 09 20:27:33.745492 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.745384    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"]
Sep 09 20:27:33.749806 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.749783    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.752354 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.752329    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 20:27:33.758398 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.758374    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"]
Sep 09 20:27:33.825256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.825220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.825424 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.825276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.825424 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.825310    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.825424 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.825339    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.825548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.825429    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7dm\" (UniqueName: \"kubernetes.io/projected/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-kube-api-access-ws7dm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.825548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.825459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926333 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7dm\" (UniqueName: \"kubernetes.io/projected/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-kube-api-access-ws7dm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926895 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926998 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.926998 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.926959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.928988 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.928962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.929122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.929104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:33.934793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:33.934770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7dm\" (UniqueName: \"kubernetes.io/projected/0ecc14e1-57b8-4a9b-849d-81d5e3015a8a-kube-api-access-ws7dm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd\" (UID: \"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:34.063167 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:34.063081    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:34.343213 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:34.343188    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"]
Sep 09 20:27:34.344733 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:27:34.344702    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecc14e1_57b8_4a9b_849d_81d5e3015a8a.slice/crio-217a9e19ffaf208bba29e929e21283921e302cd5c3122226e067676e9f5f2087 WatchSource:0}: Error finding container 217a9e19ffaf208bba29e929e21283921e302cd5c3122226e067676e9f5f2087: Status 404 returned error can't find the container with id 217a9e19ffaf208bba29e929e21283921e302cd5c3122226e067676e9f5f2087
Sep 09 20:27:34.597198 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:34.597163    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd" event={"ID":"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a","Type":"ContainerStarted","Data":"217a9e19ffaf208bba29e929e21283921e302cd5c3122226e067676e9f5f2087"}
Sep 09 20:27:35.609638 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:35.609597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd" event={"ID":"0ecc14e1-57b8-4a9b-849d-81d5e3015a8a","Type":"ContainerStarted","Data":"c63787ba9fe23d9d682dab11cd3e16991ef70ddd584b66757cbcac7f46eab08d"}
Sep 09 20:27:35.627818 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:35.627764    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd" podStartSLOduration=2.433844863 podStartE2EDuration="2.627748177s" totalImagesPullingTime="193.903314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:27:35.626321953 +0000 UTC m=+659.853272725" watchObservedRunningTime="2026-09-09 20:27:35.627748177 +0000 UTC m=+659.854698938"
Sep 09 20:27:37.860627 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:37.860595    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:37.861071 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:37.860736    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:37.872772 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:37.872748    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:38.636380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:38.636353    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n95k8"
Sep 09 20:27:44.063418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:44.063380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:44.063790 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:44.063462    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:44.075625 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:44.075599    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:27:44.668037 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:27:44.668013    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd"
Sep 09 20:29:59.705250 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.705164    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"]
Sep 09 20:29:59.708999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.708981    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.711303 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.711277    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-21117b-serving-cert\""
Sep 09 20:29:59.719517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.719493    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"]
Sep 09 20:29:59.841491 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.841461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-openshift-service-ca\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.841677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.841510    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-metrics-certs\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.841677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.841553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hgf\" (UniqueName: \"kubernetes.io/projected/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-kube-api-access-r9hgf\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.841677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.841588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-maas-api-tls\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.942411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.942369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-openshift-service-ca\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.942593 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.942455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-metrics-certs\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.942593 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.942513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hgf\" (UniqueName: \"kubernetes.io/projected/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-kube-api-access-r9hgf\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.942593 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.942574    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-maas-api-tls\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.943023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.943001    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-openshift-service-ca\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.945257 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.945231    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-metrics-certs\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.945385 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.945326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-maas-api-tls\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:29:59.952823 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:29:59.952796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hgf\" (UniqueName: \"kubernetes.io/projected/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-kube-api-access-r9hgf\") pod \"maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:30:00.021364 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:00.021283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:30:00.298907 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:00.298876    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"]
Sep 09 20:30:00.355470 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:00.355430    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf" event={"ID":"8adeb004-5ce6-4d5e-a0fe-555ed4133a25","Type":"ContainerStarted","Data":"aed10c6be5f6a2b540adc061fd51747b4c17de4439e10127407dd1ba6fcbbb0d"}
Sep 09 20:30:01.364000 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:01.363970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf" event={"ID":"8adeb004-5ce6-4d5e-a0fe-555ed4133a25","Type":"ContainerStarted","Data":"b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791"}
Sep 09 20:30:01.364406 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:01.364103    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:30:01.383431 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:01.383365    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf" podStartSLOduration=1.723861092 podStartE2EDuration="2.383346106s" totalImagesPullingTime="659.485014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:30:01.381768945 +0000 UTC m=+805.608719709" watchObservedRunningTime="2026-09-09 20:30:01.383346106 +0000 UTC m=+805.610296868"
Sep 09 20:30:03.308463 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.308431    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"]
Sep 09 20:30:03.312277 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.312256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.314724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.314693    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-87ac1d4f-openshift-default-dockercfg-j97c4\""
Sep 09 20:30:03.324080 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.324054    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"]
Sep 09 20:30:03.478367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-certs\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478367 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-envoy\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istiod-ca-cert\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvx9f\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-kube-api-access-jvx9f\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-podinfo\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-data\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478705 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-token\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478705 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-socket\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.478705 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.478668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-credential-socket\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579417 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-token\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579417 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-socket\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579417 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-credential-socket\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-certs\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-envoy\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istiod-ca-cert\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvx9f\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-kube-api-access-jvx9f\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-podinfo\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.579698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-data\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.580051 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579802    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-socket\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.580051 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579844    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-certs\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.580051 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.579950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-credential-socket\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.580051 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.580034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-data\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.580312 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.580291    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istiod-ca-cert\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.581798 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.581779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-envoy\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.582080 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.582063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-podinfo\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.593142 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.593116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvx9f\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-kube-api-access-jvx9f\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.593371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.593347    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-token\") pod \"e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") " pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.625004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.624982    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:03.902574 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.902546    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"]
Sep 09 20:30:03.903830 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:30:03.903806    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a4cfe6_9e7e_4999_b304_a142f854d8bf.slice/crio-a434cc3f31101cbaefc32d52b8d309f2f10325c5718160a5ac70918d60820cb9 WatchSource:0}: Error finding container a434cc3f31101cbaefc32d52b8d309f2f10325c5718160a5ac70918d60820cb9: Status 404 returned error can't find the container with id a434cc3f31101cbaefc32d52b8d309f2f10325c5718160a5ac70918d60820cb9
Sep 09 20:30:03.906021 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.905989    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:30:03.906101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.906053    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:30:03.906101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:03.906091    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:30:04.380272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:04.380244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" event={"ID":"c2a4cfe6-9e7e-4999-b304-a142f854d8bf","Type":"ContainerStarted","Data":"0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"}
Sep 09 20:30:04.380724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:04.380291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" event={"ID":"c2a4cfe6-9e7e-4999-b304-a142f854d8bf","Type":"ContainerStarted","Data":"a434cc3f31101cbaefc32d52b8d309f2f10325c5718160a5ac70918d60820cb9"}
Sep 09 20:30:04.401610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:04.401563    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podStartSLOduration=1.401545113 podStartE2EDuration="1.401545113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:30:04.398686812 +0000 UTC m=+808.625637572" watchObservedRunningTime="2026-09-09 20:30:04.401545113 +0000 UTC m=+808.628495937"
Sep 09 20:30:04.625732 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:04.625698    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:04.627235 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:04.627210    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:04.627361 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:04.627255    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:05.630114 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:05.630081    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:06.391728 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:06.391695    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:06.392782 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:06.392760    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:06.958271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:06.958231    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"]
Sep 09 20:30:06.962532 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:06.962508    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:06.965339 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:06.965319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-87ac1d4f-serving-cert\""
Sep 09 20:30:06.974072 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:06.974051    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"]
Sep 09 20:30:07.118531 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.118503    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.118721 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.118536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c7cd0d-113d-441d-a1b7-648893983059-openshift-service-ca\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.118721 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.118561    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4xcj\" (UniqueName: \"kubernetes.io/projected/f4c7cd0d-113d-441d-a1b7-648893983059-kube-api-access-c4xcj\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.118721 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.118708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-metrics-certs\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.219824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.219753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.219824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.219784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c7cd0d-113d-441d-a1b7-648893983059-openshift-service-ca\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.219824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.219804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4xcj\" (UniqueName: \"kubernetes.io/projected/f4c7cd0d-113d-441d-a1b7-648893983059-kube-api-access-c4xcj\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.220110 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:07.219902    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-serving-cert: secret "maas-api-e2e-ait-87ac1d4f-serving-cert" not found
Sep 09 20:30:07.220110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.219964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-metrics-certs\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.220110 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:07.220006    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls podName:f4c7cd0d-113d-441d-a1b7-648893983059 nodeName:}" failed. No retries permitted until 2026-09-09 20:30:07.719983828 +0000 UTC m=+811.946934568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls") pod "maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" (UID: "f4c7cd0d-113d-441d-a1b7-648893983059") : secret "maas-api-e2e-ait-87ac1d4f-serving-cert" not found
Sep 09 20:30:07.220511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.220488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c7cd0d-113d-441d-a1b7-648893983059-openshift-service-ca\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.222394 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.222366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-metrics-certs\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.229765 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.229736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4xcj\" (UniqueName: \"kubernetes.io/projected/f4c7cd0d-113d-441d-a1b7-648893983059-kube-api-access-c4xcj\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.373530 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.373505    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:30:07.725161 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.725126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.727627 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.727599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls\") pod \"maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:07.875767 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:07.875723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:08.153983 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:08.153956    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"]
Sep 09 20:30:08.155475 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:30:08.155449    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c7cd0d_113d_441d_a1b7_648893983059.slice/crio-fe407e79c72257f8a63f130f4ac211a545c7a757e3f8437f31d80a224ee7a7d8 WatchSource:0}: Error finding container fe407e79c72257f8a63f130f4ac211a545c7a757e3f8437f31d80a224ee7a7d8: Status 404 returned error can't find the container with id fe407e79c72257f8a63f130f4ac211a545c7a757e3f8437f31d80a224ee7a7d8
Sep 09 20:30:08.404133 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:08.404047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" event={"ID":"f4c7cd0d-113d-441d-a1b7-648893983059","Type":"ContainerStarted","Data":"fe407e79c72257f8a63f130f4ac211a545c7a757e3f8437f31d80a224ee7a7d8"}
Sep 09 20:30:09.411266 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:09.411227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" event={"ID":"f4c7cd0d-113d-441d-a1b7-648893983059","Type":"ContainerStarted","Data":"91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8"}
Sep 09 20:30:09.411652 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:09.411332    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:09.429551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:09.429485    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" podStartSLOduration=2.879091694 podStartE2EDuration="3.429471968s" totalImagesPullingTime="550.380274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:30:09.42786578 +0000 UTC m=+813.654816541" watchObservedRunningTime="2026-09-09 20:30:09.429471968 +0000 UTC m=+813.656422728"
Sep 09 20:30:11.405109 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.405077    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"]
Sep 09 20:30:11.409341 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.409314    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.414360 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.414340    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-812760-serving-cert\""
Sep 09 20:30:11.432394 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.432360    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"]
Sep 09 20:30:11.464410 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.464383    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.464509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.464411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-metrics-certs\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.464509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.464443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36081d8-f97d-46ed-953b-1a369beee2dd-openshift-service-ca\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.464509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.464504    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2z6b\" (UniqueName: \"kubernetes.io/projected/d36081d8-f97d-46ed-953b-1a369beee2dd-kube-api-access-t2z6b\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.565549 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.565511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.565704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.565566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-metrics-certs\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.565704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.565599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36081d8-f97d-46ed-953b-1a369beee2dd-openshift-service-ca\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.565704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.565650    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2z6b\" (UniqueName: \"kubernetes.io/projected/d36081d8-f97d-46ed-953b-1a369beee2dd-kube-api-access-t2z6b\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.565704 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:11.565655    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-812760-serving-cert: secret "maas-api-e2e-autores-812760-serving-cert" not found
Sep 09 20:30:11.565854 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:11.565727    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls podName:d36081d8-f97d-46ed-953b-1a369beee2dd nodeName:}" failed. No retries permitted until 2026-09-09 20:30:12.065704771 +0000 UTC m=+816.292655539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls") pod "maas-api-e2e-autores-812760-7b6cdf9545-625fs" (UID: "d36081d8-f97d-46ed-953b-1a369beee2dd") : secret "maas-api-e2e-autores-812760-serving-cert" not found
Sep 09 20:30:11.566347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.566328    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36081d8-f97d-46ed-953b-1a369beee2dd-openshift-service-ca\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.568164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.568138    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-metrics-certs\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:11.576864 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:11.576844    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2z6b\" (UniqueName: \"kubernetes.io/projected/d36081d8-f97d-46ed-953b-1a369beee2dd-kube-api-access-t2z6b\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:12.068743 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:12.068709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:12.071445 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:12.071414    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls\") pod \"maas-api-e2e-autores-812760-7b6cdf9545-625fs\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:12.319440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:12.319350    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:12.593317 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:12.593284    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"]
Sep 09 20:30:13.434757 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:13.434704    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs" event={"ID":"d36081d8-f97d-46ed-953b-1a369beee2dd","Type":"ContainerStarted","Data":"4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41"}
Sep 09 20:30:13.434953 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:13.434772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs" event={"ID":"d36081d8-f97d-46ed-953b-1a369beee2dd","Type":"ContainerStarted","Data":"a50ce089c73b021227c99be5c635dd216ad35aebb2ca7c6f118d93106f0264fa"}
Sep 09 20:30:13.434953 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:13.434905    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:13.453444 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:13.453405    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs" podStartSLOduration=2.128849261 podStartE2EDuration="2.453391471s" totalImagesPullingTime="324.54221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:30:13.451616583 +0000 UTC m=+817.678567344" watchObservedRunningTime="2026-09-09 20:30:13.453391471 +0000 UTC m=+817.680342235"
Sep 09 20:30:15.423131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:15.423104    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:19.445252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:19.445222    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:30:21.763647 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.763610    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"]
Sep 09 20:30:21.768433 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.768408    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.771076 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.771051    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4defd2-serving-cert\""
Sep 09 20:30:21.781297 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.781215    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"]
Sep 09 20:30:21.869767 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.869721    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq4mn\" (UniqueName: \"kubernetes.io/projected/755f009c-767f-4b77-9f4f-3423ec9f0e4b-kube-api-access-hq4mn\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.869951 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.869808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.869951 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.869889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/755f009c-767f-4b77-9f4f-3423ec9f0e4b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.870036 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.869972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-metrics-certs\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.970873 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.970842    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq4mn\" (UniqueName: \"kubernetes.io/projected/755f009c-767f-4b77-9f4f-3423ec9f0e4b-kube-api-access-hq4mn\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.971053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.970898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.971053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.970983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/755f009c-767f-4b77-9f4f-3423ec9f0e4b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.971053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.971030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-metrics-certs\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.971241 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:21.971048    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-serving-cert: secret "maas-api-e2e-inf-b-4defd2-serving-cert" not found
Sep 09 20:30:21.971241 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:21.971127    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls podName:755f009c-767f-4b77-9f4f-3423ec9f0e4b nodeName:}" failed. No retries permitted until 2026-09-09 20:30:22.471105844 +0000 UTC m=+826.698056597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls") pod "maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" (UID: "755f009c-767f-4b77-9f4f-3423ec9f0e4b") : secret "maas-api-e2e-inf-b-4defd2-serving-cert" not found
Sep 09 20:30:21.971553 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.971532    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/755f009c-767f-4b77-9f4f-3423ec9f0e4b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.973622 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.973598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-metrics-certs\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:21.979695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:21.979671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq4mn\" (UniqueName: \"kubernetes.io/projected/755f009c-767f-4b77-9f4f-3423ec9f0e4b-kube-api-access-hq4mn\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:22.476204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:22.476170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:22.478856 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:22.478827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls\") pod \"maas-api-e2e-inf-b-4defd2-5986c69955-7bbms\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:22.683252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:22.683218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:22.967736 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:22.967706    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"]
Sep 09 20:30:22.969438 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:30:22.969411    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755f009c_767f_4b77_9f4f_3423ec9f0e4b.slice/crio-27960215f272a00428dcced8777f82b6506425b5afbe2bb2ae2614e1bed19476 WatchSource:0}: Error finding container 27960215f272a00428dcced8777f82b6506425b5afbe2bb2ae2614e1bed19476: Status 404 returned error can't find the container with id 27960215f272a00428dcced8777f82b6506425b5afbe2bb2ae2614e1bed19476
Sep 09 20:30:23.493139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:23.493097    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" event={"ID":"755f009c-767f-4b77-9f4f-3423ec9f0e4b","Type":"ContainerStarted","Data":"ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d"}
Sep 09 20:30:23.493330 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:23.493168    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" event={"ID":"755f009c-767f-4b77-9f4f-3423ec9f0e4b","Type":"ContainerStarted","Data":"27960215f272a00428dcced8777f82b6506425b5afbe2bb2ae2614e1bed19476"}
Sep 09 20:30:23.493401 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:23.493350    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:23.508656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:23.508412    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" podStartSLOduration=2.080775104 podStartE2EDuration="2.508394111s" totalImagesPullingTime="427.619007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:30:23.507884934 +0000 UTC m=+827.734835719" watchObservedRunningTime="2026-09-09 20:30:23.508394111 +0000 UTC m=+827.735344894"
Sep 09 20:30:26.512498 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:26.512441    2570 generic.go:356] "Generic (PLEG): container finished" podID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerID="0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5" exitCode=0
Sep 09 20:30:26.512955 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:26.512525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" event={"ID":"c2a4cfe6-9e7e-4999-b304-a142f854d8bf","Type":"ContainerDied","Data":"0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"}
Sep 09 20:30:26.513011 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:26.512999    2570 scope.go:117] "RemoveContainer" containerID="0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"
Sep 09 20:30:26.514169 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:26.514135    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:30:26.514280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:26.514219    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:30:26.514280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:26.514271    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:30:27.522041 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:27.522005    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" event={"ID":"c2a4cfe6-9e7e-4999-b304-a142f854d8bf","Type":"ContainerStarted","Data":"e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc"}
Sep 09 20:30:27.625989 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:27.625957    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:27.626184 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:27.626163    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:27.626229 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:27.626210    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:28.626351 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:28.626307    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:28.626777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:28.626374    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:29.513244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:29.513216    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:30:29.625504 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:29.625467    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:29.625650 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:29.625521    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:30.626248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:30.626212    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:30.626763 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:30.626267    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:31.625572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:31.625522    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:31.625760 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:31.625595    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:32.625388 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:32.625353    2570 patch_prober.go:28] interesting pod/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 20:30:32.625777 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:32.625406    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 20:30:33.629824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:33.629796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:33.630257 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:33.630123    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:33.630796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:33.630777    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:36.213478 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.213446    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"]
Sep 09 20:30:36.214245 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.213957    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" podUID="f4c7cd0d-113d-441d-a1b7-648893983059" containerName="maas-api" containerID="cri-o://91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8" gracePeriod=30
Sep 09 20:30:36.472982 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.472901    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:36.572977 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.572944    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"]
Sep 09 20:30:36.579302 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.579273    2570 generic.go:356] "Generic (PLEG): container finished" podID="f4c7cd0d-113d-441d-a1b7-648893983059" containerID="91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8" exitCode=0
Sep 09 20:30:36.579471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.579341    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"
Sep 09 20:30:36.579471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.579365    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" event={"ID":"f4c7cd0d-113d-441d-a1b7-648893983059","Type":"ContainerDied","Data":"91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8"}
Sep 09 20:30:36.579471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.579442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf" event={"ID":"f4c7cd0d-113d-441d-a1b7-648893983059","Type":"ContainerDied","Data":"fe407e79c72257f8a63f130f4ac211a545c7a757e3f8437f31d80a224ee7a7d8"}
Sep 09 20:30:36.579629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.579479    2570 scope.go:117] "RemoveContainer" containerID="91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8"
Sep 09 20:30:36.579629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.579559    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy" containerID="cri-o://e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc" gracePeriod=30
Sep 09 20:30:36.588864 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.588846    2570 scope.go:117] "RemoveContainer" containerID="91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8"
Sep 09 20:30:36.594882 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:36.589587    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8\": container with ID starting with 91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8 not found: ID does not exist" containerID="91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8"
Sep 09 20:30:36.594882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.589624    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8"} err="failed to get container status \"91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8\": rpc error: code = NotFound desc = could not find container \"91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8\": container with ID starting with 91ecc664a3e13a87689dc6cf10d7cb1cc04b5f630d9be6d9d7cf3fcd9d458ce8 not found: ID does not exist"
Sep 09 20:30:36.625108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.625036    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4xcj\" (UniqueName: \"kubernetes.io/projected/f4c7cd0d-113d-441d-a1b7-648893983059-kube-api-access-c4xcj\") pod \"f4c7cd0d-113d-441d-a1b7-648893983059\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") "
Sep 09 20:30:36.625299 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.625189    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c7cd0d-113d-441d-a1b7-648893983059-openshift-service-ca\") pod \"f4c7cd0d-113d-441d-a1b7-648893983059\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") "
Sep 09 20:30:36.625299 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.625223    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls\") pod \"f4c7cd0d-113d-441d-a1b7-648893983059\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") "
Sep 09 20:30:36.625299 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.625276    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-metrics-certs\") pod \"f4c7cd0d-113d-441d-a1b7-648893983059\" (UID: \"f4c7cd0d-113d-441d-a1b7-648893983059\") "
Sep 09 20:30:36.625972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.625902    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c7cd0d-113d-441d-a1b7-648893983059-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4c7cd0d-113d-441d-a1b7-648893983059" (UID: "f4c7cd0d-113d-441d-a1b7-648893983059"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:30:36.628246 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.628207    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f4c7cd0d-113d-441d-a1b7-648893983059" (UID: "f4c7cd0d-113d-441d-a1b7-648893983059"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:30:36.628472 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.628451    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c7cd0d-113d-441d-a1b7-648893983059-kube-api-access-c4xcj" (OuterVolumeSpecName: "kube-api-access-c4xcj") pod "f4c7cd0d-113d-441d-a1b7-648893983059" (UID: "f4c7cd0d-113d-441d-a1b7-648893983059"). InnerVolumeSpecName "kube-api-access-c4xcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:30:36.628748 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.628720    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4c7cd0d-113d-441d-a1b7-648893983059" (UID: "f4c7cd0d-113d-441d-a1b7-648893983059"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:30:36.726793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.726702    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4xcj\" (UniqueName: \"kubernetes.io/projected/f4c7cd0d-113d-441d-a1b7-648893983059-kube-api-access-c4xcj\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:36.726793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.726735    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4c7cd0d-113d-441d-a1b7-648893983059-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:36.726793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.726748    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:36.726793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.726759    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4c7cd0d-113d-441d-a1b7-648893983059-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:36.901944 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.901901    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"]
Sep 09 20:30:36.905576 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:36.905551    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-87ac1d4f-5f85dc85d8-q9npf"]
Sep 09 20:30:38.306849 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:38.306806    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c7cd0d-113d-441d-a1b7-648893983059" path="/var/lib/kubelet/pods/f4c7cd0d-113d-441d-a1b7-648893983059/volumes"
Sep 09 20:30:41.836416 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.836394    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:41.982804 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.982776    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-token\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.982840    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-data\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.982870    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-certs\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.982893    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-podinfo\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.982944    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvx9f\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-kube-api-access-jvx9f\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.982975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-socket\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983010    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-credential-socket\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983064    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istiod-ca-cert\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983108    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-envoy\") pod \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\" (UID: \"c2a4cfe6-9e7e-4999-b304-a142f854d8bf\") "
Sep 09 20:30:41.983331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983243    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:30:41.983331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:30:41.983331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983322    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:30:41.983575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983531    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:41.983575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983553    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:41.983575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983567    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:41.983716 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983604    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:30:41.984020 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.983994    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:30:41.985547 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.985521    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-kube-api-access-jvx9f" (OuterVolumeSpecName: "kube-api-access-jvx9f") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "kube-api-access-jvx9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:30:41.985659 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.985574    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:30:41.985659 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.985613    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:30:41.985735 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:41.985696    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2a4cfe6-9e7e-4999-b304-a142f854d8bf" (UID: "c2a4cfe6-9e7e-4999-b304-a142f854d8bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:30:42.084492 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.084457    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:42.084492 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.084486    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:42.084492 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.084495    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvx9f\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-kube-api-access-jvx9f\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:42.084734 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.084504    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:42.084734 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.084513    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:42.084734 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.084520    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a4cfe6-9e7e-4999-b304-a142f854d8bf-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:30:42.619057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.619031    2570 generic.go:356] "Generic (PLEG): container finished" podID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerID="e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc" exitCode=0
Sep 09 20:30:42.619215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.619077    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"
Sep 09 20:30:42.619215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.619109    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" event={"ID":"c2a4cfe6-9e7e-4999-b304-a142f854d8bf","Type":"ContainerDied","Data":"e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc"}
Sep 09 20:30:42.619215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.619171    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq" event={"ID":"c2a4cfe6-9e7e-4999-b304-a142f854d8bf","Type":"ContainerDied","Data":"a434cc3f31101cbaefc32d52b8d309f2f10325c5718160a5ac70918d60820cb9"}
Sep 09 20:30:42.619215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.619201    2570 scope.go:117] "RemoveContainer" containerID="e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc"
Sep 09 20:30:42.630305 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.630284    2570 scope.go:117] "RemoveContainer" containerID="0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"
Sep 09 20:30:42.638727 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.638703    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"]
Sep 09 20:30:42.639503 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.639482    2570 scope.go:117] "RemoveContainer" containerID="e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc"
Sep 09 20:30:42.647965 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:42.640417    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc\": container with ID starting with e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc not found: ID does not exist" containerID="e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc"
Sep 09 20:30:42.647965 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.640466    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc"} err="failed to get container status \"e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc\": rpc error: code = NotFound desc = could not find container \"e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc\": container with ID starting with e9821728dc18d64efd65f75409fd7718bb1aeb653615318043dc5df9751f8edc not found: ID does not exist"
Sep 09 20:30:42.647965 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.640523    2570 scope.go:117] "RemoveContainer" containerID="0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"
Sep 09 20:30:42.647965 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.644853    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq"]
Sep 09 20:30:42.648516 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:30:42.648492    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5\": container with ID starting with 0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5 not found: ID does not exist" containerID="0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"
Sep 09 20:30:42.648604 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:42.648522    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5"} err="failed to get container status \"0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5\": rpc error: code = NotFound desc = could not find container \"0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5\": container with ID starting with 0b666921e137985c9bd41a6d1b084d2cf9bf2050a7906accd79962296fc7c1f5 not found: ID does not exist"
Sep 09 20:30:43.084708 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.084476    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"]
Sep 09 20:30:43.085316 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085293    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy"
Sep 09 20:30:43.085316 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085318    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy"
Sep 09 20:30:43.085500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085330    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy"
Sep 09 20:30:43.085500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085338    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy"
Sep 09 20:30:43.085500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085360    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c7cd0d-113d-441d-a1b7-648893983059" containerName="maas-api"
Sep 09 20:30:43.085500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085368    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c7cd0d-113d-441d-a1b7-648893983059" containerName="maas-api"
Sep 09 20:30:43.085500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085495    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy"
Sep 09 20:30:43.085732 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.085511    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c7cd0d-113d-441d-a1b7-648893983059" containerName="maas-api"
Sep 09 20:30:43.091120 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.091096    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.093563 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.093539    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-25e8b2a0-serving-cert\""
Sep 09 20:30:43.102369 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.102343    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"]
Sep 09 20:30:43.195728 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.195700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf432ee-adc9-4203-a37e-23c55ab5460c-openshift-service-ca\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.195962 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.195752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smm4z\" (UniqueName: \"kubernetes.io/projected/2cf432ee-adc9-4203-a37e-23c55ab5460c-kube-api-access-smm4z\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.195962 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.195873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-metrics-certs\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.196071 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.195997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-maas-api-tls\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.296718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.296682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-metrics-certs\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.296877 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.296764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-maas-api-tls\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.296877 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.296802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf432ee-adc9-4203-a37e-23c55ab5460c-openshift-service-ca\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.296877 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.296834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smm4z\" (UniqueName: \"kubernetes.io/projected/2cf432ee-adc9-4203-a37e-23c55ab5460c-kube-api-access-smm4z\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.297535 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.297459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf432ee-adc9-4203-a37e-23c55ab5460c-openshift-service-ca\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.299195 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.299175    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-maas-api-tls\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.299294 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.299229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-metrics-certs\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.304633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.304616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smm4z\" (UniqueName: \"kubernetes.io/projected/2cf432ee-adc9-4203-a37e-23c55ab5460c-kube-api-access-smm4z\") pod \"maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.405827 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.405800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:43.678595 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:43.678568    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"]
Sep 09 20:30:43.680367 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:30:43.680343    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf432ee_adc9_4203_a37e_23c55ab5460c.slice/crio-9c867a5d5d9296e3d953e5df6f078090249d2ec649f8ed93a9182e75356a361b WatchSource:0}: Error finding container 9c867a5d5d9296e3d953e5df6f078090249d2ec649f8ed93a9182e75356a361b: Status 404 returned error can't find the container with id 9c867a5d5d9296e3d953e5df6f078090249d2ec649f8ed93a9182e75356a361b
Sep 09 20:30:44.308286 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:44.308207    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" path="/var/lib/kubelet/pods/c2a4cfe6-9e7e-4999-b304-a142f854d8bf/volumes"
Sep 09 20:30:44.633278 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:44.633245    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz" event={"ID":"2cf432ee-adc9-4203-a37e-23c55ab5460c","Type":"ContainerStarted","Data":"958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674"}
Sep 09 20:30:44.633421 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:44.633302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz" event={"ID":"2cf432ee-adc9-4203-a37e-23c55ab5460c","Type":"ContainerStarted","Data":"9c867a5d5d9296e3d953e5df6f078090249d2ec649f8ed93a9182e75356a361b"}
Sep 09 20:30:44.633421 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:44.633326    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:30:44.650994 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:44.650953    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz" podStartSLOduration=1.29088503 podStartE2EDuration="1.650923143s" totalImagesPullingTime="360.038113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:30:44.649444318 +0000 UTC m=+848.876395081" watchObservedRunningTime="2026-09-09 20:30:44.650923143 +0000 UTC m=+848.877873904"
Sep 09 20:30:50.644440 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:30:50.644412    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:31:12.128350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.128319    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"]
Sep 09 20:31:12.128969 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.128536    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz" podUID="2cf432ee-adc9-4203-a37e-23c55ab5460c" containerName="maas-api" containerID="cri-o://958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674" gracePeriod=30
Sep 09 20:31:12.384135 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.384070    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:31:12.477610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.477581    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-metrics-certs\") pod \"2cf432ee-adc9-4203-a37e-23c55ab5460c\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") "
Sep 09 20:31:12.477769 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.477684    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smm4z\" (UniqueName: \"kubernetes.io/projected/2cf432ee-adc9-4203-a37e-23c55ab5460c-kube-api-access-smm4z\") pod \"2cf432ee-adc9-4203-a37e-23c55ab5460c\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") "
Sep 09 20:31:12.477769 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.477730    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf432ee-adc9-4203-a37e-23c55ab5460c-openshift-service-ca\") pod \"2cf432ee-adc9-4203-a37e-23c55ab5460c\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") "
Sep 09 20:31:12.477891 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.477774    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-maas-api-tls\") pod \"2cf432ee-adc9-4203-a37e-23c55ab5460c\" (UID: \"2cf432ee-adc9-4203-a37e-23c55ab5460c\") "
Sep 09 20:31:12.478237 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.478203    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cf432ee-adc9-4203-a37e-23c55ab5460c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cf432ee-adc9-4203-a37e-23c55ab5460c" (UID: "2cf432ee-adc9-4203-a37e-23c55ab5460c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:31:12.478636 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.478522    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf432ee-adc9-4203-a37e-23c55ab5460c-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:12.481369 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.481330    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2cf432ee-adc9-4203-a37e-23c55ab5460c" (UID: "2cf432ee-adc9-4203-a37e-23c55ab5460c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:31:12.483050 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.483017    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf432ee-adc9-4203-a37e-23c55ab5460c-kube-api-access-smm4z" (OuterVolumeSpecName: "kube-api-access-smm4z") pod "2cf432ee-adc9-4203-a37e-23c55ab5460c" (UID: "2cf432ee-adc9-4203-a37e-23c55ab5460c"). InnerVolumeSpecName "kube-api-access-smm4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:31:12.483298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.483241    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cf432ee-adc9-4203-a37e-23c55ab5460c" (UID: "2cf432ee-adc9-4203-a37e-23c55ab5460c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:31:12.579825 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.579776    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:12.579825 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.579821    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smm4z\" (UniqueName: \"kubernetes.io/projected/2cf432ee-adc9-4203-a37e-23c55ab5460c-kube-api-access-smm4z\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:12.579825 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.579834    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf432ee-adc9-4203-a37e-23c55ab5460c-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:12.797991 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.797888    2570 generic.go:356] "Generic (PLEG): container finished" podID="2cf432ee-adc9-4203-a37e-23c55ab5460c" containerID="958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674" exitCode=0
Sep 09 20:31:12.797991 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.797966    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz" event={"ID":"2cf432ee-adc9-4203-a37e-23c55ab5460c","Type":"ContainerDied","Data":"958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674"}
Sep 09 20:31:12.798204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.797980    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"
Sep 09 20:31:12.798204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.798057    2570 scope.go:117] "RemoveContainer" containerID="958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674"
Sep 09 20:31:12.798204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.798042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz" event={"ID":"2cf432ee-adc9-4203-a37e-23c55ab5460c","Type":"ContainerDied","Data":"9c867a5d5d9296e3d953e5df6f078090249d2ec649f8ed93a9182e75356a361b"}
Sep 09 20:31:12.813350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.813320    2570 scope.go:117] "RemoveContainer" containerID="958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674"
Sep 09 20:31:12.813890 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:31:12.813861    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674\": container with ID starting with 958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674 not found: ID does not exist" containerID="958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674"
Sep 09 20:31:12.814031 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.813912    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674"} err="failed to get container status \"958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674\": rpc error: code = NotFound desc = could not find container \"958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674\": container with ID starting with 958bd5e784ec77b8118b3d242d20d067a3b77d18c48f3aa656cddbb605519674 not found: ID does not exist"
Sep 09 20:31:12.835637 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.835611    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"]
Sep 09 20:31:12.839146 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:12.839122    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-25e8b2a0-7d9f5f664d-5m2kz"]
Sep 09 20:31:13.390800 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.390717    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"]
Sep 09 20:31:13.391490 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.391466    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf432ee-adc9-4203-a37e-23c55ab5460c" containerName="maas-api"
Sep 09 20:31:13.391490 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.391491    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf432ee-adc9-4203-a37e-23c55ab5460c" containerName="maas-api"
Sep 09 20:31:13.391658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.391598    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a4cfe6-9e7e-4999-b304-a142f854d8bf" containerName="istio-proxy"
Sep 09 20:31:13.391658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.391614    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf432ee-adc9-4203-a37e-23c55ab5460c" containerName="maas-api"
Sep 09 20:31:13.396725 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.396697    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.399331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.399312    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4275e4e8-openshift-default-dockercfg-x2xlt\""
Sep 09 20:31:13.408888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.408833    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"]
Sep 09 20:31:13.491318 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.491127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-envoy\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.491966 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.491787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75b0697-1b77-45b5-964c-91d58c786dae-istio-podinfo\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.491966 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.491846    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jbrz\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-kube-api-access-2jbrz\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.491966 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.491908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-istio-token\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.492115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.491995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75b0697-1b77-45b5-964c-91d58c786dae-istiod-ca-cert\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.492115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.492042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-data\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.492115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.492072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-credential-socket\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.492115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.492091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-certs\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.492263 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.492124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-socket\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593301    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-istio-token\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593526 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75b0697-1b77-45b5-964c-91d58c786dae-istiod-ca-cert\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593526 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-data\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593526 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-credential-socket\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593526 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-certs\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593526 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-socket\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593812 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-envoy\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593812 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593665    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75b0697-1b77-45b5-964c-91d58c786dae-istio-podinfo\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.593812 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.593691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jbrz\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-kube-api-access-2jbrz\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.594309 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.594022    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-data\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.594309 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.594060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-credential-socket\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.594309 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.594287    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-socket\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.594521 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.594387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-certs\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.594716 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.594694    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75b0697-1b77-45b5-964c-91d58c786dae-istiod-ca-cert\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.596872 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.596849    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-envoy\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.597216 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.597187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75b0697-1b77-45b5-964c-91d58c786dae-istio-podinfo\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.601741 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.601716    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-istio-token\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.605456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.605432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jbrz\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-kube-api-access-2jbrz\") pod \"e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") " pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.710419 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.710327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:13.994878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.994847    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"]
Sep 09 20:31:13.996185 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:31:13.996161    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75b0697_1b77_45b5_964c_91d58c786dae.slice/crio-fc6bbf2744a888271d5f37a09b237e5b79d4a7770665f50ece1ad35c8d1362e7 WatchSource:0}: Error finding container fc6bbf2744a888271d5f37a09b237e5b79d4a7770665f50ece1ad35c8d1362e7: Status 404 returned error can't find the container with id fc6bbf2744a888271d5f37a09b237e5b79d4a7770665f50ece1ad35c8d1362e7
Sep 09 20:31:13.998471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.998436    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:31:13.998538 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.998512    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:31:13.998589 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:13.998547    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:31:14.308302 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:14.308217    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf432ee-adc9-4203-a37e-23c55ab5460c" path="/var/lib/kubelet/pods/2cf432ee-adc9-4203-a37e-23c55ab5460c/volumes"
Sep 09 20:31:14.812548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:14.812518    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" event={"ID":"e75b0697-1b77-45b5-964c-91d58c786dae","Type":"ContainerStarted","Data":"94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"}
Sep 09 20:31:14.812923 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:14.812569    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" event={"ID":"e75b0697-1b77-45b5-964c-91d58c786dae","Type":"ContainerStarted","Data":"fc6bbf2744a888271d5f37a09b237e5b79d4a7770665f50ece1ad35c8d1362e7"}
Sep 09 20:31:14.835789 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:14.835739    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podStartSLOduration=1.835722755 podStartE2EDuration="1.835722755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:31:14.833305576 +0000 UTC m=+879.060256337" watchObservedRunningTime="2026-09-09 20:31:14.835722755 +0000 UTC m=+879.062673516"
Sep 09 20:31:15.711053 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:15.711020    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:15.716359 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:15.716335    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:15.818694 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:15.818666    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:15.819474 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:15.819456    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:19.455510 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.455475    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"]
Sep 09 20:31:19.459432 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.459413    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.461640 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.461620    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4275e4e8-serving-cert\""
Sep 09 20:31:19.471184 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.471160    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"]
Sep 09 20:31:19.555842 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.555805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-metrics-certs\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.555842 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.555843    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7ch\" (UniqueName: \"kubernetes.io/projected/288a2167-adba-484c-ba7e-00fbad4f2c90-kube-api-access-pd7ch\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.556080 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.556005    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a2167-adba-484c-ba7e-00fbad4f2c90-openshift-service-ca\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.556080 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.556051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.656693 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.656648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a2167-adba-484c-ba7e-00fbad4f2c90-openshift-service-ca\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.656693 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.656697    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.657015 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.656759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-metrics-certs\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.657015 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.656776    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7ch\" (UniqueName: \"kubernetes.io/projected/288a2167-adba-484c-ba7e-00fbad4f2c90-kube-api-access-pd7ch\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.657015 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:31:19.656868    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-serving-cert: secret "maas-api-e2e-ait-4275e4e8-serving-cert" not found
Sep 09 20:31:19.657015 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:31:19.656954    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls podName:288a2167-adba-484c-ba7e-00fbad4f2c90 nodeName:}" failed. No retries permitted until 2026-09-09 20:31:20.156917518 +0000 UTC m=+884.383868257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls") pod "maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" (UID: "288a2167-adba-484c-ba7e-00fbad4f2c90") : secret "maas-api-e2e-ait-4275e4e8-serving-cert" not found
Sep 09 20:31:19.657364 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.657341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a2167-adba-484c-ba7e-00fbad4f2c90-openshift-service-ca\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.659387 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.659365    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-metrics-certs\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:19.667307 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:19.667279    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7ch\" (UniqueName: \"kubernetes.io/projected/288a2167-adba-484c-ba7e-00fbad4f2c90-kube-api-access-pd7ch\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:20.163019 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:20.162979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:20.165773 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:20.165700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls\") pod \"maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:20.370198 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:20.370167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:20.644345 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:20.644317    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"]
Sep 09 20:31:20.645892 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:31:20.645870    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288a2167_adba_484c_ba7e_00fbad4f2c90.slice/crio-d6b5f03bfad4e248757927e02a997dfb3ca95aed0ddf80bb0327b7d96469dae0 WatchSource:0}: Error finding container d6b5f03bfad4e248757927e02a997dfb3ca95aed0ddf80bb0327b7d96469dae0: Status 404 returned error can't find the container with id d6b5f03bfad4e248757927e02a997dfb3ca95aed0ddf80bb0327b7d96469dae0
Sep 09 20:31:20.847984 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:20.847881    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" event={"ID":"288a2167-adba-484c-ba7e-00fbad4f2c90","Type":"ContainerStarted","Data":"d6b5f03bfad4e248757927e02a997dfb3ca95aed0ddf80bb0327b7d96469dae0"}
Sep 09 20:31:21.855219 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:21.855181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" event={"ID":"288a2167-adba-484c-ba7e-00fbad4f2c90","Type":"ContainerStarted","Data":"a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69"}
Sep 09 20:31:21.855603 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:21.855255    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:21.872629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:21.872584    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" podStartSLOduration=2.306189757 podStartE2EDuration="2.872551124s" totalImagesPullingTime="566.361367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:31:21.871707436 +0000 UTC m=+886.098658197" watchObservedRunningTime="2026-09-09 20:31:21.872551124 +0000 UTC m=+886.099501885"
Sep 09 20:31:27.866647 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:27.866571    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:41.966938 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:41.966902    2570 generic.go:356] "Generic (PLEG): container finished" podID="e75b0697-1b77-45b5-964c-91d58c786dae" containerID="94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98" exitCode=0
Sep 09 20:31:41.967452 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:41.966980    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" event={"ID":"e75b0697-1b77-45b5-964c-91d58c786dae","Type":"ContainerDied","Data":"94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"}
Sep 09 20:31:41.967559 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:41.967541    2570 scope.go:117] "RemoveContainer" containerID="94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"
Sep 09 20:31:41.968701 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:41.968669    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:31:41.968796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:41.968742    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:31:41.968796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:41.968781    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:31:42.974635 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:42.974597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" event={"ID":"e75b0697-1b77-45b5-964c-91d58c786dae","Type":"ContainerStarted","Data":"4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5"}
Sep 09 20:31:43.712034 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:43.711981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:43.712519 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:43.712168    2570 patch_prober.go:28] interesting pod/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 20:31:43.712519 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:43.712231    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 20:31:44.711226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:44.711165    2570 patch_prober.go:28] interesting pod/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 20:31:44.711696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:44.711273    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 20:31:45.711266 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:45.711220    2570 patch_prober.go:28] interesting pod/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 20:31:45.711763 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:45.711305    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 20:31:45.819249 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:45.819208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:46.711540 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:46.711497    2570 patch_prober.go:28] interesting pod/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 20:31:46.712718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:46.712686    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 20:31:47.711376 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:47.711314    2570 patch_prober.go:28] interesting pod/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 20:31:47.711671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:47.711643    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 20:31:48.715299 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:48.715267    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:48.716605 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:48.716579    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:31:58.075832 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.075789    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"]
Sep 09 20:31:58.076307 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.076174    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs" podUID="d36081d8-f97d-46ed-953b-1a369beee2dd" containerName="maas-api" containerID="cri-o://4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41" gracePeriod=30
Sep 09 20:31:58.316563 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.316534    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"]
Sep 09 20:31:58.317375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.317323    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" podUID="288a2167-adba-484c-ba7e-00fbad4f2c90" containerName="maas-api" containerID="cri-o://a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69" gracePeriod=30
Sep 09 20:31:58.469610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.469507    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:31:58.567967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.566360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2z6b\" (UniqueName: \"kubernetes.io/projected/d36081d8-f97d-46ed-953b-1a369beee2dd-kube-api-access-t2z6b\") pod \"d36081d8-f97d-46ed-953b-1a369beee2dd\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") "
Sep 09 20:31:58.567967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.566558    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-metrics-certs\") pod \"d36081d8-f97d-46ed-953b-1a369beee2dd\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") "
Sep 09 20:31:58.567967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.566598    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls\") pod \"d36081d8-f97d-46ed-953b-1a369beee2dd\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") "
Sep 09 20:31:58.567967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.566629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36081d8-f97d-46ed-953b-1a369beee2dd-openshift-service-ca\") pod \"d36081d8-f97d-46ed-953b-1a369beee2dd\" (UID: \"d36081d8-f97d-46ed-953b-1a369beee2dd\") "
Sep 09 20:31:58.567967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.567301    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36081d8-f97d-46ed-953b-1a369beee2dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d36081d8-f97d-46ed-953b-1a369beee2dd" (UID: "d36081d8-f97d-46ed-953b-1a369beee2dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:31:58.569557 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.569523    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d36081d8-f97d-46ed-953b-1a369beee2dd" (UID: "d36081d8-f97d-46ed-953b-1a369beee2dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:31:58.569689 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.569668    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d36081d8-f97d-46ed-953b-1a369beee2dd" (UID: "d36081d8-f97d-46ed-953b-1a369beee2dd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:31:58.569764 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.569694    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36081d8-f97d-46ed-953b-1a369beee2dd-kube-api-access-t2z6b" (OuterVolumeSpecName: "kube-api-access-t2z6b") pod "d36081d8-f97d-46ed-953b-1a369beee2dd" (UID: "d36081d8-f97d-46ed-953b-1a369beee2dd"). InnerVolumeSpecName "kube-api-access-t2z6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:31:58.610407 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.610362    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:58.668347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.668317    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.668347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.668342    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36081d8-f97d-46ed-953b-1a369beee2dd-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.668347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.668351    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36081d8-f97d-46ed-953b-1a369beee2dd-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.668656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.668359    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2z6b\" (UniqueName: \"kubernetes.io/projected/d36081d8-f97d-46ed-953b-1a369beee2dd-kube-api-access-t2z6b\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.769095 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.769005    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a2167-adba-484c-ba7e-00fbad4f2c90-openshift-service-ca\") pod \"288a2167-adba-484c-ba7e-00fbad4f2c90\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") "
Sep 09 20:31:58.769279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.769159    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls\") pod \"288a2167-adba-484c-ba7e-00fbad4f2c90\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") "
Sep 09 20:31:58.769462 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.769433    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/288a2167-adba-484c-ba7e-00fbad4f2c90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "288a2167-adba-484c-ba7e-00fbad4f2c90" (UID: "288a2167-adba-484c-ba7e-00fbad4f2c90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:31:58.769525 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.769476    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd7ch\" (UniqueName: \"kubernetes.io/projected/288a2167-adba-484c-ba7e-00fbad4f2c90-kube-api-access-pd7ch\") pod \"288a2167-adba-484c-ba7e-00fbad4f2c90\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") "
Sep 09 20:31:58.769592 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.769531    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-metrics-certs\") pod \"288a2167-adba-484c-ba7e-00fbad4f2c90\" (UID: \"288a2167-adba-484c-ba7e-00fbad4f2c90\") "
Sep 09 20:31:58.770168 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.770087    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a2167-adba-484c-ba7e-00fbad4f2c90-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.771756 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.771587    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "288a2167-adba-484c-ba7e-00fbad4f2c90" (UID: "288a2167-adba-484c-ba7e-00fbad4f2c90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:31:58.771756 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.771664    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288a2167-adba-484c-ba7e-00fbad4f2c90-kube-api-access-pd7ch" (OuterVolumeSpecName: "kube-api-access-pd7ch") pod "288a2167-adba-484c-ba7e-00fbad4f2c90" (UID: "288a2167-adba-484c-ba7e-00fbad4f2c90"). InnerVolumeSpecName "kube-api-access-pd7ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:31:58.772119 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.772100    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "288a2167-adba-484c-ba7e-00fbad4f2c90" (UID: "288a2167-adba-484c-ba7e-00fbad4f2c90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:31:58.870845 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.870764    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.870845 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.870796    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd7ch\" (UniqueName: \"kubernetes.io/projected/288a2167-adba-484c-ba7e-00fbad4f2c90-kube-api-access-pd7ch\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:58.870845 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:58.870806    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/288a2167-adba-484c-ba7e-00fbad4f2c90-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:31:59.075763 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.075726    2570 generic.go:356] "Generic (PLEG): container finished" podID="288a2167-adba-484c-ba7e-00fbad4f2c90" containerID="a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69" exitCode=0
Sep 09 20:31:59.075959 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.075774    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"
Sep 09 20:31:59.075959 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.075807    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" event={"ID":"288a2167-adba-484c-ba7e-00fbad4f2c90","Type":"ContainerDied","Data":"a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69"}
Sep 09 20:31:59.075959 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.075860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k" event={"ID":"288a2167-adba-484c-ba7e-00fbad4f2c90","Type":"ContainerDied","Data":"d6b5f03bfad4e248757927e02a997dfb3ca95aed0ddf80bb0327b7d96469dae0"}
Sep 09 20:31:59.075959 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.075884    2570 scope.go:117] "RemoveContainer" containerID="a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69"
Sep 09 20:31:59.081084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.081053    2570 generic.go:356] "Generic (PLEG): container finished" podID="d36081d8-f97d-46ed-953b-1a369beee2dd" containerID="4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41" exitCode=0
Sep 09 20:31:59.081180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.081086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs" event={"ID":"d36081d8-f97d-46ed-953b-1a369beee2dd","Type":"ContainerDied","Data":"4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41"}
Sep 09 20:31:59.081180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.081123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs" event={"ID":"d36081d8-f97d-46ed-953b-1a369beee2dd","Type":"ContainerDied","Data":"a50ce089c73b021227c99be5c635dd216ad35aebb2ca7c6f118d93106f0264fa"}
Sep 09 20:31:59.081304 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.081182    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"
Sep 09 20:31:59.097214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.091320    2570 scope.go:117] "RemoveContainer" containerID="a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69"
Sep 09 20:31:59.097214 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:31:59.091657    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69\": container with ID starting with a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69 not found: ID does not exist" containerID="a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69"
Sep 09 20:31:59.097214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.091693    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69"} err="failed to get container status \"a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69\": rpc error: code = NotFound desc = could not find container \"a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69\": container with ID starting with a0271d6839e10cb5c8f65eaea73d6e9d4ba50637d6713aa5f1a6b852e2251c69 not found: ID does not exist"
Sep 09 20:31:59.097214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.091719    2570 scope.go:117] "RemoveContainer" containerID="4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41"
Sep 09 20:31:59.110179 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.110134    2570 scope.go:117] "RemoveContainer" containerID="4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41"
Sep 09 20:31:59.110497 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:31:59.110473    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41\": container with ID starting with 4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41 not found: ID does not exist" containerID="4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41"
Sep 09 20:31:59.110568 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.110505    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41"} err="failed to get container status \"4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41\": rpc error: code = NotFound desc = could not find container \"4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41\": container with ID starting with 4292e9805d796ffa084032b1d77dac7656fe4b45f7eb6b86909d1e6226b68b41 not found: ID does not exist"
Sep 09 20:31:59.128616 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.128560    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"]
Sep 09 20:31:59.140570 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.140551    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-812760-7b6cdf9545-625fs"]
Sep 09 20:31:59.154065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.154041    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"]
Sep 09 20:31:59.161495 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:31:59.161472    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4275e4e8-5d9f46c87b-lb55k"]
Sep 09 20:32:00.087180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.087148    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"]
Sep 09 20:32:00.087863 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.087833    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" containerID="cri-o://4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5" gracePeriod=30
Sep 09 20:32:00.308025 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.307991    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288a2167-adba-484c-ba7e-00fbad4f2c90" path="/var/lib/kubelet/pods/288a2167-adba-484c-ba7e-00fbad4f2c90/volumes"
Sep 09 20:32:00.308818 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.308793    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36081d8-f97d-46ed-953b-1a369beee2dd" path="/var/lib/kubelet/pods/d36081d8-f97d-46ed-953b-1a369beee2dd/volumes"
Sep 09 20:32:00.828409 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.828374    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"]
Sep 09 20:32:00.828996 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.828972    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36081d8-f97d-46ed-953b-1a369beee2dd" containerName="maas-api"
Sep 09 20:32:00.828996 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.828996    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36081d8-f97d-46ed-953b-1a369beee2dd" containerName="maas-api"
Sep 09 20:32:00.829200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.829019    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288a2167-adba-484c-ba7e-00fbad4f2c90" containerName="maas-api"
Sep 09 20:32:00.829200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.829026    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="288a2167-adba-484c-ba7e-00fbad4f2c90" containerName="maas-api"
Sep 09 20:32:00.829200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.829138    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36081d8-f97d-46ed-953b-1a369beee2dd" containerName="maas-api"
Sep 09 20:32:00.829200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.829159    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="288a2167-adba-484c-ba7e-00fbad4f2c90" containerName="maas-api"
Sep 09 20:32:00.832175 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.832154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.834629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.834612    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f4c2073a-openshift-default-dockercfg-w8c5k\""
Sep 09 20:32:00.844581 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.844552    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"]
Sep 09 20:32:00.998064 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-socket\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998283 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998070    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d1a28-9306-45b6-a835-2d444b447a47-istio-podinfo\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998283 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn78m\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-kube-api-access-wn78m\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998283 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-istio-token\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998283 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998250    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-data\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998283 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998271    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d1a28-9306-45b6-a835-2d444b447a47-istiod-ca-cert\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-credential-socket\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-certs\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:00.998513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:00.998416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-envoy\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.098998 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.098903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-socket\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d1a28-9306-45b6-a835-2d444b447a47-istio-podinfo\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn78m\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-kube-api-access-wn78m\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-istio-token\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099143    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-data\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d1a28-9306-45b6-a835-2d444b447a47-istiod-ca-cert\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-credential-socket\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099235    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-certs\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-envoy\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099351    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-socket\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099857 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099610    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-credential-socket\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099857 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-data\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.099857 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.099840    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-certs\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.100418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.100395    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d1a28-9306-45b6-a835-2d444b447a47-istiod-ca-cert\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.101738 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.101720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-envoy\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.101828 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.101808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d1a28-9306-45b6-a835-2d444b447a47-istio-podinfo\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.106731 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.106705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-istio-token\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.106917 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.106902    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn78m\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-kube-api-access-wn78m\") pod \"e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") " pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.143253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.143228    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:01.418275 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.418251    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"]
Sep 09 20:32:01.420037 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:32:01.419997    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922d1a28_9306_45b6_a835_2d444b447a47.slice/crio-df4314f40ebc8fa4596fa1affad8414b1c3a4da17133e5441093212d88362aca WatchSource:0}: Error finding container df4314f40ebc8fa4596fa1affad8414b1c3a4da17133e5441093212d88362aca: Status 404 returned error can't find the container with id df4314f40ebc8fa4596fa1affad8414b1c3a4da17133e5441093212d88362aca
Sep 09 20:32:01.422366 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.422334    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:01.422437 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.422400    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:01.422437 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:01.422431    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:02.109243 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:02.109208    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" event={"ID":"922d1a28-9306-45b6-a835-2d444b447a47","Type":"ContainerStarted","Data":"d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"}
Sep 09 20:32:02.109580 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:02.109266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" event={"ID":"922d1a28-9306-45b6-a835-2d444b447a47","Type":"ContainerStarted","Data":"df4314f40ebc8fa4596fa1affad8414b1c3a4da17133e5441093212d88362aca"}
Sep 09 20:32:02.129298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:02.129250    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podStartSLOduration=2.129233792 podStartE2EDuration="2.129233792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:02.127149508 +0000 UTC m=+926.354100269" watchObservedRunningTime="2026-09-09 20:32:02.129233792 +0000 UTC m=+926.356184553"
Sep 09 20:32:02.143877 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:02.143851    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:02.149194 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:02.149174    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:03.115373 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:03.115336    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:03.116365 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:03.116345    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:03.717753 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:03.717721    2570 patch_prober.go:28] interesting pod/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 20:32:03.717916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:03.717774    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:32:04.871441 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.871412    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"]
Sep 09 20:32:04.875512 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.875486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:04.881783 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.881404    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f4c2073a-serving-cert\""
Sep 09 20:32:04.886757 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.886677    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"]
Sep 09 20:32:04.938590 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.938563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-maas-api-tls\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:04.938733 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.938605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/649a4c60-ce92-4d7c-a080-867309f1c3ad-openshift-service-ca\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:04.938733 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.938710    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bx9q\" (UniqueName: \"kubernetes.io/projected/649a4c60-ce92-4d7c-a080-867309f1c3ad-kube-api-access-7bx9q\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:04.938820 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:04.938761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-metrics-certs\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.039274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.039243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-maas-api-tls\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.039438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.039286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/649a4c60-ce92-4d7c-a080-867309f1c3ad-openshift-service-ca\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.039438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.039361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bx9q\" (UniqueName: \"kubernetes.io/projected/649a4c60-ce92-4d7c-a080-867309f1c3ad-kube-api-access-7bx9q\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.039438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.039381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-metrics-certs\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.040064 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.039961    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/649a4c60-ce92-4d7c-a080-867309f1c3ad-openshift-service-ca\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.042061 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.042038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-metrics-certs\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.042155 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.042038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-maas-api-tls\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.046880 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.046859    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bx9q\" (UniqueName: \"kubernetes.io/projected/649a4c60-ce92-4d7c-a080-867309f1c3ad-kube-api-access-7bx9q\") pod \"maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.193320 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.193233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:05.362976 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.362922    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:32:05.442692 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442665    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75b0697-1b77-45b5-964c-91d58c786dae-istio-podinfo\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.442888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442719    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-certs\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.442888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442741    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-data\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.442888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442768    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75b0697-1b77-45b5-964c-91d58c786dae-istiod-ca-cert\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.442888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442798    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-envoy\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.442888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442855    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jbrz\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-kube-api-access-2jbrz\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.442888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442887    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-credential-socket\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.443256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442912    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-socket\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.443256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.442991    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-istio-token\") pod \"e75b0697-1b77-45b5-964c-91d58c786dae\" (UID: \"e75b0697-1b77-45b5-964c-91d58c786dae\") "
Sep 09 20:32:05.443256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-data" (OuterVolumeSpecName: "istio-data") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:05.443256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443157    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:05.443256 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443248    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75b0697-1b77-45b5-964c-91d58c786dae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443366    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443382    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443499    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443518    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443534    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443548    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.443754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.443561    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e75b0697-1b77-45b5-964c-91d58c786dae-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.445272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.445246    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e75b0697-1b77-45b5-964c-91d58c786dae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:32:05.445448 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.445427    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-istio-token" (OuterVolumeSpecName: "istio-token") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:32:05.445487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.445427    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-kube-api-access-2jbrz" (OuterVolumeSpecName: "kube-api-access-2jbrz") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "kube-api-access-2jbrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:32:05.445487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.445453    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e75b0697-1b77-45b5-964c-91d58c786dae" (UID: "e75b0697-1b77-45b5-964c-91d58c786dae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:05.470553 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.470527    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"]
Sep 09 20:32:05.472001 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:32:05.471974    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649a4c60_ce92_4d7c_a080_867309f1c3ad.slice/crio-da7b32d19874a0b60c09a64dd59da1ba37c40c6b0392affb368ae9b8e4b5d5b7 WatchSource:0}: Error finding container da7b32d19874a0b60c09a64dd59da1ba37c40c6b0392affb368ae9b8e4b5d5b7: Status 404 returned error can't find the container with id da7b32d19874a0b60c09a64dd59da1ba37c40c6b0392affb368ae9b8e4b5d5b7
Sep 09 20:32:05.544086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.544061    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.544086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.544084    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e75b0697-1b77-45b5-964c-91d58c786dae-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.544247 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.544093    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e75b0697-1b77-45b5-964c-91d58c786dae-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:05.544247 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:05.544103    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jbrz\" (UniqueName: \"kubernetes.io/projected/e75b0697-1b77-45b5-964c-91d58c786dae-kube-api-access-2jbrz\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:06.133213 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.133128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn" event={"ID":"649a4c60-ce92-4d7c-a080-867309f1c3ad","Type":"ContainerStarted","Data":"11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3"}
Sep 09 20:32:06.133213 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.133179    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn" event={"ID":"649a4c60-ce92-4d7c-a080-867309f1c3ad","Type":"ContainerStarted","Data":"da7b32d19874a0b60c09a64dd59da1ba37c40c6b0392affb368ae9b8e4b5d5b7"}
Sep 09 20:32:06.133698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.133265    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:06.135213 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.135192    2570 generic.go:356] "Generic (PLEG): container finished" podID="e75b0697-1b77-45b5-964c-91d58c786dae" containerID="4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5" exitCode=0
Sep 09 20:32:06.135334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.135220    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" event={"ID":"e75b0697-1b77-45b5-964c-91d58c786dae","Type":"ContainerDied","Data":"4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5"}
Sep 09 20:32:06.135334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.135237    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"
Sep 09 20:32:06.135334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.135268    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk" event={"ID":"e75b0697-1b77-45b5-964c-91d58c786dae","Type":"ContainerDied","Data":"fc6bbf2744a888271d5f37a09b237e5b79d4a7770665f50ece1ad35c8d1362e7"}
Sep 09 20:32:06.135334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.135292    2570 scope.go:117] "RemoveContainer" containerID="4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5"
Sep 09 20:32:06.146912 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.146891    2570 scope.go:117] "RemoveContainer" containerID="94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"
Sep 09 20:32:06.153065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.153012    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn" podStartSLOduration=1.769211927 podStartE2EDuration="2.15299343s" totalImagesPullingTime="383.781503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:06.149285184 +0000 UTC m=+930.376235948" watchObservedRunningTime="2026-09-09 20:32:06.15299343 +0000 UTC m=+930.379944194"
Sep 09 20:32:06.157772 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.157752    2570 scope.go:117] "RemoveContainer" containerID="4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5"
Sep 09 20:32:06.158116 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:32:06.158087    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5\": container with ID starting with 4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5 not found: ID does not exist" containerID="4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5"
Sep 09 20:32:06.158200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.158123    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5"} err="failed to get container status \"4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5\": rpc error: code = NotFound desc = could not find container \"4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5\": container with ID starting with 4cd200fac2f8b1c6c5508acb3bc205fd4242d5dbca897902c1136adbe43b17b5 not found: ID does not exist"
Sep 09 20:32:06.158200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.158144    2570 scope.go:117] "RemoveContainer" containerID="94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"
Sep 09 20:32:06.158450 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:32:06.158432    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98\": container with ID starting with 94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98 not found: ID does not exist" containerID="94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"
Sep 09 20:32:06.158504 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.158459    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98"} err="failed to get container status \"94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98\": rpc error: code = NotFound desc = could not find container \"94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98\": container with ID starting with 94151dbade509198cf3490b8081a57f6557f9d016fd250e01166a89b2a9f0b98 not found: ID does not exist"
Sep 09 20:32:06.172546 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.172522    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"]
Sep 09 20:32:06.174544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.174525    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk"]
Sep 09 20:32:06.307471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:06.307435    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" path="/var/lib/kubelet/pods/e75b0697-1b77-45b5-964c-91d58c786dae/volumes"
Sep 09 20:32:12.146953 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:12.146908    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:26.259444 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:26.259411    2570 generic.go:356] "Generic (PLEG): container finished" podID="922d1a28-9306-45b6-a835-2d444b447a47" containerID="d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2" exitCode=0
Sep 09 20:32:26.259877 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:26.259487    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" event={"ID":"922d1a28-9306-45b6-a835-2d444b447a47","Type":"ContainerDied","Data":"d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"}
Sep 09 20:32:26.259923 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:26.259905    2570 scope.go:117] "RemoveContainer" containerID="d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"
Sep 09 20:32:26.261124 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:26.261088    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:26.261201 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:26.261176    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:26.261243 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:26.261210    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:27.267635 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:27.267597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" event={"ID":"922d1a28-9306-45b6-a835-2d444b447a47","Type":"ContainerStarted","Data":"bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d"}
Sep 09 20:32:28.143678 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:28.143645    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:28.144419 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:28.144398    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:28.144509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:28.144446    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:29.144241 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:29.144203    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:29.144620 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:29.144295    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:30.144179 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:30.144144    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:30.144349 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:30.144196    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:31.144021 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:31.143979    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:31.144206 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:31.144045    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:32.144055 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:32.144020    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:32.144409 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:32.144077    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:33.116149 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:33.116104    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:33.143561 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:33.143522    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:33.143729 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:33.143576    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:34.144340 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:34.144305    2570 patch_prober.go:28] interesting pod/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 20:32:34.144707 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:34.144364    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 20:32:35.148237 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.148203    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:35.149242 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.149221    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:35.442412 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.442324    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"]
Sep 09 20:32:35.442594 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.442570    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn" podUID="649a4c60-ce92-4d7c-a080-867309f1c3ad" containerName="maas-api" containerID="cri-o://11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3" gracePeriod=30
Sep 09 20:32:35.692069 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.692043    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:35.764539 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.764457    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-metrics-certs\") pod \"649a4c60-ce92-4d7c-a080-867309f1c3ad\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") "
Sep 09 20:32:35.764539 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.764514    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-maas-api-tls\") pod \"649a4c60-ce92-4d7c-a080-867309f1c3ad\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") "
Sep 09 20:32:35.764739 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.764602    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/649a4c60-ce92-4d7c-a080-867309f1c3ad-openshift-service-ca\") pod \"649a4c60-ce92-4d7c-a080-867309f1c3ad\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") "
Sep 09 20:32:35.764803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.764741    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bx9q\" (UniqueName: \"kubernetes.io/projected/649a4c60-ce92-4d7c-a080-867309f1c3ad-kube-api-access-7bx9q\") pod \"649a4c60-ce92-4d7c-a080-867309f1c3ad\" (UID: \"649a4c60-ce92-4d7c-a080-867309f1c3ad\") "
Sep 09 20:32:35.765016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.764991    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/649a4c60-ce92-4d7c-a080-867309f1c3ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "649a4c60-ce92-4d7c-a080-867309f1c3ad" (UID: "649a4c60-ce92-4d7c-a080-867309f1c3ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:32:35.768708 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.768634    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649a4c60-ce92-4d7c-a080-867309f1c3ad-kube-api-access-7bx9q" (OuterVolumeSpecName: "kube-api-access-7bx9q") pod "649a4c60-ce92-4d7c-a080-867309f1c3ad" (UID: "649a4c60-ce92-4d7c-a080-867309f1c3ad"). InnerVolumeSpecName "kube-api-access-7bx9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:32:35.770564 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.770536    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "649a4c60-ce92-4d7c-a080-867309f1c3ad" (UID: "649a4c60-ce92-4d7c-a080-867309f1c3ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:32:35.770674 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.770633    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "649a4c60-ce92-4d7c-a080-867309f1c3ad" (UID: "649a4c60-ce92-4d7c-a080-867309f1c3ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:32:35.802087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.802054    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"]
Sep 09 20:32:35.866432 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.866397    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bx9q\" (UniqueName: \"kubernetes.io/projected/649a4c60-ce92-4d7c-a080-867309f1c3ad-kube-api-access-7bx9q\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:35.866432 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.866427    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:35.866432 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.866441    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/649a4c60-ce92-4d7c-a080-867309f1c3ad-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:35.866663 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:35.866452    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/649a4c60-ce92-4d7c-a080-867309f1c3ad-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:36.328122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.328092    2570 generic.go:356] "Generic (PLEG): container finished" podID="649a4c60-ce92-4d7c-a080-867309f1c3ad" containerID="11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3" exitCode=0
Sep 09 20:32:36.328515 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.328147    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"
Sep 09 20:32:36.328515 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.328178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn" event={"ID":"649a4c60-ce92-4d7c-a080-867309f1c3ad","Type":"ContainerDied","Data":"11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3"}
Sep 09 20:32:36.328515 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.328262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn" event={"ID":"649a4c60-ce92-4d7c-a080-867309f1c3ad","Type":"ContainerDied","Data":"da7b32d19874a0b60c09a64dd59da1ba37c40c6b0392affb368ae9b8e4b5d5b7"}
Sep 09 20:32:36.328515 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.328289    2570 scope.go:117] "RemoveContainer" containerID="11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3"
Sep 09 20:32:36.328882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.328562    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy" containerID="cri-o://bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d" gracePeriod=30
Sep 09 20:32:36.338656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.338627    2570 scope.go:117] "RemoveContainer" containerID="11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3"
Sep 09 20:32:36.338984 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:32:36.338964    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3\": container with ID starting with 11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3 not found: ID does not exist" containerID="11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3"
Sep 09 20:32:36.339056 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.338992    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3"} err="failed to get container status \"11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3\": rpc error: code = NotFound desc = could not find container \"11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3\": container with ID starting with 11aa7fbccad1924e24c3dce642ad8bf1b5690b9399aae4020363c3e2d4b5ada3 not found: ID does not exist"
Sep 09 20:32:36.366334 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.366310    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"]
Sep 09 20:32:36.370147 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:36.370122    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f4c2073a-5c8955d4d7-cr5cn"]
Sep 09 20:32:38.307041 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:38.307007    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="649a4c60-ce92-4d7c-a080-867309f1c3ad" path="/var/lib/kubelet/pods/649a4c60-ce92-4d7c-a080-867309f1c3ad/volumes"
Sep 09 20:32:39.689762 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.689729    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"]
Sep 09 20:32:39.690345 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690314    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy"
Sep 09 20:32:39.690345 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690335    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy"
Sep 09 20:32:39.690345 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690346    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy"
Sep 09 20:32:39.690523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690352    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy"
Sep 09 20:32:39.690523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690369    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="649a4c60-ce92-4d7c-a080-867309f1c3ad" containerName="maas-api"
Sep 09 20:32:39.690523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690377    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="649a4c60-ce92-4d7c-a080-867309f1c3ad" containerName="maas-api"
Sep 09 20:32:39.690523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690493    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy"
Sep 09 20:32:39.690523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690508    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e75b0697-1b77-45b5-964c-91d58c786dae" containerName="istio-proxy"
Sep 09 20:32:39.690523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.690518    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="649a4c60-ce92-4d7c-a080-867309f1c3ad" containerName="maas-api"
Sep 09 20:32:39.693906 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.693882    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.696381 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.696356    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-08bc01-openshift-default-dockercfg-czx9w\""
Sep 09 20:32:39.707135 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.707117    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"]
Sep 09 20:32:39.809909 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.809875    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-data\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-certs\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810094    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-credential-socket\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx7kz\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-kube-api-access-rx7kz\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810200    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57af14c-4207-4e50-8854-25935f7d1357-istio-podinfo\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-envoy\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810316 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810281    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-istio-token\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810357 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57af14c-4207-4e50-8854-25935f7d1357-istiod-ca-cert\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.810404 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.810389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-socket\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.911803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-certs\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.911803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-credential-socket\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx7kz\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-kube-api-access-rx7kz\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57af14c-4207-4e50-8854-25935f7d1357-istio-podinfo\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-envoy\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-istio-token\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.911992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57af14c-4207-4e50-8854-25935f7d1357-istiod-ca-cert\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-socket\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912089    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-data\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912247    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-certs\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912291    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-credential-socket\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912364    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-data\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912522    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-socket\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.912813 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.912790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57af14c-4207-4e50-8854-25935f7d1357-istiod-ca-cert\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.914288 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.914261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-envoy\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.914554 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.914537    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57af14c-4207-4e50-8854-25935f7d1357-istio-podinfo\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.920326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.920305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx7kz\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-kube-api-access-rx7kz\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:39.920489 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:39.920466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-istio-token\") pod \"e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") " pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:40.005737 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:40.005667    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:40.287852 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:40.287828    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"]
Sep 09 20:32:40.289733 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:32:40.289702    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57af14c_4207_4e50_8854_25935f7d1357.slice/crio-787618cc65da8d93e3bfc12da8dcc0230038a2130280372553e3c781fcc642f5 WatchSource:0}: Error finding container 787618cc65da8d93e3bfc12da8dcc0230038a2130280372553e3c781fcc642f5: Status 404 returned error can't find the container with id 787618cc65da8d93e3bfc12da8dcc0230038a2130280372553e3c781fcc642f5
Sep 09 20:32:40.292749 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:40.292707    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:40.292856 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:40.292803    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:40.292856 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:40.292845    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:32:40.350996 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:40.350967    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" event={"ID":"e57af14c-4207-4e50-8854-25935f7d1357","Type":"ContainerStarted","Data":"787618cc65da8d93e3bfc12da8dcc0230038a2130280372553e3c781fcc642f5"}
Sep 09 20:32:41.358387 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.358353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" event={"ID":"e57af14c-4207-4e50-8854-25935f7d1357","Type":"ContainerStarted","Data":"8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"}
Sep 09 20:32:41.379915 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.379871    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podStartSLOduration=2.379855849 podStartE2EDuration="2.379855849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:41.378856555 +0000 UTC m=+965.605807316" watchObservedRunningTime="2026-09-09 20:32:41.379855849 +0000 UTC m=+965.606806610"
Sep 09 20:32:41.597435 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.597380    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:41.628815 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.628786    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d1a28-9306-45b6-a835-2d444b447a47-istio-podinfo\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629005 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.628835    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-certs\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629005 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.628898    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-credential-socket\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629005 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.628956    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-data\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629005 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.628987    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-envoy\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d1a28-9306-45b6-a835-2d444b447a47-istiod-ca-cert\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629095    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-istio-token\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629113    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:41.629244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629161    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-socket\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629190    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:41.629509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629216    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn78m\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-kube-api-access-wn78m\") pod \"922d1a28-9306-45b6-a835-2d444b447a47\" (UID: \"922d1a28-9306-45b6-a835-2d444b447a47\") "
Sep 09 20:32:41.629509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629287    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-data" (OuterVolumeSpecName: "istio-data") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:41.629509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629400    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922d1a28-9306-45b6-a835-2d444b447a47-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:32:41.629509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629482    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:41.629761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629683    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.629761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629706    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.629761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629721    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.629761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629734    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/922d1a28-9306-45b6-a835-2d444b447a47-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.629761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.629743    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.631505 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.631472    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-istio-token" (OuterVolumeSpecName: "istio-token") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:32:41.631632 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.631605    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:32:41.631768 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.631747    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/922d1a28-9306-45b6-a835-2d444b447a47-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:32:41.631851 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.631767    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-kube-api-access-wn78m" (OuterVolumeSpecName: "kube-api-access-wn78m") pod "922d1a28-9306-45b6-a835-2d444b447a47" (UID: "922d1a28-9306-45b6-a835-2d444b447a47"). InnerVolumeSpecName "kube-api-access-wn78m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:32:41.730487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.730453    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/922d1a28-9306-45b6-a835-2d444b447a47-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.730487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.730480    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.730487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.730490    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn78m\" (UniqueName: \"kubernetes.io/projected/922d1a28-9306-45b6-a835-2d444b447a47-kube-api-access-wn78m\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:41.730685 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:41.730499    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/922d1a28-9306-45b6-a835-2d444b447a47-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:32:42.006758 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.006727    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:42.011128 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.011109    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:42.364842 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.364810    2570 generic.go:356] "Generic (PLEG): container finished" podID="922d1a28-9306-45b6-a835-2d444b447a47" containerID="bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d" exitCode=0
Sep 09 20:32:42.365252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.364855    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"
Sep 09 20:32:42.365252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.364859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" event={"ID":"922d1a28-9306-45b6-a835-2d444b447a47","Type":"ContainerDied","Data":"bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d"}
Sep 09 20:32:42.365252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.364902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j" event={"ID":"922d1a28-9306-45b6-a835-2d444b447a47","Type":"ContainerDied","Data":"df4314f40ebc8fa4596fa1affad8414b1c3a4da17133e5441093212d88362aca"}
Sep 09 20:32:42.365252 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.364923    2570 scope.go:117] "RemoveContainer" containerID="bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d"
Sep 09 20:32:42.365458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.365259    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:42.366402 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.366373    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:32:42.374563 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.374548    2570 scope.go:117] "RemoveContainer" containerID="d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"
Sep 09 20:32:42.381311 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.381290    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"]
Sep 09 20:32:42.383355 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.383342    2570 scope.go:117] "RemoveContainer" containerID="bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d"
Sep 09 20:32:42.383632 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:32:42.383616    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d\": container with ID starting with bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d not found: ID does not exist" containerID="bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d"
Sep 09 20:32:42.383681 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.383638    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d"} err="failed to get container status \"bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d\": rpc error: code = NotFound desc = could not find container \"bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d\": container with ID starting with bb5bf3a665c369b100c371457388389561efa6e8d5bc8683bd7dcdf634ae555d not found: ID does not exist"
Sep 09 20:32:42.383681 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.383653    2570 scope.go:117] "RemoveContainer" containerID="d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"
Sep 09 20:32:42.383882 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:32:42.383863    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2\": container with ID starting with d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2 not found: ID does not exist" containerID="d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"
Sep 09 20:32:42.383982 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.383891    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2"} err="failed to get container status \"d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2\": rpc error: code = NotFound desc = could not find container \"d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2\": container with ID starting with d1aea04600511de9131a1962821e61b1bea3c2a6264a66b42402a4da6d4981a2 not found: ID does not exist"
Sep 09 20:32:42.388726 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:42.388700    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j"]
Sep 09 20:32:44.308315 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.308286    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922d1a28-9306-45b6-a835-2d444b447a47" path="/var/lib/kubelet/pods/922d1a28-9306-45b6-a835-2d444b447a47/volumes"
Sep 09 20:32:44.697264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.697229    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"]
Sep 09 20:32:44.697860 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.697838    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy"
Sep 09 20:32:44.697860 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.697859    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy"
Sep 09 20:32:44.698057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.697871    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy"
Sep 09 20:32:44.698057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.697877    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy"
Sep 09 20:32:44.698057 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.697987    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy"
Sep 09 20:32:44.702465 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.702443    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.704914 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.704895    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-08bc01-serving-cert\""
Sep 09 20:32:44.714745 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.714722    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"]
Sep 09 20:32:44.758084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.758057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-metrics-certs\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.758231 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.758090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-maas-api-tls\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.758231 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.758136    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqpql\" (UniqueName: \"kubernetes.io/projected/d62afbf2-2094-4e6f-95c3-a10ffa81134a-kube-api-access-sqpql\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.758231 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.758153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d62afbf2-2094-4e6f-95c3-a10ffa81134a-openshift-service-ca\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.859058 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.859031    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-metrics-certs\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.859214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.859075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-maas-api-tls\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.859214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.859154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqpql\" (UniqueName: \"kubernetes.io/projected/d62afbf2-2094-4e6f-95c3-a10ffa81134a-kube-api-access-sqpql\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.859214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.859185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d62afbf2-2094-4e6f-95c3-a10ffa81134a-openshift-service-ca\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.859806 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.859780    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d62afbf2-2094-4e6f-95c3-a10ffa81134a-openshift-service-ca\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.861656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.861633    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-maas-api-tls\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.861656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.861645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-metrics-certs\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:44.868042 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:44.868017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqpql\" (UniqueName: \"kubernetes.io/projected/d62afbf2-2094-4e6f-95c3-a10ffa81134a-kube-api-access-sqpql\") pod \"maas-api-e2e-explicit-08bc01-759945c67d-zv9ls\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:45.014533 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:45.014460    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:45.291883 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:45.291854    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"]
Sep 09 20:32:45.293063 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:32:45.293025    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62afbf2_2094_4e6f_95c3_a10ffa81134a.slice/crio-f3f694524e7e1c07e3ee200693d468fbaef5f89eb3d4a1ce35bbce9c8009e0f5 WatchSource:0}: Error finding container f3f694524e7e1c07e3ee200693d468fbaef5f89eb3d4a1ce35bbce9c8009e0f5: Status 404 returned error can't find the container with id f3f694524e7e1c07e3ee200693d468fbaef5f89eb3d4a1ce35bbce9c8009e0f5
Sep 09 20:32:45.294629 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:45.294608    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:32:45.387975 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:45.387911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls" event={"ID":"d62afbf2-2094-4e6f-95c3-a10ffa81134a","Type":"ContainerStarted","Data":"f3f694524e7e1c07e3ee200693d468fbaef5f89eb3d4a1ce35bbce9c8009e0f5"}
Sep 09 20:32:46.396069 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:46.396033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls" event={"ID":"d62afbf2-2094-4e6f-95c3-a10ffa81134a","Type":"ContainerStarted","Data":"78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb"}
Sep 09 20:32:46.396523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:46.396171    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:46.414458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:46.414408    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls" podStartSLOduration=1.9506701610000001 podStartE2EDuration="2.414394274s" totalImagesPullingTime="463.724113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:32:46.412903274 +0000 UTC m=+970.639854037" watchObservedRunningTime="2026-09-09 20:32:46.414394274 +0000 UTC m=+970.641345035"
Sep 09 20:32:52.415232 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:52.415192    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:32:58.407127 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:58.407081    2570 patch_prober.go:28] interesting pod/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 20:32:58.407528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:32:58.407174    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 20:33:00.476149 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:00.476071    2570 generic.go:356] "Generic (PLEG): container finished" podID="e57af14c-4207-4e50-8854-25935f7d1357" containerID="8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201" exitCode=0
Sep 09 20:33:00.476590 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:00.476145    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" event={"ID":"e57af14c-4207-4e50-8854-25935f7d1357","Type":"ContainerDied","Data":"8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"}
Sep 09 20:33:00.476590 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:00.476582    2570 scope.go:117] "RemoveContainer" containerID="8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"
Sep 09 20:33:00.477676 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:00.477635    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:33:00.477736 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:00.477722    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:33:00.477800 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:00.477763    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:33:01.483568 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:01.483534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" event={"ID":"e57af14c-4207-4e50-8854-25935f7d1357","Type":"ContainerStarted","Data":"49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15"}
Sep 09 20:33:02.006951 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:02.006893    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:33:02.007241 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:02.007208    2570 patch_prober.go:28] interesting pod/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 20:33:02.007330 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:02.007284    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 20:33:03.006778 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:03.006734    2570 patch_prober.go:28] interesting pod/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 20:33:03.007327 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:03.006802    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 20:33:04.007411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:04.007006    2570 patch_prober.go:28] interesting pod/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 20:33:04.007411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:04.007069    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 20:33:05.005956 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:05.005896    2570 patch_prober.go:28] interesting pod/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 20:33:05.006155 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:05.005983    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 20:33:06.006331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:06.006291    2570 patch_prober.go:28] interesting pod/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 09 20:33:06.006967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:06.006912    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 09 20:33:07.010028 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:07.009987    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:33:07.010737 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:07.010448    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:33:07.011248 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:33:07.011229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:34:23.775261 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.775223    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"]
Sep 09 20:34:23.776003 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.775968    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="922d1a28-9306-45b6-a835-2d444b447a47" containerName="istio-proxy"
Sep 09 20:34:23.779482 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.779466    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.782264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.782247    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-36f068b3-serving-cert\""
Sep 09 20:34:23.791878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.791857    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"]
Sep 09 20:34:23.841886 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.841854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec2a75a-c923-4112-a4b1-e4585f766c82-openshift-service-ca\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.842013 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.841995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.842076 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.842030    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-metrics-certs\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.842145 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.842124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgt5r\" (UniqueName: \"kubernetes.io/projected/0ec2a75a-c923-4112-a4b1-e4585f766c82-kube-api-access-dgt5r\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.943483 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.943458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec2a75a-c923-4112-a4b1-e4585f766c82-openshift-service-ca\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.943616 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.943539    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.943616 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.943567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-metrics-certs\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.943616 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.943597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgt5r\" (UniqueName: \"kubernetes.io/projected/0ec2a75a-c923-4112-a4b1-e4585f766c82-kube-api-access-dgt5r\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.943783 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:34:23.943644    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-serving-cert: secret "maas-api-e2e-mt-36f068b3-serving-cert" not found
Sep 09 20:34:23.943783 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:34:23.943742    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls podName:0ec2a75a-c923-4112-a4b1-e4585f766c82 nodeName:}" failed. No retries permitted until 2026-09-09 20:34:24.443720403 +0000 UTC m=+1068.670671155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls") pod "maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" (UID: "0ec2a75a-c923-4112-a4b1-e4585f766c82") : secret "maas-api-e2e-mt-36f068b3-serving-cert" not found
Sep 09 20:34:23.944167 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.944143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec2a75a-c923-4112-a4b1-e4585f766c82-openshift-service-ca\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.946178 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.946163    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-metrics-certs\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:23.957555 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:23.957535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgt5r\" (UniqueName: \"kubernetes.io/projected/0ec2a75a-c923-4112-a4b1-e4585f766c82-kube-api-access-dgt5r\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:24.450479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:24.450438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:24.453206 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:24.453177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls\") pod \"maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:24.691869 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:24.691613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:24.984534 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:24.984461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"]
Sep 09 20:34:24.988125 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:34:24.988083    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec2a75a_c923_4112_a4b1_e4585f766c82.slice/crio-e13b299ee15e30181ab1dd6eb54489d6d0aebaa1c75af9e4b1f14302f9ff0379 WatchSource:0}: Error finding container e13b299ee15e30181ab1dd6eb54489d6d0aebaa1c75af9e4b1f14302f9ff0379: Status 404 returned error can't find the container with id e13b299ee15e30181ab1dd6eb54489d6d0aebaa1c75af9e4b1f14302f9ff0379
Sep 09 20:34:25.955846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:25.955809    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" event={"ID":"0ec2a75a-c923-4112-a4b1-e4585f766c82","Type":"ContainerStarted","Data":"db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649"}
Sep 09 20:34:25.956046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:25.955872    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" event={"ID":"0ec2a75a-c923-4112-a4b1-e4585f766c82","Type":"ContainerStarted","Data":"e13b299ee15e30181ab1dd6eb54489d6d0aebaa1c75af9e4b1f14302f9ff0379"}
Sep 09 20:34:25.956046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:25.955902    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:25.982179 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:25.982128    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" podStartSLOduration=2.604310279 podStartE2EDuration="2.982111896s" totalImagesPullingTime="377.801617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:34:25.979179484 +0000 UTC m=+1070.206130246" watchObservedRunningTime="2026-09-09 20:34:25.982111896 +0000 UTC m=+1070.209062656"
Sep 09 20:34:31.966894 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:31.966820    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:34:34.268202 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.268169    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"]
Sep 09 20:34:34.268606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.268391    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls" podUID="d62afbf2-2094-4e6f-95c3-a10ffa81134a" containerName="maas-api" containerID="cri-o://78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb" gracePeriod=30
Sep 09 20:34:34.550854 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.550820    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:34:34.657391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.657357    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d62afbf2-2094-4e6f-95c3-a10ffa81134a-openshift-service-ca\") pod \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") "
Sep 09 20:34:34.657391 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.657399    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqpql\" (UniqueName: \"kubernetes.io/projected/d62afbf2-2094-4e6f-95c3-a10ffa81134a-kube-api-access-sqpql\") pod \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") "
Sep 09 20:34:34.657660 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.657472    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-metrics-certs\") pod \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") "
Sep 09 20:34:34.657660 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.657516    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-maas-api-tls\") pod \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\" (UID: \"d62afbf2-2094-4e6f-95c3-a10ffa81134a\") "
Sep 09 20:34:34.657809 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.657779    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d62afbf2-2094-4e6f-95c3-a10ffa81134a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d62afbf2-2094-4e6f-95c3-a10ffa81134a" (UID: "d62afbf2-2094-4e6f-95c3-a10ffa81134a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:34.658155 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.658132    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d62afbf2-2094-4e6f-95c3-a10ffa81134a-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:34.659715 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.659690    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d62afbf2-2094-4e6f-95c3-a10ffa81134a" (UID: "d62afbf2-2094-4e6f-95c3-a10ffa81134a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:34:34.659833 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.659812    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d62afbf2-2094-4e6f-95c3-a10ffa81134a-kube-api-access-sqpql" (OuterVolumeSpecName: "kube-api-access-sqpql") pod "d62afbf2-2094-4e6f-95c3-a10ffa81134a" (UID: "d62afbf2-2094-4e6f-95c3-a10ffa81134a"). InnerVolumeSpecName "kube-api-access-sqpql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:34:34.659882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.659838    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d62afbf2-2094-4e6f-95c3-a10ffa81134a" (UID: "d62afbf2-2094-4e6f-95c3-a10ffa81134a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:34:34.759407 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.759372    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqpql\" (UniqueName: \"kubernetes.io/projected/d62afbf2-2094-4e6f-95c3-a10ffa81134a-kube-api-access-sqpql\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:34.759407 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.759400    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:34.759407 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:34.759411    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d62afbf2-2094-4e6f-95c3-a10ffa81134a-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:35.008313 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.008281    2570 generic.go:356] "Generic (PLEG): container finished" podID="d62afbf2-2094-4e6f-95c3-a10ffa81134a" containerID="78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb" exitCode=0
Sep 09 20:34:35.008476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.008324    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"
Sep 09 20:34:35.008476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.008332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls" event={"ID":"d62afbf2-2094-4e6f-95c3-a10ffa81134a","Type":"ContainerDied","Data":"78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb"}
Sep 09 20:34:35.008476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.008383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls" event={"ID":"d62afbf2-2094-4e6f-95c3-a10ffa81134a","Type":"ContainerDied","Data":"f3f694524e7e1c07e3ee200693d468fbaef5f89eb3d4a1ce35bbce9c8009e0f5"}
Sep 09 20:34:35.008476 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.008413    2570 scope.go:117] "RemoveContainer" containerID="78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb"
Sep 09 20:34:35.019779 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.019759    2570 scope.go:117] "RemoveContainer" containerID="78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb"
Sep 09 20:34:35.020111 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:34:35.020087    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb\": container with ID starting with 78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb not found: ID does not exist" containerID="78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb"
Sep 09 20:34:35.020179 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.020121    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb"} err="failed to get container status \"78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb\": rpc error: code = NotFound desc = could not find container \"78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb\": container with ID starting with 78fd2245b4790551a77ae2ba87c2c16df6ab556f00c0f0b3d320dd37ee39ccdb not found: ID does not exist"
Sep 09 20:34:35.030621 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.030595    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"]
Sep 09 20:34:35.034421 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:35.034401    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-08bc01-759945c67d-zv9ls"]
Sep 09 20:34:36.308665 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:36.308632    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d62afbf2-2094-4e6f-95c3-a10ffa81134a" path="/var/lib/kubelet/pods/d62afbf2-2094-4e6f-95c3-a10ffa81134a/volumes"
Sep 09 20:34:42.052179 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:42.052143    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"]
Sep 09 20:34:42.052645 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:42.052404    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy" containerID="cri-o://49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15" gracePeriod=30
Sep 09 20:34:47.314588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.314525    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:34:47.484686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484653    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-credential-socket\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.484874 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484722    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-data\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.484874 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484748    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-istio-token\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.484874 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484790    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx7kz\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-kube-api-access-rx7kz\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.484874 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-certs\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.484874 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484860    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-envoy\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.484874 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484878    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57af14c-4207-4e50-8854-25935f7d1357-istiod-ca-cert\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.485253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484897    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-socket\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.485253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.484961    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:34:47.485253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485010    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57af14c-4207-4e50-8854-25935f7d1357-istio-podinfo\") pod \"e57af14c-4207-4e50-8854-25935f7d1357\" (UID: \"e57af14c-4207-4e50-8854-25935f7d1357\") "
Sep 09 20:34:47.485253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485029    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-data" (OuterVolumeSpecName: "istio-data") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:34:47.485253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485203    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:34:47.485511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485295    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57af14c-4207-4e50-8854-25935f7d1357-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:47.485511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485424    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.485511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485442    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e57af14c-4207-4e50-8854-25935f7d1357-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.485511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485454    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.485511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485466    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.485829 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.485594    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:34:47.487285 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.487243    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-istio-token" (OuterVolumeSpecName: "istio-token") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:34:47.487285 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.487259    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:34:47.487429 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.487284    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-kube-api-access-rx7kz" (OuterVolumeSpecName: "kube-api-access-rx7kz") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "kube-api-access-rx7kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:34:47.487429 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.487289    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e57af14c-4207-4e50-8854-25935f7d1357-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e57af14c-4207-4e50-8854-25935f7d1357" (UID: "e57af14c-4207-4e50-8854-25935f7d1357"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:34:47.586012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.585954    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx7kz\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-kube-api-access-rx7kz\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.586012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.585980    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.586012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.585989    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e57af14c-4207-4e50-8854-25935f7d1357-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.586012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.585997    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e57af14c-4207-4e50-8854-25935f7d1357-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:47.586012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:47.586005    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e57af14c-4207-4e50-8854-25935f7d1357-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:34:48.083458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.083422    2570 generic.go:356] "Generic (PLEG): container finished" podID="e57af14c-4207-4e50-8854-25935f7d1357" containerID="49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15" exitCode=0
Sep 09 20:34:48.083458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.083463    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" event={"ID":"e57af14c-4207-4e50-8854-25935f7d1357","Type":"ContainerDied","Data":"49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15"}
Sep 09 20:34:48.083703 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.083488    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"
Sep 09 20:34:48.083703 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.083513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd" event={"ID":"e57af14c-4207-4e50-8854-25935f7d1357","Type":"ContainerDied","Data":"787618cc65da8d93e3bfc12da8dcc0230038a2130280372553e3c781fcc642f5"}
Sep 09 20:34:48.083703 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.083536    2570 scope.go:117] "RemoveContainer" containerID="49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15"
Sep 09 20:34:48.094959 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.094912    2570 scope.go:117] "RemoveContainer" containerID="8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"
Sep 09 20:34:48.103340 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.103315    2570 scope.go:117] "RemoveContainer" containerID="49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15"
Sep 09 20:34:48.103667 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:34:48.103639    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15\": container with ID starting with 49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15 not found: ID does not exist" containerID="49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15"
Sep 09 20:34:48.103765 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.103677    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15"} err="failed to get container status \"49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15\": rpc error: code = NotFound desc = could not find container \"49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15\": container with ID starting with 49cc0d270b1a730ed6e9d41f23c98deed56134bb5a78600c5a1e07197a3acc15 not found: ID does not exist"
Sep 09 20:34:48.103765 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.103701    2570 scope.go:117] "RemoveContainer" containerID="8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"
Sep 09 20:34:48.104017 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:34:48.103998    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201\": container with ID starting with 8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201 not found: ID does not exist" containerID="8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"
Sep 09 20:34:48.104085 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.104024    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201"} err="failed to get container status \"8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201\": rpc error: code = NotFound desc = could not find container \"8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201\": container with ID starting with 8c57bc809836f15a50ea356ffd1527ce565b47decaee2c9a3dd61a92f932a201 not found: ID does not exist"
Sep 09 20:34:48.112463 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.112436    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"]
Sep 09 20:34:48.121439 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.121418    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd"]
Sep 09 20:34:48.307263 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:48.307236    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57af14c-4207-4e50-8854-25935f7d1357" path="/var/lib/kubelet/pods/e57af14c-4207-4e50-8854-25935f7d1357/volumes"
Sep 09 20:34:51.258796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.258756    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"]
Sep 09 20:34:51.259783 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.259757    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62afbf2-2094-4e6f-95c3-a10ffa81134a" containerName="maas-api"
Sep 09 20:34:51.259896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.259790    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62afbf2-2094-4e6f-95c3-a10ffa81134a" containerName="maas-api"
Sep 09 20:34:51.259896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.259822    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy"
Sep 09 20:34:51.259896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.259832    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy"
Sep 09 20:34:51.259896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.259870    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy"
Sep 09 20:34:51.259896 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.259880    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy"
Sep 09 20:34:51.260168 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.260095    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy"
Sep 09 20:34:51.260168 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.260120    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d62afbf2-2094-4e6f-95c3-a10ffa81134a" containerName="maas-api"
Sep 09 20:34:51.265753 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.265731    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.269726 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.269700    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-82f543\"/\"openshift-service-ca.crt\""
Sep 09 20:34:51.270595 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.270569    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-82f543\"/\"kube-root-ca.crt\""
Sep 09 20:34:51.270723 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.270587    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-82f543\"/\"noten-model-82f543-kserve-self-signed-certs\""
Sep 09 20:34:51.270723 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.270619    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-82f543\"/\"default-dockercfg-fhk27\""
Sep 09 20:34:51.271046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.271022    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"]
Sep 09 20:34:51.423569 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.423537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tmp-dir\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.423758 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.423588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tls-certs\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.423758 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.423608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-dshm\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.423758 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.423714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcq8\" (UniqueName: \"kubernetes.io/projected/bfc14335-44f7-4ead-afe5-f045cb9f20ba-kube-api-access-cwcq8\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.423946 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.423809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-model-cache\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.423946 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.423840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-home\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.524785 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.524688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tls-certs\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.524785 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.524742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-dshm\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.525212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.525179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcq8\" (UniqueName: \"kubernetes.io/projected/bfc14335-44f7-4ead-afe5-f045cb9f20ba-kube-api-access-cwcq8\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.525446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.525427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-model-cache\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.525569 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.525554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-home\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.525709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.525696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tmp-dir\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.525839 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.525749    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-model-cache\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.526197 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.526158    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-home\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.526290 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.526211    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tmp-dir\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.528003 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.527977    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-dshm\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.528340 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.528324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tls-certs\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.547189 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.547161    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcq8\" (UniqueName: \"kubernetes.io/projected/bfc14335-44f7-4ead-afe5-f045cb9f20ba-kube-api-access-cwcq8\") pod \"noten-model-82f543-kserve-8569bd8759-lqt5p\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") " pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.576128 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.576099    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:34:51.871011 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:51.870984    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"]
Sep 09 20:34:51.873022 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:34:51.872954    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfc14335_44f7_4ead_afe5_f045cb9f20ba.slice/crio-3b21f7dcaa8f6c1ce91a8d2ca928c13a90a6f5920b6e09e46009e1b44f9e13c7 WatchSource:0}: Error finding container 3b21f7dcaa8f6c1ce91a8d2ca928c13a90a6f5920b6e09e46009e1b44f9e13c7: Status 404 returned error can't find the container with id 3b21f7dcaa8f6c1ce91a8d2ca928c13a90a6f5920b6e09e46009e1b44f9e13c7
Sep 09 20:34:52.109027 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:52.108993    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p" event={"ID":"bfc14335-44f7-4ead-afe5-f045cb9f20ba","Type":"ContainerStarted","Data":"9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c"}
Sep 09 20:34:52.109171 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:52.109037    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p" event={"ID":"bfc14335-44f7-4ead-afe5-f045cb9f20ba","Type":"ContainerStarted","Data":"3b21f7dcaa8f6c1ce91a8d2ca928c13a90a6f5920b6e09e46009e1b44f9e13c7"}
Sep 09 20:34:52.133181 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:34:52.133082    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p" podStartSLOduration=1.133067859 podStartE2EDuration="1.133067859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:34:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:34:52.131753366 +0000 UTC m=+1096.358704126" watchObservedRunningTime="2026-09-09 20:34:52.133067859 +0000 UTC m=+1096.360018620"
Sep 09 20:35:01.576517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:01.576470    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:35:01.576517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:01.576530    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:35:01.588860 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:01.588841    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:35:02.176618 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.176584    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:35:02.241346 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.241312    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"]
Sep 09 20:35:02.241590 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.241564    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" podUID="0ec2a75a-c923-4112-a4b1-e4585f766c82" containerName="maas-api" containerID="cri-o://db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649" gracePeriod=30
Sep 09 20:35:02.492110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.492080    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:35:02.528807 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.528774    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec2a75a-c923-4112-a4b1-e4585f766c82-openshift-service-ca\") pod \"0ec2a75a-c923-4112-a4b1-e4585f766c82\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") "
Sep 09 20:35:02.528974 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.528839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgt5r\" (UniqueName: \"kubernetes.io/projected/0ec2a75a-c923-4112-a4b1-e4585f766c82-kube-api-access-dgt5r\") pod \"0ec2a75a-c923-4112-a4b1-e4585f766c82\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") "
Sep 09 20:35:02.528974 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.528907    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls\") pod \"0ec2a75a-c923-4112-a4b1-e4585f766c82\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") "
Sep 09 20:35:02.528974 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.528956    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-metrics-certs\") pod \"0ec2a75a-c923-4112-a4b1-e4585f766c82\" (UID: \"0ec2a75a-c923-4112-a4b1-e4585f766c82\") "
Sep 09 20:35:02.529226 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.529197    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec2a75a-c923-4112-a4b1-e4585f766c82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ec2a75a-c923-4112-a4b1-e4585f766c82" (UID: "0ec2a75a-c923-4112-a4b1-e4585f766c82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:02.529418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.529394    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec2a75a-c923-4112-a4b1-e4585f766c82-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:02.531356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.531317    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ec2a75a-c923-4112-a4b1-e4585f766c82" (UID: "0ec2a75a-c923-4112-a4b1-e4585f766c82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:02.531586 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.531564    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0ec2a75a-c923-4112-a4b1-e4585f766c82" (UID: "0ec2a75a-c923-4112-a4b1-e4585f766c82"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:02.531698 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.531599    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec2a75a-c923-4112-a4b1-e4585f766c82-kube-api-access-dgt5r" (OuterVolumeSpecName: "kube-api-access-dgt5r") pod "0ec2a75a-c923-4112-a4b1-e4585f766c82" (UID: "0ec2a75a-c923-4112-a4b1-e4585f766c82"). InnerVolumeSpecName "kube-api-access-dgt5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:35:02.630850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.630816    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:02.630850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.630847    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ec2a75a-c923-4112-a4b1-e4585f766c82-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:02.630850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:02.630857    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgt5r\" (UniqueName: \"kubernetes.io/projected/0ec2a75a-c923-4112-a4b1-e4585f766c82-kube-api-access-dgt5r\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:03.171846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.171814    2570 generic.go:356] "Generic (PLEG): container finished" podID="0ec2a75a-c923-4112-a4b1-e4585f766c82" containerID="db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649" exitCode=0
Sep 09 20:35:03.172313 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.171872    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"
Sep 09 20:35:03.172313 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.171908    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" event={"ID":"0ec2a75a-c923-4112-a4b1-e4585f766c82","Type":"ContainerDied","Data":"db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649"}
Sep 09 20:35:03.172313 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.172018    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9" event={"ID":"0ec2a75a-c923-4112-a4b1-e4585f766c82","Type":"ContainerDied","Data":"e13b299ee15e30181ab1dd6eb54489d6d0aebaa1c75af9e4b1f14302f9ff0379"}
Sep 09 20:35:03.172313 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.172047    2570 scope.go:117] "RemoveContainer" containerID="db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649"
Sep 09 20:35:03.181696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.181673    2570 scope.go:117] "RemoveContainer" containerID="db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649"
Sep 09 20:35:03.182021 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:35:03.182000    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649\": container with ID starting with db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649 not found: ID does not exist" containerID="db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649"
Sep 09 20:35:03.182090 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.182035    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649"} err="failed to get container status \"db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649\": rpc error: code = NotFound desc = could not find container \"db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649\": container with ID starting with db9532d59f1c978ce5630d05db9c3556040c11b33254d410682e56bfd0da4649 not found: ID does not exist"
Sep 09 20:35:03.198174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.198149    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"]
Sep 09 20:35:03.203470 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:03.203441    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-36f068b3-7cf848fbcc-grst9"]
Sep 09 20:35:04.307566 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:04.307532    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec2a75a-c923-4112-a4b1-e4585f766c82" path="/var/lib/kubelet/pods/0ec2a75a-c923-4112-a4b1-e4585f766c82/volumes"
Sep 09 20:35:06.440966 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:06.440917    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"]
Sep 09 20:35:21.461070 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.461029    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p" podUID="bfc14335-44f7-4ead-afe5-f045cb9f20ba" containerName="main" containerID="cri-o://9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c" gracePeriod=45
Sep 09 20:35:21.718705 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.718643    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:35:21.826016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.825978    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-model-cache\") pod \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") "
Sep 09 20:35:21.826016 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826021    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwcq8\" (UniqueName: \"kubernetes.io/projected/bfc14335-44f7-4ead-afe5-f045cb9f20ba-kube-api-access-cwcq8\") pod \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") "
Sep 09 20:35:21.826268 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826064    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-home\") pod \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") "
Sep 09 20:35:21.826268 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826088    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tls-certs\") pod \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") "
Sep 09 20:35:21.826268 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826106    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-dshm\") pod \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") "
Sep 09 20:35:21.826268 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826140    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tmp-dir\") pod \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\" (UID: \"bfc14335-44f7-4ead-afe5-f045cb9f20ba\") "
Sep 09 20:35:21.826484 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826285    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfc14335-44f7-4ead-afe5-f045cb9f20ba" (UID: "bfc14335-44f7-4ead-afe5-f045cb9f20ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:35:21.826484 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826303    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-home" (OuterVolumeSpecName: "home") pod "bfc14335-44f7-4ead-afe5-f045cb9f20ba" (UID: "bfc14335-44f7-4ead-afe5-f045cb9f20ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:35:21.826575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826497    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-model-cache\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:21.826575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826518    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-home\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:21.826575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.826557    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfc14335-44f7-4ead-afe5-f045cb9f20ba" (UID: "bfc14335-44f7-4ead-afe5-f045cb9f20ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:35:21.828458 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.828429    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-dshm" (OuterVolumeSpecName: "dshm") pod "bfc14335-44f7-4ead-afe5-f045cb9f20ba" (UID: "bfc14335-44f7-4ead-afe5-f045cb9f20ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:35:21.828570 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.828540    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc14335-44f7-4ead-afe5-f045cb9f20ba-kube-api-access-cwcq8" (OuterVolumeSpecName: "kube-api-access-cwcq8") pod "bfc14335-44f7-4ead-afe5-f045cb9f20ba" (UID: "bfc14335-44f7-4ead-afe5-f045cb9f20ba"). InnerVolumeSpecName "kube-api-access-cwcq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:35:21.828570 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.828541    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfc14335-44f7-4ead-afe5-f045cb9f20ba" (UID: "bfc14335-44f7-4ead-afe5-f045cb9f20ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:21.927389 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.927362    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwcq8\" (UniqueName: \"kubernetes.io/projected/bfc14335-44f7-4ead-afe5-f045cb9f20ba-kube-api-access-cwcq8\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:21.927389 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.927385    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tls-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:21.927389 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.927394    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-dshm\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:21.927586 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:21.927403    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfc14335-44f7-4ead-afe5-f045cb9f20ba-tmp-dir\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:22.276362 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.276324    2570 generic.go:356] "Generic (PLEG): container finished" podID="bfc14335-44f7-4ead-afe5-f045cb9f20ba" containerID="9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c" exitCode=0
Sep 09 20:35:22.276571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.276381    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"
Sep 09 20:35:22.276571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.276404    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p" event={"ID":"bfc14335-44f7-4ead-afe5-f045cb9f20ba","Type":"ContainerDied","Data":"9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c"}
Sep 09 20:35:22.276571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.276448    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p" event={"ID":"bfc14335-44f7-4ead-afe5-f045cb9f20ba","Type":"ContainerDied","Data":"3b21f7dcaa8f6c1ce91a8d2ca928c13a90a6f5920b6e09e46009e1b44f9e13c7"}
Sep 09 20:35:22.276571 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.276468    2570 scope.go:117] "RemoveContainer" containerID="9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c"
Sep 09 20:35:22.286046 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.286026    2570 scope.go:117] "RemoveContainer" containerID="9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c"
Sep 09 20:35:22.286308 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:35:22.286290    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c\": container with ID starting with 9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c not found: ID does not exist" containerID="9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c"
Sep 09 20:35:22.286416 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.286320    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c"} err="failed to get container status \"9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c\": rpc error: code = NotFound desc = could not find container \"9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c\": container with ID starting with 9ff49a581bbe456d2365df633ac523ccf11e8bade9342f6fb3044605b530322c not found: ID does not exist"
Sep 09 20:35:22.297704 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.297677    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"]
Sep 09 20:35:22.307131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:22.307113    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-82f543/noten-model-82f543-kserve-8569bd8759-lqt5p"]
Sep 09 20:35:23.982659 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.982624    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"]
Sep 09 20:35:23.983270 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983250    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec2a75a-c923-4112-a4b1-e4585f766c82" containerName="maas-api"
Sep 09 20:35:23.983270 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983272    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec2a75a-c923-4112-a4b1-e4585f766c82" containerName="maas-api"
Sep 09 20:35:23.983411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983289    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc14335-44f7-4ead-afe5-f045cb9f20ba" containerName="main"
Sep 09 20:35:23.983411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983295    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc14335-44f7-4ead-afe5-f045cb9f20ba" containerName="main"
Sep 09 20:35:23.983411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983361    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ec2a75a-c923-4112-a4b1-e4585f766c82" containerName="maas-api"
Sep 09 20:35:23.983411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983369    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfc14335-44f7-4ead-afe5-f045cb9f20ba" containerName="main"
Sep 09 20:35:23.983411 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.983376    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57af14c-4207-4e50-8854-25935f7d1357" containerName="istio-proxy"
Sep 09 20:35:23.987984 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.987961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:23.990770 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.990751    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-dc2ebb-openshift-default-dockercfg-r9rrn\""
Sep 09 20:35:23.998682 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:23.998661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"]
Sep 09 20:35:24.148475 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148441    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-certs\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148667 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln5xv\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-kube-api-access-ln5xv\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148667 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-socket\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148667 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148598    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feeec4b3-0200-4595-a63b-0cbb2ae72072-istiod-ca-cert\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148667 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148645    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-podinfo\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-envoy\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148794    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-token\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148846 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-credential-socket\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.148975 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.148867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-data\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-socket\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feeec4b3-0200-4595-a63b-0cbb2ae72072-istiod-ca-cert\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-podinfo\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-envoy\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-token\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-credential-socket\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-data\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.249673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249658    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-certs\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.250000 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln5xv\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-kube-api-access-ln5xv\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.250000 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.249776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-socket\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.250109 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.250067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-data\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.250153 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.250128    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-credential-socket\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.250202 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.250180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feeec4b3-0200-4595-a63b-0cbb2ae72072-istiod-ca-cert\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.250244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.250180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-certs\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.252572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.252549    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-envoy\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.252862 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.252841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-podinfo\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.259455 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.259421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-token\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.260164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.260143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln5xv\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-kube-api-access-ln5xv\") pod \"e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") " pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.300022 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.299989    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:24.307394 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.307368    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfc14335-44f7-4ead-afe5-f045cb9f20ba" path="/var/lib/kubelet/pods/bfc14335-44f7-4ead-afe5-f045cb9f20ba/volumes"
Sep 09 20:35:24.586548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.586519    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"]
Sep 09 20:35:24.589038 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:35:24.589009    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeeec4b3_0200_4595_a63b_0cbb2ae72072.slice/crio-56b1959df48bae7e44aa358da1fb80d7258816996da352df9e2208f88aa6fb0e WatchSource:0}: Error finding container 56b1959df48bae7e44aa358da1fb80d7258816996da352df9e2208f88aa6fb0e: Status 404 returned error can't find the container with id 56b1959df48bae7e44aa358da1fb80d7258816996da352df9e2208f88aa6fb0e
Sep 09 20:35:24.591338 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.591295    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:24.591428 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.591405    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:24.591475 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:24.591456    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:25.295748 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:25.295707    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" event={"ID":"feeec4b3-0200-4595-a63b-0cbb2ae72072","Type":"ContainerStarted","Data":"654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"}
Sep 09 20:35:25.296221 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:25.295796    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" event={"ID":"feeec4b3-0200-4595-a63b-0cbb2ae72072","Type":"ContainerStarted","Data":"56b1959df48bae7e44aa358da1fb80d7258816996da352df9e2208f88aa6fb0e"}
Sep 09 20:35:25.300439 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:25.300416    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:25.305402 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:25.305380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:25.317977 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:25.317910    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podStartSLOduration=2.317894236 podStartE2EDuration="2.317894236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:25.316780753 +0000 UTC m=+1129.543731515" watchObservedRunningTime="2026-09-09 20:35:25.317894236 +0000 UTC m=+1129.544844991"
Sep 09 20:35:26.306781 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:26.306753    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:26.307157 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:26.306814    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:29.203714 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.203678    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"]
Sep 09 20:35:29.208146 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.208124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.212658 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.212631    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-dc2ebb-serving-cert\""
Sep 09 20:35:29.221786 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.221764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"]
Sep 09 20:35:29.302522 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.302485    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.302763 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.302745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gw8\" (UniqueName: \"kubernetes.io/projected/7d49f047-07cd-4c9d-a58a-5c58f95bca97-kube-api-access-r7gw8\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.302898 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.302884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.303055 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.303039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d49f047-07cd-4c9d-a58a-5c58f95bca97-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.404243 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.404207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.404423 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.404264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gw8\" (UniqueName: \"kubernetes.io/projected/7d49f047-07cd-4c9d-a58a-5c58f95bca97-kube-api-access-r7gw8\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.404423 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.404286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.404423 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.404311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d49f047-07cd-4c9d-a58a-5c58f95bca97-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.404423 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:35:29.404380    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-serving-cert: secret "maas-api-e2e-shared-a-w2-dc2ebb-serving-cert" not found
Sep 09 20:35:29.404616 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:35:29.404460    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls podName:7d49f047-07cd-4c9d-a58a-5c58f95bca97 nodeName:}" failed. No retries permitted until 2026-09-09 20:35:29.9044395 +0000 UTC m=+1134.131390240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls") pod "maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" (UID: "7d49f047-07cd-4c9d-a58a-5c58f95bca97") : secret "maas-api-e2e-shared-a-w2-dc2ebb-serving-cert" not found
Sep 09 20:35:29.405044 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.405025    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d49f047-07cd-4c9d-a58a-5c58f95bca97-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.406861 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.406841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.415979 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.415948    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gw8\" (UniqueName: \"kubernetes.io/projected/7d49f047-07cd-4c9d-a58a-5c58f95bca97-kube-api-access-r7gw8\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.911257 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.911218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:29.913720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:29.913697    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:30.120032 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:30.120000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:30.390479 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:30.390451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"]
Sep 09 20:35:30.392706 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:35:30.392676    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d49f047_07cd_4c9d_a58a_5c58f95bca97.slice/crio-c46b7ca44f5925d87a62c98d18ec842f57a72ddf4f01a144fd774b8a4720349d WatchSource:0}: Error finding container c46b7ca44f5925d87a62c98d18ec842f57a72ddf4f01a144fd774b8a4720349d: Status 404 returned error can't find the container with id c46b7ca44f5925d87a62c98d18ec842f57a72ddf4f01a144fd774b8a4720349d
Sep 09 20:35:30.938686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:30.938641    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"]
Sep 09 20:35:30.938958 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:30.938912    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf" podUID="8adeb004-5ce6-4d5e-a0fe-555ed4133a25" containerName="maas-api" containerID="cri-o://b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791" gracePeriod=30
Sep 09 20:35:31.201663 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.201597    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:35:31.226234 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.226201    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-maas-api-tls\") pod \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") "
Sep 09 20:35:31.226403 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.226285    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-metrics-certs\") pod \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") "
Sep 09 20:35:31.226403 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.226341    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9hgf\" (UniqueName: \"kubernetes.io/projected/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-kube-api-access-r9hgf\") pod \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") "
Sep 09 20:35:31.226528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.226403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-openshift-service-ca\") pod \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\" (UID: \"8adeb004-5ce6-4d5e-a0fe-555ed4133a25\") "
Sep 09 20:35:31.227005 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.226917    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8adeb004-5ce6-4d5e-a0fe-555ed4133a25" (UID: "8adeb004-5ce6-4d5e-a0fe-555ed4133a25"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:31.228945 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.228893    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8adeb004-5ce6-4d5e-a0fe-555ed4133a25" (UID: "8adeb004-5ce6-4d5e-a0fe-555ed4133a25"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:31.229150 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.229118    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8adeb004-5ce6-4d5e-a0fe-555ed4133a25" (UID: "8adeb004-5ce6-4d5e-a0fe-555ed4133a25"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:31.229379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.229355    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-kube-api-access-r9hgf" (OuterVolumeSpecName: "kube-api-access-r9hgf") pod "8adeb004-5ce6-4d5e-a0fe-555ed4133a25" (UID: "8adeb004-5ce6-4d5e-a0fe-555ed4133a25"). InnerVolumeSpecName "kube-api-access-r9hgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:35:31.327324 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.327289    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:31.327324 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.327319    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:31.327324 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.327333    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9hgf\" (UniqueName: \"kubernetes.io/projected/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-kube-api-access-r9hgf\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:31.327617 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.327342    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8adeb004-5ce6-4d5e-a0fe-555ed4133a25-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:31.331869 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.331838    2570 generic.go:356] "Generic (PLEG): container finished" podID="8adeb004-5ce6-4d5e-a0fe-555ed4133a25" containerID="b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791" exitCode=0
Sep 09 20:35:31.332040 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.331896    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"
Sep 09 20:35:31.332040 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.331916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf" event={"ID":"8adeb004-5ce6-4d5e-a0fe-555ed4133a25","Type":"ContainerDied","Data":"b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791"}
Sep 09 20:35:31.332040 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.332000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf" event={"ID":"8adeb004-5ce6-4d5e-a0fe-555ed4133a25","Type":"ContainerDied","Data":"aed10c6be5f6a2b540adc061fd51747b4c17de4439e10127407dd1ba6fcbbb0d"}
Sep 09 20:35:31.332040 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.332029    2570 scope.go:117] "RemoveContainer" containerID="b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791"
Sep 09 20:35:31.334641 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.334612    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" event={"ID":"7d49f047-07cd-4c9d-a58a-5c58f95bca97","Type":"ContainerStarted","Data":"e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618"}
Sep 09 20:35:31.334761 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.334664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" event={"ID":"7d49f047-07cd-4c9d-a58a-5c58f95bca97","Type":"ContainerStarted","Data":"c46b7ca44f5925d87a62c98d18ec842f57a72ddf4f01a144fd774b8a4720349d"}
Sep 09 20:35:31.334894 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.334869    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:31.346789 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.346770    2570 scope.go:117] "RemoveContainer" containerID="b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791"
Sep 09 20:35:31.347124 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:35:31.347099    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791\": container with ID starting with b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791 not found: ID does not exist" containerID="b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791"
Sep 09 20:35:31.347240 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.347135    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791"} err="failed to get container status \"b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791\": rpc error: code = NotFound desc = could not find container \"b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791\": container with ID starting with b3667e377d5e0203a132df91e5e263f3d0e62ed266bc855659bc9e1775900791 not found: ID does not exist"
Sep 09 20:35:31.373371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.373321    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" podStartSLOduration=1.717996479 podStartE2EDuration="2.373306139s" totalImagesPullingTime="655.30966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:31.369661114 +0000 UTC m=+1135.596611901" watchObservedRunningTime="2026-09-09 20:35:31.373306139 +0000 UTC m=+1135.600256901"
Sep 09 20:35:31.412452 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.412410    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"]
Sep 09 20:35:31.421632 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:31.421599    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-21117b-58cd878cf9-pkdbf"]
Sep 09 20:35:32.307377 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:32.307337    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8adeb004-5ce6-4d5e-a0fe-555ed4133a25" path="/var/lib/kubelet/pods/8adeb004-5ce6-4d5e-a0fe-555ed4133a25/volumes"
Sep 09 20:35:37.345851 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:37.345817    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:35:42.345084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:42.345048    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 20:35:42.345531 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:42.345117    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 20:35:43.103659 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.103622    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"]
Sep 09 20:35:43.104148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.104130    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8adeb004-5ce6-4d5e-a0fe-555ed4133a25" containerName="maas-api"
Sep 09 20:35:43.104148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.104146    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8adeb004-5ce6-4d5e-a0fe-555ed4133a25" containerName="maas-api"
Sep 09 20:35:43.104347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.104245    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8adeb004-5ce6-4d5e-a0fe-555ed4133a25" containerName="maas-api"
Sep 09 20:35:43.109211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.109188    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.112666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.112642    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-47e11e-openshift-default-dockercfg-4qpz8\""
Sep 09 20:35:43.126350 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.126316    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"]
Sep 09 20:35:43.168400 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-credential-socket\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-envoy\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168567 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-podinfo\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-certs\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-data\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-socket\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168671 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-token\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168868 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168724    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5r7\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-kube-api-access-7g5r7\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.168868 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.168772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f32853-1430-46d7-ad5e-109ceae6a9e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.269793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.269747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5r7\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-kube-api-access-7g5r7\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270006 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.269809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f32853-1430-46d7-ad5e-109ceae6a9e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270006 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.269869    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-credential-socket\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270006 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.269998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-envoy\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-podinfo\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-certs\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-data\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-socket\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-token\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270602    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-certs\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270682    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f32853-1430-46d7-ad5e-109ceae6a9e0-istiod-ca-cert\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270830    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-socket\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-credential-socket\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.270970 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.270909    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-data\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.272642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.272618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-envoy\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.273793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.273771    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-podinfo\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.291961 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.291886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-token\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.293379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.293349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5r7\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-kube-api-access-7g5r7\") pod \"e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") " pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.422009 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.421911    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:43.715574 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.715549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"]
Sep 09 20:35:43.717532 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:35:43.717506    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f32853_1430_46d7_ad5e_109ceae6a9e0.slice/crio-246c5dd8a34a99b6399d4d4274aaee477fff13ff929384e54702f7289d1dc5ae WatchSource:0}: Error finding container 246c5dd8a34a99b6399d4d4274aaee477fff13ff929384e54702f7289d1dc5ae: Status 404 returned error can't find the container with id 246c5dd8a34a99b6399d4d4274aaee477fff13ff929384e54702f7289d1dc5ae
Sep 09 20:35:43.720167 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.720131    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:43.720233 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.720199    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:43.720233 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:43.720225    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:44.409912 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:44.409874    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" event={"ID":"66f32853-1430-46d7-ad5e-109ceae6a9e0","Type":"ContainerStarted","Data":"30386a0129013a9c72df5bd0b559e9480a75e7279bd8013832144e876939beef"}
Sep 09 20:35:44.410259 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:44.409948    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" event={"ID":"66f32853-1430-46d7-ad5e-109ceae6a9e0","Type":"ContainerStarted","Data":"246c5dd8a34a99b6399d4d4274aaee477fff13ff929384e54702f7289d1dc5ae"}
Sep 09 20:35:44.422593 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:44.422567    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:44.427381 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:44.427351    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:44.434535 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:44.434493    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podStartSLOduration=1.4344795989999999 podStartE2EDuration="1.434479599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:44.432624174 +0000 UTC m=+1148.659574936" watchObservedRunningTime="2026-09-09 20:35:44.434479599 +0000 UTC m=+1148.661430359"
Sep 09 20:35:45.418145 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.418112    2570 generic.go:356] "Generic (PLEG): container finished" podID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerID="654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8" exitCode=0
Sep 09 20:35:45.418369 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.418184    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" event={"ID":"feeec4b3-0200-4595-a63b-0cbb2ae72072","Type":"ContainerDied","Data":"654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"}
Sep 09 20:35:45.418489 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.418467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:45.418697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.418681    2570 scope.go:117] "RemoveContainer" containerID="654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"
Sep 09 20:35:45.419521 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.419300    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:35:45.419746 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.419720    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:45.419824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.419786    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:45.419824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:45.419818    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:35:46.426293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:46.426254    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" event={"ID":"feeec4b3-0200-4595-a63b-0cbb2ae72072","Type":"ContainerStarted","Data":"bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4"}
Sep 09 20:35:47.300990 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:47.300958    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:47.301354 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:47.301327    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 20:35:47.301529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:47.301505    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 20:35:48.305524 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:48.305486    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 20:35:48.306036 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:48.305551    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 20:35:49.302007 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:49.301965    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 20:35:49.302221 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:49.302050    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 20:35:50.306577 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:50.306540    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 20:35:50.307177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:50.307147    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 20:35:51.301357 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:51.301313    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 09 20:35:51.301660 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:51.301633    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 09 20:35:51.615467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:51.615400    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"]
Sep 09 20:35:51.616005 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:51.615649    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" podUID="755f009c-767f-4b77-9f4f-3423ec9f0e4b" containerName="maas-api" containerID="cri-o://ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d" gracePeriod=30
Sep 09 20:35:52.066325 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.066298    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:35:52.176511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.176406    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/755f009c-767f-4b77-9f4f-3423ec9f0e4b-openshift-service-ca\") pod \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") "
Sep 09 20:35:52.176696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.176560    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-metrics-certs\") pod \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") "
Sep 09 20:35:52.176696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.176606    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls\") pod \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") "
Sep 09 20:35:52.176696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.176646    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq4mn\" (UniqueName: \"kubernetes.io/projected/755f009c-767f-4b77-9f4f-3423ec9f0e4b-kube-api-access-hq4mn\") pod \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\" (UID: \"755f009c-767f-4b77-9f4f-3423ec9f0e4b\") "
Sep 09 20:35:52.176850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.176761    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755f009c-767f-4b77-9f4f-3423ec9f0e4b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "755f009c-767f-4b77-9f4f-3423ec9f0e4b" (UID: "755f009c-767f-4b77-9f4f-3423ec9f0e4b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:35:52.177051 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.177027    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/755f009c-767f-4b77-9f4f-3423ec9f0e4b-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:52.178834 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.178806    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "755f009c-767f-4b77-9f4f-3423ec9f0e4b" (UID: "755f009c-767f-4b77-9f4f-3423ec9f0e4b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:52.178922 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.178817    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "755f009c-767f-4b77-9f4f-3423ec9f0e4b" (UID: "755f009c-767f-4b77-9f4f-3423ec9f0e4b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:35:52.178922 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.178867    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755f009c-767f-4b77-9f4f-3423ec9f0e4b-kube-api-access-hq4mn" (OuterVolumeSpecName: "kube-api-access-hq4mn") pod "755f009c-767f-4b77-9f4f-3423ec9f0e4b" (UID: "755f009c-767f-4b77-9f4f-3423ec9f0e4b"). InnerVolumeSpecName "kube-api-access-hq4mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:35:52.278375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.278343    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:52.278375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.278372    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/755f009c-767f-4b77-9f4f-3423ec9f0e4b-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:52.278375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.278381    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq4mn\" (UniqueName: \"kubernetes.io/projected/755f009c-767f-4b77-9f4f-3423ec9f0e4b-kube-api-access-hq4mn\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:35:52.307393 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.307368    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:52.307644 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.307628    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:52.308469 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.308449    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:35:52.461509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.461434    2570 generic.go:356] "Generic (PLEG): container finished" podID="755f009c-767f-4b77-9f4f-3423ec9f0e4b" containerID="ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d" exitCode=0
Sep 09 20:35:52.461509 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.461475    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"
Sep 09 20:35:52.461681 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.461517    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" event={"ID":"755f009c-767f-4b77-9f4f-3423ec9f0e4b","Type":"ContainerDied","Data":"ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d"}
Sep 09 20:35:52.461681 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.461567    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms" event={"ID":"755f009c-767f-4b77-9f4f-3423ec9f0e4b","Type":"ContainerDied","Data":"27960215f272a00428dcced8777f82b6506425b5afbe2bb2ae2614e1bed19476"}
Sep 09 20:35:52.461681 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.461597    2570 scope.go:117] "RemoveContainer" containerID="ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d"
Sep 09 20:35:52.471169 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.471150    2570 scope.go:117] "RemoveContainer" containerID="ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d"
Sep 09 20:35:52.471465 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:35:52.471447    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d\": container with ID starting with ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d not found: ID does not exist" containerID="ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d"
Sep 09 20:35:52.471516 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.471475    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d"} err="failed to get container status \"ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d\": rpc error: code = NotFound desc = could not find container \"ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d\": container with ID starting with ae888cb1faf876925fcb8fcaff555bbf939c3529709f62464617b3c2dc111e4d not found: ID does not exist"
Sep 09 20:35:52.482012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.481989    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"]
Sep 09 20:35:52.487417 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:52.487393    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4defd2-5986c69955-7bbms"]
Sep 09 20:35:54.308161 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:54.308128    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755f009c-767f-4b77-9f4f-3423ec9f0e4b" path="/var/lib/kubelet/pods/755f009c-767f-4b77-9f4f-3423ec9f0e4b/volumes"
Sep 09 20:35:59.424198 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.424121    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"]
Sep 09 20:35:59.424916 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.424891    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755f009c-767f-4b77-9f4f-3423ec9f0e4b" containerName="maas-api"
Sep 09 20:35:59.425064 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.424917    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="755f009c-767f-4b77-9f4f-3423ec9f0e4b" containerName="maas-api"
Sep 09 20:35:59.425121 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.425076    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="755f009c-767f-4b77-9f4f-3423ec9f0e4b" containerName="maas-api"
Sep 09 20:35:59.430261 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.430116    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.432004 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.431964    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"]
Sep 09 20:35:59.433056 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.433037    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-166b94-openshift-default-dockercfg-b84t8\""
Sep 09 20:35:59.446971 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.446946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-credential-socket\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.447148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447061    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-envoy\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.447148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-podinfo\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.447271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447169    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94faf2b1-d888-44cc-8f27-543e2f27e610-istiod-ca-cert\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.447349 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447297    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-data\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.447417 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447402    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-socket\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.447473 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-certs\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.448311 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447502    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-token\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.448311 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.447625    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcnj\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-kube-api-access-dlcnj\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548419 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-data\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-socket\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-certs\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-token\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcnj\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-kube-api-access-dlcnj\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-credential-socket\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-envoy\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.548709 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-podinfo\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.549174 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.548722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94faf2b1-d888-44cc-8f27-543e2f27e610-istiod-ca-cert\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.549240 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.549209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-socket\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.549313 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.549285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-certs\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.549596 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.549571    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94faf2b1-d888-44cc-8f27-543e2f27e610-istiod-ca-cert\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.549751 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.549689    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-data\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.549985 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.549958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-credential-socket\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.552175 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.552149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-podinfo\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.552279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.552218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-envoy\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.561868 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.561843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcnj\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-kube-api-access-dlcnj\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.562183 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.562160    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-token\") pod \"e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") " pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:35:59.745657 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:35:59.745567    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:00.039024 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.038997    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"]
Sep 09 20:36:00.040517 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:36:00.040469    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94faf2b1_d888_44cc_8f27_543e2f27e610.slice/crio-80a1b027b2e223aec0afd8a9705172fd9bcfa72924b64d85ea7d5ae298588057 WatchSource:0}: Error finding container 80a1b027b2e223aec0afd8a9705172fd9bcfa72924b64d85ea7d5ae298588057: Status 404 returned error can't find the container with id 80a1b027b2e223aec0afd8a9705172fd9bcfa72924b64d85ea7d5ae298588057
Sep 09 20:36:00.043076 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.043040    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:00.043173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.043132    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:00.043247 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.043174    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:00.523922 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.523883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" event={"ID":"94faf2b1-d888-44cc-8f27-543e2f27e610","Type":"ContainerStarted","Data":"06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"}
Sep 09 20:36:00.524383 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.523962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" event={"ID":"94faf2b1-d888-44cc-8f27-543e2f27e610","Type":"ContainerStarted","Data":"80a1b027b2e223aec0afd8a9705172fd9bcfa72924b64d85ea7d5ae298588057"}
Sep 09 20:36:00.545881 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.545829    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podStartSLOduration=1.5458129729999999 podStartE2EDuration="1.545812973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:36:00.543058549 +0000 UTC m=+1164.770009312" watchObservedRunningTime="2026-09-09 20:36:00.545812973 +0000 UTC m=+1164.772763734"
Sep 09 20:36:00.745918 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:00.745887    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:01.751096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:01.751065    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:02.535233 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:02.535202    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:02.536385 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:02.536363    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:04.539485 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.539455    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"]
Sep 09 20:36:04.543272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.543247    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.559562 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.559535    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-166b94-serving-cert\""
Sep 09 20:36:04.564630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.564604    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"]
Sep 09 20:36:04.599666 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.599625    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b25c0892-9dde-4ab8-9fbe-8380a67190fe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.599851 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.599769    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.599921 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.599866    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzgt\" (UniqueName: \"kubernetes.io/projected/b25c0892-9dde-4ab8-9fbe-8380a67190fe-kube-api-access-fxzgt\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.600142 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.600108    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.701670 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.701635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.701882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.701710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzgt\" (UniqueName: \"kubernetes.io/projected/b25c0892-9dde-4ab8-9fbe-8380a67190fe-kube-api-access-fxzgt\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.701882 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:36:04.701795    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-serving-cert: secret "maas-api-e2e-shared-a-w3-166b94-serving-cert" not found
Sep 09 20:36:04.701882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.701815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.701882 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.701845    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b25c0892-9dde-4ab8-9fbe-8380a67190fe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.701882 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:36:04.701867    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls podName:b25c0892-9dde-4ab8-9fbe-8380a67190fe nodeName:}" failed. No retries permitted until 2026-09-09 20:36:05.201843482 +0000 UTC m=+1169.428794225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls") pod "maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" (UID: "b25c0892-9dde-4ab8-9fbe-8380a67190fe") : secret "maas-api-e2e-shared-a-w3-166b94-serving-cert" not found
Sep 09 20:36:04.702493 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.702471    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b25c0892-9dde-4ab8-9fbe-8380a67190fe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.704821 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.704798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:04.717729 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:04.717696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzgt\" (UniqueName: \"kubernetes.io/projected/b25c0892-9dde-4ab8-9fbe-8380a67190fe-kube-api-access-fxzgt\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:05.206523 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.206442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:05.208923 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.208904    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:05.455673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.455628    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:05.557078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.557049    2570 generic.go:356] "Generic (PLEG): container finished" podID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerID="30386a0129013a9c72df5bd0b559e9480a75e7279bd8013832144e876939beef" exitCode=0
Sep 09 20:36:05.557407 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.557118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" event={"ID":"66f32853-1430-46d7-ad5e-109ceae6a9e0","Type":"ContainerDied","Data":"30386a0129013a9c72df5bd0b559e9480a75e7279bd8013832144e876939beef"}
Sep 09 20:36:05.557642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.557624    2570 scope.go:117] "RemoveContainer" containerID="30386a0129013a9c72df5bd0b559e9480a75e7279bd8013832144e876939beef"
Sep 09 20:36:05.558720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.558645    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:05.558720 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.558713    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:05.558883 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.558745    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:05.745173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:05.745016    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"]
Sep 09 20:36:05.746886 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:36:05.746854    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25c0892_9dde_4ab8_9fbe_8380a67190fe.slice/crio-4df63ddf6f2a150fbeb6bc6ef5acaf55f8d1e2d564224e06479249ac70ccf83c WatchSource:0}: Error finding container 4df63ddf6f2a150fbeb6bc6ef5acaf55f8d1e2d564224e06479249ac70ccf83c: Status 404 returned error can't find the container with id 4df63ddf6f2a150fbeb6bc6ef5acaf55f8d1e2d564224e06479249ac70ccf83c
Sep 09 20:36:06.565554 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:06.565444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" event={"ID":"66f32853-1430-46d7-ad5e-109ceae6a9e0","Type":"ContainerStarted","Data":"9273345a72a9baa195349c94e52cb01f435aa898e41484a7cb46da2253eb9626"}
Sep 09 20:36:06.567093 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:06.567068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" event={"ID":"b25c0892-9dde-4ab8-9fbe-8380a67190fe","Type":"ContainerStarted","Data":"32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051"}
Sep 09 20:36:06.567211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:06.567109    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" event={"ID":"b25c0892-9dde-4ab8-9fbe-8380a67190fe","Type":"ContainerStarted","Data":"4df63ddf6f2a150fbeb6bc6ef5acaf55f8d1e2d564224e06479249ac70ccf83c"}
Sep 09 20:36:06.567211 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:06.567159    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:06.607438 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:06.607364    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" podStartSLOduration=2.21521374 podStartE2EDuration="2.607341163s" totalImagesPullingTime="392.127423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:36:06.605420075 +0000 UTC m=+1170.832370838" watchObservedRunningTime="2026-09-09 20:36:06.607341163 +0000 UTC m=+1170.834291924"
Sep 09 20:36:07.422452 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:07.422414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:36:07.422702 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:07.422656    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 20:36:07.422753 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:07.422721    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 20:36:08.422344 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:08.422307    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 20:36:08.422724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:08.422369    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 20:36:09.423371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:09.423331    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 20:36:09.424006 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:09.423918    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 20:36:10.422847 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:10.422806    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 20:36:10.423173 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:10.423142    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 20:36:11.422463 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:11.422414    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 20:36:11.423106 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:11.423068    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 20:36:12.426560 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:12.426527    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:36:12.427065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:12.426972    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:36:12.427582 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:12.427564    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:36:12.577946 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:12.577906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:36:17.566293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.565558    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:55576->10.134.0.60:15021: read: connection reset by peer" start-of-body=
Sep 09 20:36:17.566293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.565628    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": read tcp 10.134.0.2:55576->10.134.0.60:15021: read: connection reset by peer"
Sep 09 20:36:17.651378 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.651346    2570 generic.go:356] "Generic (PLEG): container finished" podID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerID="06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6" exitCode=0
Sep 09 20:36:17.651522 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.651417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" event={"ID":"94faf2b1-d888-44cc-8f27-543e2f27e610","Type":"ContainerDied","Data":"06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"}
Sep 09 20:36:17.651830 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.651815    2570 scope.go:117] "RemoveContainer" containerID="06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"
Sep 09 20:36:17.652889 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.652861    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:17.653012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.652953    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:17.653012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:17.652997    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:36:18.659417 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:18.659383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" event={"ID":"94faf2b1-d888-44cc-8f27-543e2f27e610","Type":"ContainerStarted","Data":"c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c"}
Sep 09 20:36:18.746043 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:18.746007    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:18.746214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:18.746177    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 20:36:18.746261 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:18.746222    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 20:36:19.746217 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:19.746172    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 20:36:19.746617 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:19.746249    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 20:36:20.746793 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:20.746750    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 20:36:20.747194 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:20.746819    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 20:36:21.746840 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:21.746806    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 20:36:21.747260 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:21.746861    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 20:36:22.746131 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:22.746096    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 09 20:36:22.746329 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:22.746154    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 09 20:36:23.890673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:23.890640    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:23.891517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:23.891453    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:23.895132 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:23.895103    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:36:35.378054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.378016    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"]
Sep 09 20:36:35.381365 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.381340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.383900 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.383879    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-4101f2-serving-cert\""
Sep 09 20:36:35.391864 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.391840    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"]
Sep 09 20:36:35.443152 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.443118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.443324 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.443290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.443384 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.443353    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtqvv\" (UniqueName: \"kubernetes.io/projected/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-kube-api-access-xtqvv\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.443429 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.443397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.544548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.544509    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.544742 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.544586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.544742 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.544624    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtqvv\" (UniqueName: \"kubernetes.io/projected/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-kube-api-access-xtqvv\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.544742 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.544649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.545356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.545328    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.547231 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.547208    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.547331 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.547230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.553087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.553065    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtqvv\" (UniqueName: \"kubernetes.io/projected/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-kube-api-access-xtqvv\") pod \"maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.697639 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.697539    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:35.973067 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:35.973042    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"]
Sep 09 20:36:35.975595 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:36:35.975558    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc32fcb_ccf5_48a3_93e8_330f3ed293de.slice/crio-4b2967d64f40acd0ddbd73f304667b0b709d4f0ede2ab07e80900d7a4acae53e WatchSource:0}: Error finding container 4b2967d64f40acd0ddbd73f304667b0b709d4f0ede2ab07e80900d7a4acae53e: Status 404 returned error can't find the container with id 4b2967d64f40acd0ddbd73f304667b0b709d4f0ede2ab07e80900d7a4acae53e
Sep 09 20:36:36.766359 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:36.766277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp" event={"ID":"ffc32fcb-ccf5-48a3-93e8-330f3ed293de","Type":"ContainerStarted","Data":"34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379"}
Sep 09 20:36:36.766359 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:36.766340    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp" event={"ID":"ffc32fcb-ccf5-48a3-93e8-330f3ed293de","Type":"ContainerStarted","Data":"4b2967d64f40acd0ddbd73f304667b0b709d4f0ede2ab07e80900d7a4acae53e"}
Sep 09 20:36:36.766724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:36.766390    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:36:36.782826 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:36.782785    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp" podStartSLOduration=1.174493067 podStartE2EDuration="1.782772156s" totalImagesPullingTime="608.279089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:36:36.78082148 +0000 UTC m=+1201.007772245" watchObservedRunningTime="2026-09-09 20:36:36.782772156 +0000 UTC m=+1201.009722917"
Sep 09 20:36:42.778573 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:36:42.778542    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:39:40.192696 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.192664    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"]
Sep 09 20:39:40.196460 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.196434    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.199209 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.199190    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-06f7dc-openshift-default-dockercfg-rtlbq\""
Sep 09 20:39:40.222328 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.222297    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"]
Sep 09 20:39:40.327796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.327756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-podinfo\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.327796 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.327800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-envoy\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.327862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee175f9e-5682-4bba-9aeb-882fe2436efe-istiod-ca-cert\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.327887    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kddpb\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-kube-api-access-kddpb\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.327910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-token\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.327956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-socket\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.328018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-certs\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.328141    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-credential-socket\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.328215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.328162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-data\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.428966 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.428912    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kddpb\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-kube-api-access-kddpb\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.428983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-token\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-socket\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429148 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-certs\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429343 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-credential-socket\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429343 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-data\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429343 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-podinfo\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-envoy\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee175f9e-5682-4bba-9aeb-882fe2436efe-istiod-ca-cert\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429458    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-socket\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.429529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.429473    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-certs\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.430064 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.430034    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-credential-socket\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.430187 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.430135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-data\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.430255 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.430207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee175f9e-5682-4bba-9aeb-882fe2436efe-istiod-ca-cert\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.431994 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.431974    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-envoy\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.432349 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.432334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-podinfo\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.437399 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.437369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-token\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.437644 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.437621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kddpb\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-kube-api-access-kddpb\") pod \"e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") " pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.510641 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.510556    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:40.788235 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.788207    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"]
Sep 09 20:39:40.788765 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:39:40.788722    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee175f9e_5682_4bba_9aeb_882fe2436efe.slice/crio-d9234b0d776ecba0f3bd11eaffd111faf42e2fa6196f663de47b47a027e659d7 WatchSource:0}: Error finding container d9234b0d776ecba0f3bd11eaffd111faf42e2fa6196f663de47b47a027e659d7: Status 404 returned error can't find the container with id d9234b0d776ecba0f3bd11eaffd111faf42e2fa6196f663de47b47a027e659d7
Sep 09 20:39:40.791687 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.791619    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:39:40.791817 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.791727    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:39:40.791817 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:40.791792    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:39:41.800139 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:41.800103    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" event={"ID":"ee175f9e-5682-4bba-9aeb-882fe2436efe","Type":"ContainerStarted","Data":"15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"}
Sep 09 20:39:41.800529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:41.800159    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" event={"ID":"ee175f9e-5682-4bba-9aeb-882fe2436efe","Type":"ContainerStarted","Data":"d9234b0d776ecba0f3bd11eaffd111faf42e2fa6196f663de47b47a027e659d7"}
Sep 09 20:39:41.821739 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:41.821669    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podStartSLOduration=1.821643932 podStartE2EDuration="1.821643932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:39:41.819124881 +0000 UTC m=+1386.046075904" watchObservedRunningTime="2026-09-09 20:39:41.821643932 +0000 UTC m=+1386.048594693"
Sep 09 20:39:42.510757 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:42.510727    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:42.515493 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:42.515469    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:42.806371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:42.806286    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:39:42.807534 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:39:42.807516    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:40:06.955092 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:06.955014    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerID="15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093" exitCode=0
Sep 09 20:40:06.955469 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:06.955087    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" event={"ID":"ee175f9e-5682-4bba-9aeb-882fe2436efe","Type":"ContainerDied","Data":"15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"}
Sep 09 20:40:06.955554 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:06.955540    2570 scope.go:117] "RemoveContainer" containerID="15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"
Sep 09 20:40:06.956733 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:06.956704    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:40:06.956805 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:06.956786    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:40:06.956843 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:06.956817    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 09 20:40:07.962617 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:07.962581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" event={"ID":"ee175f9e-5682-4bba-9aeb-882fe2436efe","Type":"ContainerStarted","Data":"ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1"}
Sep 09 20:40:08.511496 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:08.511076    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:40:08.512500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:08.512468    2570 patch_prober.go:28] interesting pod/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 20:40:08.512715 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:08.512690    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 20:40:09.511398 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:09.511349    2570 patch_prober.go:28] interesting pod/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 20:40:09.511972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:09.511429    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 20:40:10.511494 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:10.511453    2570 patch_prober.go:28] interesting pod/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 20:40:10.512009 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:10.511528    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 20:40:11.511839 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:11.511791    2570 patch_prober.go:28] interesting pod/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 20:40:11.512348 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:11.511875    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 20:40:12.512090 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:12.511636    2570 patch_prober.go:28] interesting pod/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 09 20:40:12.512090 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:12.511696    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 09 20:40:12.806776 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:12.806682    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:40:13.515059 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:13.515028    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:40:13.516304 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:40:13.516278    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:41:01.368170 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:01.368084    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"]
Sep 09 20:41:01.368745 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:01.368286    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy" containerID="cri-o://ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1" gracePeriod=30
Sep 09 20:41:06.626180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.626153    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:41:06.728278 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728193    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-data\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728278 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728244    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-certs\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728287    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-podinfo\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728310    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-credential-socket\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-socket\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728402    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee175f9e-5682-4bba-9aeb-882fe2436efe-istiod-ca-cert\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728458    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728477    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:06.728513 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728484    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-envoy\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728616    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:06.728879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728644    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-token\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728680    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kddpb\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-kube-api-access-kddpb\") pod \"ee175f9e-5682-4bba-9aeb-882fe2436efe\" (UID: \"ee175f9e-5682-4bba-9aeb-882fe2436efe\") "
Sep 09 20:41:06.728879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728691    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:06.728879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.728817    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee175f9e-5682-4bba-9aeb-882fe2436efe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:41:06.729338 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.729314    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.729338 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.729341    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.729549 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.729356    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.729549 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.729370    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.729549 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.729383    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee175f9e-5682-4bba-9aeb-882fe2436efe-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.730794 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.730764    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:06.730794 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.730778    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-kube-api-access-kddpb" (OuterVolumeSpecName: "kube-api-access-kddpb") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "kube-api-access-kddpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:06.730965 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.730817    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:41:06.730965 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.730852    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee175f9e-5682-4bba-9aeb-882fe2436efe" (UID: "ee175f9e-5682-4bba-9aeb-882fe2436efe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:06.830836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.830788    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.830836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.830827    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kddpb\" (UniqueName: \"kubernetes.io/projected/ee175f9e-5682-4bba-9aeb-882fe2436efe-kube-api-access-kddpb\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.830836 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.830846    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:06.831194 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:06.830858    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee175f9e-5682-4bba-9aeb-882fe2436efe-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:07.306068 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.306035    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerID="ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1" exitCode=0
Sep 09 20:41:07.306239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.306076    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"
Sep 09 20:41:07.306239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.306116    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" event={"ID":"ee175f9e-5682-4bba-9aeb-882fe2436efe","Type":"ContainerDied","Data":"ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1"}
Sep 09 20:41:07.306239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.306167    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn" event={"ID":"ee175f9e-5682-4bba-9aeb-882fe2436efe","Type":"ContainerDied","Data":"d9234b0d776ecba0f3bd11eaffd111faf42e2fa6196f663de47b47a027e659d7"}
Sep 09 20:41:07.306239 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.306191    2570 scope.go:117] "RemoveContainer" containerID="ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1"
Sep 09 20:41:07.316247 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.316229    2570 scope.go:117] "RemoveContainer" containerID="15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"
Sep 09 20:41:07.324569 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.324552    2570 scope.go:117] "RemoveContainer" containerID="ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1"
Sep 09 20:41:07.324848 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:41:07.324824    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1\": container with ID starting with ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1 not found: ID does not exist" containerID="ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1"
Sep 09 20:41:07.324913 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.324860    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1"} err="failed to get container status \"ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1\": rpc error: code = NotFound desc = could not find container \"ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1\": container with ID starting with ac8ed73bdf7c418367b39bc660c51e92b43725d80ecdbd4feb1b97dcb59b5ff1 not found: ID does not exist"
Sep 09 20:41:07.324913 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.324884    2570 scope.go:117] "RemoveContainer" containerID="15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"
Sep 09 20:41:07.325167 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:41:07.325150    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093\": container with ID starting with 15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093 not found: ID does not exist" containerID="15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"
Sep 09 20:41:07.325209 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.325173    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093"} err="failed to get container status \"15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093\": rpc error: code = NotFound desc = could not find container \"15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093\": container with ID starting with 15458fca506c9f275f3949ad6939229e423bdd8b7b2612e43532349ee30ef093 not found: ID does not exist"
Sep 09 20:41:07.329034 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.329012    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"]
Sep 09 20:41:07.335809 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:07.335779    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn"]
Sep 09 20:41:08.307384 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:08.307344    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" path="/var/lib/kubelet/pods/ee175f9e-5682-4bba-9aeb-882fe2436efe/volumes"
Sep 09 20:41:12.626297 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.626262    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"]
Sep 09 20:41:12.626669 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.626517    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" podUID="7d49f047-07cd-4c9d-a58a-5c58f95bca97" containerName="maas-api" containerID="cri-o://e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618" gracePeriod=30
Sep 09 20:41:12.881604 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.881547    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:41:12.994901 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.994865    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7gw8\" (UniqueName: \"kubernetes.io/projected/7d49f047-07cd-4c9d-a58a-5c58f95bca97-kube-api-access-r7gw8\") pod \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") "
Sep 09 20:41:12.994901 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.994908    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-metrics-certs\") pod \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") "
Sep 09 20:41:12.995181 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.994989    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls\") pod \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") "
Sep 09 20:41:12.995181 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.995027    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d49f047-07cd-4c9d-a58a-5c58f95bca97-openshift-service-ca\") pod \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\" (UID: \"7d49f047-07cd-4c9d-a58a-5c58f95bca97\") "
Sep 09 20:41:12.995695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.995666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d49f047-07cd-4c9d-a58a-5c58f95bca97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d49f047-07cd-4c9d-a58a-5c58f95bca97" (UID: "7d49f047-07cd-4c9d-a58a-5c58f95bca97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:41:12.997456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.997430    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d49f047-07cd-4c9d-a58a-5c58f95bca97-kube-api-access-r7gw8" (OuterVolumeSpecName: "kube-api-access-r7gw8") pod "7d49f047-07cd-4c9d-a58a-5c58f95bca97" (UID: "7d49f047-07cd-4c9d-a58a-5c58f95bca97"). InnerVolumeSpecName "kube-api-access-r7gw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:12.997664 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.997633    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d49f047-07cd-4c9d-a58a-5c58f95bca97" (UID: "7d49f047-07cd-4c9d-a58a-5c58f95bca97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:41:12.997852 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:12.997825    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d49f047-07cd-4c9d-a58a-5c58f95bca97" (UID: "7d49f047-07cd-4c9d-a58a-5c58f95bca97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:41:13.096630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.096584    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:13.096630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.096626    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d49f047-07cd-4c9d-a58a-5c58f95bca97-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:13.096630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.096642    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7gw8\" (UniqueName: \"kubernetes.io/projected/7d49f047-07cd-4c9d-a58a-5c58f95bca97-kube-api-access-r7gw8\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:13.097008 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.096654    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d49f047-07cd-4c9d-a58a-5c58f95bca97-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:13.341442 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.341347    2570 generic.go:356] "Generic (PLEG): container finished" podID="7d49f047-07cd-4c9d-a58a-5c58f95bca97" containerID="e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618" exitCode=0
Sep 09 20:41:13.341442 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.341427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" event={"ID":"7d49f047-07cd-4c9d-a58a-5c58f95bca97","Type":"ContainerDied","Data":"e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618"}
Sep 09 20:41:13.341685 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.341451    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"
Sep 09 20:41:13.341685 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.341478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7" event={"ID":"7d49f047-07cd-4c9d-a58a-5c58f95bca97","Type":"ContainerDied","Data":"c46b7ca44f5925d87a62c98d18ec842f57a72ddf4f01a144fd774b8a4720349d"}
Sep 09 20:41:13.341685 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.341509    2570 scope.go:117] "RemoveContainer" containerID="e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618"
Sep 09 20:41:13.353528 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.353504    2570 scope.go:117] "RemoveContainer" containerID="e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618"
Sep 09 20:41:13.353804 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:41:13.353783    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618\": container with ID starting with e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618 not found: ID does not exist" containerID="e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618"
Sep 09 20:41:13.353858 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.353813    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618"} err="failed to get container status \"e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618\": rpc error: code = NotFound desc = could not find container \"e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618\": container with ID starting with e591f904c14a206cb48d32772d1f520cf9222dec80fde04951b30294d65c0618 not found: ID does not exist"
Sep 09 20:41:13.365707 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.365679    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"]
Sep 09 20:41:13.369297 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:13.369271    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dc2ebb-84c6b69c55-mm5c7"]
Sep 09 20:41:14.307243 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:14.307212    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d49f047-07cd-4c9d-a58a-5c58f95bca97" path="/var/lib/kubelet/pods/7d49f047-07cd-4c9d-a58a-5c58f95bca97/volumes"
Sep 09 20:41:19.377185 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:19.377156    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"]
Sep 09 20:41:19.377640 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:19.377358    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" containerID="cri-o://bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4" gracePeriod=30
Sep 09 20:41:22.309750 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:22.309697    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 20:41:22.310164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:22.309778    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:41:24.632467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.632436    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:41:24.719582 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719517    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln5xv\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-kube-api-access-ln5xv\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.719582 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719563    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feeec4b3-0200-4595-a63b-0cbb2ae72072-istiod-ca-cert\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.719752 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719585    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-data\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.719752 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719615    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-podinfo\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.719752 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719680    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-token\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.719752 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719707    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-credential-socket\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.720002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719770    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-envoy\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.720002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719799    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-certs\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.720002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.719823    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-socket\") pod \"feeec4b3-0200-4595-a63b-0cbb2ae72072\" (UID: \"feeec4b3-0200-4595-a63b-0cbb2ae72072\") "
Sep 09 20:41:24.720164 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720000    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feeec4b3-0200-4595-a63b-0cbb2ae72072-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:41:24.720229 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:24.720279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720242    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:24.720279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720254    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:24.720347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720283    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-data" (OuterVolumeSpecName: "istio-data") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:24.720610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720489    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.720688 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720674    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.720735 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720693    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feeec4b3-0200-4595-a63b-0cbb2ae72072-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.720735 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720707    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.720735 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.720719    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.722166 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.722134    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:41:24.722268 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.722184    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:24.722436 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.722410    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-token" (OuterVolumeSpecName: "istio-token") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:24.722436 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.722424    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-kube-api-access-ln5xv" (OuterVolumeSpecName: "kube-api-access-ln5xv") pod "feeec4b3-0200-4595-a63b-0cbb2ae72072" (UID: "feeec4b3-0200-4595-a63b-0cbb2ae72072"). InnerVolumeSpecName "kube-api-access-ln5xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:24.822143 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.822117    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln5xv\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-kube-api-access-ln5xv\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.822143 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.822140    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.822281 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.822149    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:24.822281 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:24.822158    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feeec4b3-0200-4595-a63b-0cbb2ae72072-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:25.434690 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.434654    2570 generic.go:356] "Generic (PLEG): container finished" podID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerID="bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4" exitCode=0
Sep 09 20:41:25.434878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.434699    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"
Sep 09 20:41:25.434878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.434738    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" event={"ID":"feeec4b3-0200-4595-a63b-0cbb2ae72072","Type":"ContainerDied","Data":"bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4"}
Sep 09 20:41:25.434878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.434793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt" event={"ID":"feeec4b3-0200-4595-a63b-0cbb2ae72072","Type":"ContainerDied","Data":"56b1959df48bae7e44aa358da1fb80d7258816996da352df9e2208f88aa6fb0e"}
Sep 09 20:41:25.434878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.434817    2570 scope.go:117] "RemoveContainer" containerID="bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4"
Sep 09 20:41:25.444673 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.444654    2570 scope.go:117] "RemoveContainer" containerID="654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"
Sep 09 20:41:25.453269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.453229    2570 scope.go:117] "RemoveContainer" containerID="bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4"
Sep 09 20:41:25.453661 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:41:25.453629    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4\": container with ID starting with bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4 not found: ID does not exist" containerID="bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4"
Sep 09 20:41:25.453742 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.453693    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4"} err="failed to get container status \"bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4\": rpc error: code = NotFound desc = could not find container \"bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4\": container with ID starting with bd4f289f872d1ff5dbe8a780daad78fee20a88698f526ec1b7a5d16b82bee3f4 not found: ID does not exist"
Sep 09 20:41:25.453742 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.453719    2570 scope.go:117] "RemoveContainer" containerID="654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"
Sep 09 20:41:25.454159 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:41:25.454100    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8\": container with ID starting with 654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8 not found: ID does not exist" containerID="654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"
Sep 09 20:41:25.454159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.454131    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8"} err="failed to get container status \"654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8\": rpc error: code = NotFound desc = could not find container \"654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8\": container with ID starting with 654a11e1736a44174c62dda2a4586d08dee433e59ebcf7c3b6ea1bfb997459a8 not found: ID does not exist"
Sep 09 20:41:25.456240 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.456207    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"]
Sep 09 20:41:25.461533 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:25.461514    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt"]
Sep 09 20:41:26.308203 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:26.308168    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" path="/var/lib/kubelet/pods/feeec4b3-0200-4595-a63b-0cbb2ae72072/volumes"
Sep 09 20:41:37.280067 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:37.280017    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"]
Sep 09 20:41:37.280878 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:37.280843    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" containerID="cri-o://9273345a72a9baa195349c94e52cb01f435aa898e41484a7cb46da2253eb9626" gracePeriod=30
Sep 09 20:41:42.428497 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.428463    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 20:41:42.428838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.428537    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 20:41:42.530456 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.530421    2570 generic.go:356] "Generic (PLEG): container finished" podID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerID="9273345a72a9baa195349c94e52cb01f435aa898e41484a7cb46da2253eb9626" exitCode=0
Sep 09 20:41:42.530601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.530486    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" event={"ID":"66f32853-1430-46d7-ad5e-109ceae6a9e0","Type":"ContainerDied","Data":"9273345a72a9baa195349c94e52cb01f435aa898e41484a7cb46da2253eb9626"}
Sep 09 20:41:42.530601 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.530548    2570 scope.go:117] "RemoveContainer" containerID="30386a0129013a9c72df5bd0b559e9480a75e7279bd8013832144e876939beef"
Sep 09 20:41:42.554038 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.554017    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:41:42.608214 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608187    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-data\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608221    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-socket\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608299    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-podinfo\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608317    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-certs\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608336    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-token\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608353    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-envoy\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608385    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-credential-socket\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608494    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:42.608633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608587    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:42.608633 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608600    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:42.608822 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608704    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:42.608822 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608740    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g5r7\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-kube-api-access-7g5r7\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.608822 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.608803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f32853-1430-46d7-ad5e-109ceae6a9e0-istiod-ca-cert\") pod \"66f32853-1430-46d7-ad5e-109ceae6a9e0\" (UID: \"66f32853-1430-46d7-ad5e-109ceae6a9e0\") "
Sep 09 20:41:42.609181 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.609153    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.609181 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.609176    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.609341 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.609189    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.609341 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.609201    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.609341 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.609324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f32853-1430-46d7-ad5e-109ceae6a9e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:41:42.610795 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.610774    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:41:42.610890 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.610815    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:41:42.611231 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.611213    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-kube-api-access-7g5r7" (OuterVolumeSpecName: "kube-api-access-7g5r7") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "kube-api-access-7g5r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:42.611280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.611239    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "66f32853-1430-46d7-ad5e-109ceae6a9e0" (UID: "66f32853-1430-46d7-ad5e-109ceae6a9e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:41:42.710517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.710486    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.710517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.710513    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.710517 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.710522    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f32853-1430-46d7-ad5e-109ceae6a9e0-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.710803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.710529    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g5r7\" (UniqueName: \"kubernetes.io/projected/66f32853-1430-46d7-ad5e-109ceae6a9e0-kube-api-access-7g5r7\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:42.710803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:42.710539    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f32853-1430-46d7-ad5e-109ceae6a9e0-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:41:43.536727 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:43.536693    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq" event={"ID":"66f32853-1430-46d7-ad5e-109ceae6a9e0","Type":"ContainerDied","Data":"246c5dd8a34a99b6399d4d4274aaee477fff13ff929384e54702f7289d1dc5ae"}
Sep 09 20:41:43.536727 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:43.536719    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"
Sep 09 20:41:43.537257 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:43.536770    2570 scope.go:117] "RemoveContainer" containerID="9273345a72a9baa195349c94e52cb01f435aa898e41484a7cb46da2253eb9626"
Sep 09 20:41:43.572870 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:43.572843    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"]
Sep 09 20:41:43.578266 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:43.578245    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq"]
Sep 09 20:41:44.307045 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:41:44.307015    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" path="/var/lib/kubelet/pods/66f32853-1430-46d7-ad5e-109ceae6a9e0/volumes"
Sep 09 20:42:44.179215 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179181    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"]
Sep 09 20:42:44.179863 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179841    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179866    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179879    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d49f047-07cd-4c9d-a58a-5c58f95bca97" containerName="maas-api"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179887    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d49f047-07cd-4c9d-a58a-5c58f95bca97" containerName="maas-api"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179900    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179908    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179954    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy"
Sep 09 20:42:44.179972 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179963    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179981    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.179989    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180007    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180018    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180135    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180148    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d49f047-07cd-4c9d-a58a-5c58f95bca97" containerName="maas-api"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180161    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180171    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180181    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy"
Sep 09 20:42:44.180326 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.180191    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f32853-1430-46d7-ad5e-109ceae6a9e0" containerName="istio-proxy"
Sep 09 20:42:44.185115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.185093    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.188439 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.188416    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-868e40-serving-cert\""
Sep 09 20:42:44.193990 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.193968    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"]
Sep 09 20:42:44.287809 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.287771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-metrics-certs\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.288017 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.287881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.288017 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.287903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnjs8\" (UniqueName: \"kubernetes.io/projected/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-kube-api-access-gnjs8\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.288017 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.287965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.388816 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.388779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-metrics-certs\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.389103 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.388868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.389103 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.388886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnjs8\" (UniqueName: \"kubernetes.io/projected/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-kube-api-access-gnjs8\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.389103 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.388968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.389103 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:42:44.389054    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-serving-cert: secret "maas-api-e2e-ipp-a-868e40-serving-cert" not found
Sep 09 20:42:44.389340 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:42:44.389156    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls podName:837ca12c-e8ae-400e-9c97-06e12ce6d5b0 nodeName:}" failed. No retries permitted until 2026-09-09 20:42:44.889130931 +0000 UTC m=+1569.116081702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls") pod "maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" (UID: "837ca12c-e8ae-400e-9c97-06e12ce6d5b0") : secret "maas-api-e2e-ipp-a-868e40-serving-cert" not found
Sep 09 20:42:44.389648 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.389630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.391442 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.391421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-metrics-certs\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.399674 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.399651    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnjs8\" (UniqueName: \"kubernetes.io/projected/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-kube-api-access-gnjs8\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.894254 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.894207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:44.896782 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:44.896744    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls\") pod \"maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:45.097021 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:45.096984    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:45.370569 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:45.370542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"]
Sep 09 20:42:45.372688 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:42:45.372647    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837ca12c_e8ae_400e_9c97_06e12ce6d5b0.slice/crio-c519ba7bd0e54621b8349cde6a602890d271e6e9c34b575a9f3f1a0890e62dbb WatchSource:0}: Error finding container c519ba7bd0e54621b8349cde6a602890d271e6e9c34b575a9f3f1a0890e62dbb: Status 404 returned error can't find the container with id c519ba7bd0e54621b8349cde6a602890d271e6e9c34b575a9f3f1a0890e62dbb
Sep 09 20:42:45.374070 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:45.374047    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:42:45.871677 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:45.871638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" event={"ID":"837ca12c-e8ae-400e-9c97-06e12ce6d5b0","Type":"ContainerStarted","Data":"c519ba7bd0e54621b8349cde6a602890d271e6e9c34b575a9f3f1a0890e62dbb"}
Sep 09 20:42:46.878724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:46.878685    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" event={"ID":"837ca12c-e8ae-400e-9c97-06e12ce6d5b0","Type":"ContainerStarted","Data":"35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1"}
Sep 09 20:42:46.879175 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:46.878742    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:42:46.897529 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:46.897481    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" podStartSLOduration=2.423525098 podStartE2EDuration="2.897466216s" totalImagesPullingTime="473.941118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:42:46.895853653 +0000 UTC m=+1571.122804414" watchObservedRunningTime="2026-09-09 20:42:46.897466216 +0000 UTC m=+1571.124416977"
Sep 09 20:42:52.889360 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:42:52.889329    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:43:14.134595 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.134549    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"]
Sep 09 20:43:14.135371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.135349    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy"
Sep 09 20:43:14.135472 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.135382    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeec4b3-0200-4595-a63b-0cbb2ae72072" containerName="istio-proxy"
Sep 09 20:43:14.135534 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.135507    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee175f9e-5682-4bba-9aeb-882fe2436efe" containerName="istio-proxy"
Sep 09 20:43:14.139332 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.139311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.141847 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.141823    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-697f19-serving-cert\""
Sep 09 20:43:14.150803 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.150777    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"]
Sep 09 20:43:14.204297 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.204266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cv5j\" (UniqueName: \"kubernetes.io/projected/276264c0-1bb4-4ff9-b52d-746fe2c7457c-kube-api-access-6cv5j\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.204419 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.204304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/276264c0-1bb4-4ff9-b52d-746fe2c7457c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.204419 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.204324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.204511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.204436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-metrics-certs\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.306315 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.306280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cv5j\" (UniqueName: \"kubernetes.io/projected/276264c0-1bb4-4ff9-b52d-746fe2c7457c-kube-api-access-6cv5j\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.306315 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.306329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/276264c0-1bb4-4ff9-b52d-746fe2c7457c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.306588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.306362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.306588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.306450    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-metrics-certs\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.306588 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:43:14.306545    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-serving-cert: secret "maas-api-e2e-ipp-b-697f19-serving-cert" not found
Sep 09 20:43:14.306749 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:43:14.306620    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls podName:276264c0-1bb4-4ff9-b52d-746fe2c7457c nodeName:}" failed. No retries permitted until 2026-09-09 20:43:14.806597668 +0000 UTC m=+1599.033548424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls") pod "maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" (UID: "276264c0-1bb4-4ff9-b52d-746fe2c7457c") : secret "maas-api-e2e-ipp-b-697f19-serving-cert" not found
Sep 09 20:43:14.307096 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.307066    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/276264c0-1bb4-4ff9-b52d-746fe2c7457c-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.309115 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.309093    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-metrics-certs\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.314888 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.314870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cv5j\" (UniqueName: \"kubernetes.io/projected/276264c0-1bb4-4ff9-b52d-746fe2c7457c-kube-api-access-6cv5j\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.812826 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.812794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:14.815387 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:14.815363    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls\") pod \"maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:15.054521 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:15.054478    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:15.329588 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:15.329559    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"]
Sep 09 20:43:15.331155 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:43:15.331123    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276264c0_1bb4_4ff9_b52d_746fe2c7457c.slice/crio-406bd20c1dfb57bf9a4471b2250cb42b60b9f8946e837e946e5afaa8cd7f6c4d WatchSource:0}: Error finding container 406bd20c1dfb57bf9a4471b2250cb42b60b9f8946e837e946e5afaa8cd7f6c4d: Status 404 returned error can't find the container with id 406bd20c1dfb57bf9a4471b2250cb42b60b9f8946e837e946e5afaa8cd7f6c4d
Sep 09 20:43:16.033273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:16.033193    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" event={"ID":"276264c0-1bb4-4ff9-b52d-746fe2c7457c","Type":"ContainerStarted","Data":"daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573"}
Sep 09 20:43:16.033273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:16.033240    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" event={"ID":"276264c0-1bb4-4ff9-b52d-746fe2c7457c","Type":"ContainerStarted","Data":"406bd20c1dfb57bf9a4471b2250cb42b60b9f8946e837e946e5afaa8cd7f6c4d"}
Sep 09 20:43:16.033273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:16.033271    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:43:16.051221 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:16.051169    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" podStartSLOduration=1.670502151 podStartE2EDuration="2.051153017s" totalImagesPullingTime="380.650866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:43:16.049239754 +0000 UTC m=+1600.276190532" watchObservedRunningTime="2026-09-09 20:43:16.051153017 +0000 UTC m=+1600.278103777"
Sep 09 20:43:22.043445 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:43:22.043414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:44:14.045373 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.045334    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"]
Sep 09 20:44:14.049514 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.049490    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.051768 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.051747    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-dd5d0a-serving-cert\""
Sep 09 20:44:14.061084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.061059    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"]
Sep 09 20:44:14.165680 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.165648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n86g\" (UniqueName: \"kubernetes.io/projected/04d9b9e4-3495-4837-919a-ed8eea554979-kube-api-access-8n86g\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.165829 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.165705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.165829 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.165783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.165829 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.165822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04d9b9e4-3495-4837-919a-ed8eea554979-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.267212 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.267185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.267343 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.267226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.267343 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.267250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04d9b9e4-3495-4837-919a-ed8eea554979-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.267343 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.267325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n86g\" (UniqueName: \"kubernetes.io/projected/04d9b9e4-3495-4837-919a-ed8eea554979-kube-api-access-8n86g\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.267343 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:44:14.267337    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-serving-cert: secret "maas-api-e2e-ipp-cleanup-dd5d0a-serving-cert" not found
Sep 09 20:44:14.267558 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:44:14.267404    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls podName:04d9b9e4-3495-4837-919a-ed8eea554979 nodeName:}" failed. No retries permitted until 2026-09-09 20:44:14.767389023 +0000 UTC m=+1658.994339762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" (UID: "04d9b9e4-3495-4837-919a-ed8eea554979") : secret "maas-api-e2e-ipp-cleanup-dd5d0a-serving-cert" not found
Sep 09 20:44:14.267980 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.267961    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04d9b9e4-3495-4837-919a-ed8eea554979-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.269752 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.269733    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.276381 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.276362    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n86g\" (UniqueName: \"kubernetes.io/projected/04d9b9e4-3495-4837-919a-ed8eea554979-kube-api-access-8n86g\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.773123 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.773079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.775771 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.775746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:14.961511 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:14.961472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:15.237171 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:15.237134    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"]
Sep 09 20:44:15.238572 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:44:15.238535    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d9b9e4_3495_4837_919a_ed8eea554979.slice/crio-bfa780e8e76ef71faece37f6a7b2e26b67dd03246203f72fb5b7988b91ef9cd8 WatchSource:0}: Error finding container bfa780e8e76ef71faece37f6a7b2e26b67dd03246203f72fb5b7988b91ef9cd8: Status 404 returned error can't find the container with id bfa780e8e76ef71faece37f6a7b2e26b67dd03246203f72fb5b7988b91ef9cd8
Sep 09 20:44:15.355865 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:15.355832    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" event={"ID":"04d9b9e4-3495-4837-919a-ed8eea554979","Type":"ContainerStarted","Data":"bfa780e8e76ef71faece37f6a7b2e26b67dd03246203f72fb5b7988b91ef9cd8"}
Sep 09 20:44:16.362771 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:16.362737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" event={"ID":"04d9b9e4-3495-4837-919a-ed8eea554979","Type":"ContainerStarted","Data":"b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2"}
Sep 09 20:44:16.363200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:16.362838    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:16.380300 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:16.380240    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" podStartSLOduration=1.4369497820000001 podStartE2EDuration="2.380224684s" totalImagesPullingTime="943.274902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:44:16.378631505 +0000 UTC m=+1660.605582291" watchObservedRunningTime="2026-09-09 20:44:16.380224684 +0000 UTC m=+1660.607175444"
Sep 09 20:44:22.373851 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:22.373821    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:52.609628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:52.609594    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"]
Sep 09 20:44:52.610184 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:52.609819    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" podUID="04d9b9e4-3495-4837-919a-ed8eea554979" containerName="maas-api" containerID="cri-o://b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2" gracePeriod=30
Sep 09 20:44:52.865790 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:52.865727    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:53.035119 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.035090    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04d9b9e4-3495-4837-919a-ed8eea554979-openshift-service-ca\") pod \"04d9b9e4-3495-4837-919a-ed8eea554979\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") "
Sep 09 20:44:53.035294 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.035144    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls\") pod \"04d9b9e4-3495-4837-919a-ed8eea554979\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") "
Sep 09 20:44:53.035294 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.035231    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n86g\" (UniqueName: \"kubernetes.io/projected/04d9b9e4-3495-4837-919a-ed8eea554979-kube-api-access-8n86g\") pod \"04d9b9e4-3495-4837-919a-ed8eea554979\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") "
Sep 09 20:44:53.035294 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.035263    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-metrics-certs\") pod \"04d9b9e4-3495-4837-919a-ed8eea554979\" (UID: \"04d9b9e4-3495-4837-919a-ed8eea554979\") "
Sep 09 20:44:53.035468 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.035445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04d9b9e4-3495-4837-919a-ed8eea554979-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04d9b9e4-3495-4837-919a-ed8eea554979" (UID: "04d9b9e4-3495-4837-919a-ed8eea554979"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:53.035550 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.035535    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04d9b9e4-3495-4837-919a-ed8eea554979-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:44:53.037519 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.037484    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "04d9b9e4-3495-4837-919a-ed8eea554979" (UID: "04d9b9e4-3495-4837-919a-ed8eea554979"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:53.037641 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.037530    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04d9b9e4-3495-4837-919a-ed8eea554979" (UID: "04d9b9e4-3495-4837-919a-ed8eea554979"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:53.037641 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.037542    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d9b9e4-3495-4837-919a-ed8eea554979-kube-api-access-8n86g" (OuterVolumeSpecName: "kube-api-access-8n86g") pod "04d9b9e4-3495-4837-919a-ed8eea554979" (UID: "04d9b9e4-3495-4837-919a-ed8eea554979"). InnerVolumeSpecName "kube-api-access-8n86g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:44:53.137054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.136983    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n86g\" (UniqueName: \"kubernetes.io/projected/04d9b9e4-3495-4837-919a-ed8eea554979-kube-api-access-8n86g\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:44:53.137054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.137008    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:44:53.137054 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.137017    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04d9b9e4-3495-4837-919a-ed8eea554979-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:44:53.568280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.568199    2570 generic.go:356] "Generic (PLEG): container finished" podID="04d9b9e4-3495-4837-919a-ed8eea554979" containerID="b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2" exitCode=0
Sep 09 20:44:53.568280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.568244    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"
Sep 09 20:44:53.568466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.568278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" event={"ID":"04d9b9e4-3495-4837-919a-ed8eea554979","Type":"ContainerDied","Data":"b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2"}
Sep 09 20:44:53.568466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.568331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd" event={"ID":"04d9b9e4-3495-4837-919a-ed8eea554979","Type":"ContainerDied","Data":"bfa780e8e76ef71faece37f6a7b2e26b67dd03246203f72fb5b7988b91ef9cd8"}
Sep 09 20:44:53.568466 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.568354    2570 scope.go:117] "RemoveContainer" containerID="b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2"
Sep 09 20:44:53.577855 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.577839    2570 scope.go:117] "RemoveContainer" containerID="b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2"
Sep 09 20:44:53.578149 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:44:53.578131    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2\": container with ID starting with b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2 not found: ID does not exist" containerID="b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2"
Sep 09 20:44:53.578227 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.578159    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2"} err="failed to get container status \"b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2\": rpc error: code = NotFound desc = could not find container \"b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2\": container with ID starting with b5ec6eb2203f325eaaa812891173fb0d2a014d7961e8280786f2df8070db90c2 not found: ID does not exist"
Sep 09 20:44:53.592606 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.592582    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"]
Sep 09 20:44:53.594866 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:53.594845    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-dd5d0a-ff6f7b5dd-tf5jd"]
Sep 09 20:44:54.307940 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:44:54.307908    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d9b9e4-3495-4837-919a-ed8eea554979" path="/var/lib/kubelet/pods/04d9b9e4-3495-4837-919a-ed8eea554979/volumes"
Sep 09 20:45:18.435772 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.435740    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"]
Sep 09 20:45:18.436306 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.435992    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" podUID="837ca12c-e8ae-400e-9c97-06e12ce6d5b0" containerName="maas-api" containerID="cri-o://35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1" gracePeriod=30
Sep 09 20:45:18.682108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.682084    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:45:18.701154 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.701090    2570 generic.go:356] "Generic (PLEG): container finished" podID="837ca12c-e8ae-400e-9c97-06e12ce6d5b0" containerID="35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1" exitCode=0
Sep 09 20:45:18.701154 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.701131    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"
Sep 09 20:45:18.701321 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.701173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" event={"ID":"837ca12c-e8ae-400e-9c97-06e12ce6d5b0","Type":"ContainerDied","Data":"35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1"}
Sep 09 20:45:18.701321 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.701227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh" event={"ID":"837ca12c-e8ae-400e-9c97-06e12ce6d5b0","Type":"ContainerDied","Data":"c519ba7bd0e54621b8349cde6a602890d271e6e9c34b575a9f3f1a0890e62dbb"}
Sep 09 20:45:18.701321 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.701255    2570 scope.go:117] "RemoveContainer" containerID="35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1"
Sep 09 20:45:18.713098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.713058    2570 scope.go:117] "RemoveContainer" containerID="35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1"
Sep 09 20:45:18.713421 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:45:18.713380    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1\": container with ID starting with 35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1 not found: ID does not exist" containerID="35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1"
Sep 09 20:45:18.713544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.713430    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1"} err="failed to get container status \"35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1\": rpc error: code = NotFound desc = could not find container \"35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1\": container with ID starting with 35a6d9c3d7ce035d5532ba53fcabc33ff8e9c6bf1a52e520642db74a9f1083b1 not found: ID does not exist"
Sep 09 20:45:18.774058 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.774033    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnjs8\" (UniqueName: \"kubernetes.io/projected/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-kube-api-access-gnjs8\") pod \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") "
Sep 09 20:45:18.774180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.774115    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-metrics-certs\") pod \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") "
Sep 09 20:45:18.774180 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.774144    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-openshift-service-ca\") pod \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") "
Sep 09 20:45:18.774280 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.774203    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls\") pod \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\" (UID: \"837ca12c-e8ae-400e-9c97-06e12ce6d5b0\") "
Sep 09 20:45:18.774583 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.774546    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "837ca12c-e8ae-400e-9c97-06e12ce6d5b0" (UID: "837ca12c-e8ae-400e-9c97-06e12ce6d5b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:45:18.776339 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.776304    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-kube-api-access-gnjs8" (OuterVolumeSpecName: "kube-api-access-gnjs8") pod "837ca12c-e8ae-400e-9c97-06e12ce6d5b0" (UID: "837ca12c-e8ae-400e-9c97-06e12ce6d5b0"). InnerVolumeSpecName "kube-api-access-gnjs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:45:18.776446 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.776418    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "837ca12c-e8ae-400e-9c97-06e12ce6d5b0" (UID: "837ca12c-e8ae-400e-9c97-06e12ce6d5b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:45:18.776544 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.776525    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "837ca12c-e8ae-400e-9c97-06e12ce6d5b0" (UID: "837ca12c-e8ae-400e-9c97-06e12ce6d5b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:45:18.875273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.875239    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:45:18.875273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.875269    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:45:18.875273 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.875279    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:45:18.875500 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:18.875290    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnjs8\" (UniqueName: \"kubernetes.io/projected/837ca12c-e8ae-400e-9c97-06e12ce6d5b0-kube-api-access-gnjs8\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:45:19.025957 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:19.025912    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"]
Sep 09 20:45:19.036510 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:19.036477    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-868e40-5fdd4fb6b-8g4kh"]
Sep 09 20:45:20.307826 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:45:20.307788    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="837ca12c-e8ae-400e-9c97-06e12ce6d5b0" path="/var/lib/kubelet/pods/837ca12c-e8ae-400e-9c97-06e12ce6d5b0/volumes"
Sep 09 20:46:20.132599 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.132560    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"]
Sep 09 20:46:20.133153 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.132786    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" podUID="276264c0-1bb4-4ff9-b52d-746fe2c7457c" containerName="maas-api" containerID="cri-o://daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573" gracePeriod=30
Sep 09 20:46:20.400200 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.400177    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:46:20.442044 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.442009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/276264c0-1bb4-4ff9-b52d-746fe2c7457c-openshift-service-ca\") pod \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") "
Sep 09 20:46:20.442190 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.442048    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls\") pod \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") "
Sep 09 20:46:20.442190 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.442086    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cv5j\" (UniqueName: \"kubernetes.io/projected/276264c0-1bb4-4ff9-b52d-746fe2c7457c-kube-api-access-6cv5j\") pod \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") "
Sep 09 20:46:20.442190 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.442148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-metrics-certs\") pod \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\" (UID: \"276264c0-1bb4-4ff9-b52d-746fe2c7457c\") "
Sep 09 20:46:20.442453 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.442424    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/276264c0-1bb4-4ff9-b52d-746fe2c7457c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "276264c0-1bb4-4ff9-b52d-746fe2c7457c" (UID: "276264c0-1bb4-4ff9-b52d-746fe2c7457c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:46:20.444371 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.444348    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "276264c0-1bb4-4ff9-b52d-746fe2c7457c" (UID: "276264c0-1bb4-4ff9-b52d-746fe2c7457c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:46:20.444462 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.444424    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "276264c0-1bb4-4ff9-b52d-746fe2c7457c" (UID: "276264c0-1bb4-4ff9-b52d-746fe2c7457c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:46:20.444508 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.444461    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/276264c0-1bb4-4ff9-b52d-746fe2c7457c-kube-api-access-6cv5j" (OuterVolumeSpecName: "kube-api-access-6cv5j") pod "276264c0-1bb4-4ff9-b52d-746fe2c7457c" (UID: "276264c0-1bb4-4ff9-b52d-746fe2c7457c"). InnerVolumeSpecName "kube-api-access-6cv5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:46:20.543686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.543652    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/276264c0-1bb4-4ff9-b52d-746fe2c7457c-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:20.543686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.543681    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:20.543919 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.543694    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cv5j\" (UniqueName: \"kubernetes.io/projected/276264c0-1bb4-4ff9-b52d-746fe2c7457c-kube-api-access-6cv5j\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:20.543919 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:20.543706    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/276264c0-1bb4-4ff9-b52d-746fe2c7457c-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:21.035987 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.035916    2570 generic.go:356] "Generic (PLEG): container finished" podID="276264c0-1bb4-4ff9-b52d-746fe2c7457c" containerID="daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573" exitCode=0
Sep 09 20:46:21.035987 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.035987    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"
Sep 09 20:46:21.036191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.036012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" event={"ID":"276264c0-1bb4-4ff9-b52d-746fe2c7457c","Type":"ContainerDied","Data":"daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573"}
Sep 09 20:46:21.036191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.036073    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f" event={"ID":"276264c0-1bb4-4ff9-b52d-746fe2c7457c","Type":"ContainerDied","Data":"406bd20c1dfb57bf9a4471b2250cb42b60b9f8946e837e946e5afaa8cd7f6c4d"}
Sep 09 20:46:21.036191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.036098    2570 scope.go:117] "RemoveContainer" containerID="daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573"
Sep 09 20:46:21.045899 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.045884    2570 scope.go:117] "RemoveContainer" containerID="daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573"
Sep 09 20:46:21.046186 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:46:21.046168    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573\": container with ID starting with daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573 not found: ID does not exist" containerID="daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573"
Sep 09 20:46:21.046240 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.046195    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573"} err="failed to get container status \"daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573\": rpc error: code = NotFound desc = could not find container \"daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573\": container with ID starting with daebe10778f6b509a7fea982dfc8161f9154829ccbc783412bf8c8f2edd76573 not found: ID does not exist"
Sep 09 20:46:21.088915 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.088889    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"]
Sep 09 20:46:21.095268 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:21.095240    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-697f19-6cdcd6c67d-czv8f"]
Sep 09 20:46:22.307052 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:22.307020    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="276264c0-1bb4-4ff9-b52d-746fe2c7457c" path="/var/lib/kubelet/pods/276264c0-1bb4-4ff9-b52d-746fe2c7457c/volumes"
Sep 09 20:46:40.087416 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.087380    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"]
Sep 09 20:46:40.087789 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.087564    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" podUID="b25c0892-9dde-4ab8-9fbe-8380a67190fe" containerName="maas-api" containerID="cri-o://32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051" gracePeriod=30
Sep 09 20:46:40.356802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.356768    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:46:40.424575 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.424545    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxzgt\" (UniqueName: \"kubernetes.io/projected/b25c0892-9dde-4ab8-9fbe-8380a67190fe-kube-api-access-fxzgt\") pod \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") "
Sep 09 20:46:40.424730 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.424619    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls\") pod \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") "
Sep 09 20:46:40.424730 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.424643    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-metrics-certs\") pod \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") "
Sep 09 20:46:40.424860 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.424777    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b25c0892-9dde-4ab8-9fbe-8380a67190fe-openshift-service-ca\") pod \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\" (UID: \"b25c0892-9dde-4ab8-9fbe-8380a67190fe\") "
Sep 09 20:46:40.425216 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.425177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b25c0892-9dde-4ab8-9fbe-8380a67190fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b25c0892-9dde-4ab8-9fbe-8380a67190fe" (UID: "b25c0892-9dde-4ab8-9fbe-8380a67190fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:46:40.427121 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.427096    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b25c0892-9dde-4ab8-9fbe-8380a67190fe" (UID: "b25c0892-9dde-4ab8-9fbe-8380a67190fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:46:40.427121 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.427109    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25c0892-9dde-4ab8-9fbe-8380a67190fe-kube-api-access-fxzgt" (OuterVolumeSpecName: "kube-api-access-fxzgt") pod "b25c0892-9dde-4ab8-9fbe-8380a67190fe" (UID: "b25c0892-9dde-4ab8-9fbe-8380a67190fe"). InnerVolumeSpecName "kube-api-access-fxzgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:46:40.427271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.427256    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b25c0892-9dde-4ab8-9fbe-8380a67190fe" (UID: "b25c0892-9dde-4ab8-9fbe-8380a67190fe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:46:40.525837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.525803    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b25c0892-9dde-4ab8-9fbe-8380a67190fe-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:40.525837 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.525835    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxzgt\" (UniqueName: \"kubernetes.io/projected/b25c0892-9dde-4ab8-9fbe-8380a67190fe-kube-api-access-fxzgt\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:40.526078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.525848    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:40.526078 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:40.525862    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b25c0892-9dde-4ab8-9fbe-8380a67190fe-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:41.153298 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.153266    2570 generic.go:356] "Generic (PLEG): container finished" podID="b25c0892-9dde-4ab8-9fbe-8380a67190fe" containerID="32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051" exitCode=0
Sep 09 20:46:41.153718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.153319    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"
Sep 09 20:46:41.153718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.153349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" event={"ID":"b25c0892-9dde-4ab8-9fbe-8380a67190fe","Type":"ContainerDied","Data":"32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051"}
Sep 09 20:46:41.153718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.153414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn" event={"ID":"b25c0892-9dde-4ab8-9fbe-8380a67190fe","Type":"ContainerDied","Data":"4df63ddf6f2a150fbeb6bc6ef5acaf55f8d1e2d564224e06479249ac70ccf83c"}
Sep 09 20:46:41.153718 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.153438    2570 scope.go:117] "RemoveContainer" containerID="32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051"
Sep 09 20:46:41.162956 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.162919    2570 scope.go:117] "RemoveContainer" containerID="32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051"
Sep 09 20:46:41.163202 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:46:41.163185    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051\": container with ID starting with 32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051 not found: ID does not exist" containerID="32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051"
Sep 09 20:46:41.163251 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.163209    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051"} err="failed to get container status \"32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051\": rpc error: code = NotFound desc = could not find container \"32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051\": container with ID starting with 32b70f25a192b7c3cb74c9d3768b43c4725d6c9ebe1e3329c53f256d0f97e051 not found: ID does not exist"
Sep 09 20:46:41.212133 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.212108    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"]
Sep 09 20:46:41.225684 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:41.225663    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-166b94-7c464cb846-97kjn"]
Sep 09 20:46:42.306603 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:42.306571    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b25c0892-9dde-4ab8-9fbe-8380a67190fe" path="/var/lib/kubelet/pods/b25c0892-9dde-4ab8-9fbe-8380a67190fe/volumes"
Sep 09 20:46:49.717015 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:49.716981    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"]
Sep 09 20:46:49.717494 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:49.717236    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" containerID="cri-o://c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c" gracePeriod=30
Sep 09 20:46:53.894128 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:53.894092    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 20:46:53.894563 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:53.894150    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:46:54.968546 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:54.968524    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:46:55.064999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.064870    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-podinfo\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.064999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.064959    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-data\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.064999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.064983    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-token\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-credential-socket\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065044    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-socket\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065095    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlcnj\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-kube-api-access-dlcnj\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065147    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-envoy\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065191    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94faf2b1-d888-44cc-8f27-543e2f27e610-istiod-ca-cert\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065293 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065229    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-certs\") pod \"94faf2b1-d888-44cc-8f27-543e2f27e610\" (UID: \"94faf2b1-d888-44cc-8f27-543e2f27e610\") "
Sep 09 20:46:55.065572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065312    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:55.065572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065344    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:55.065572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065520    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-data" (OuterVolumeSpecName: "istio-data") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:55.065724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065612    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94faf2b1-d888-44cc-8f27-543e2f27e610-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:46:55.065724 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065681    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-data\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.065915 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065897    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-credential-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.066022 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065918    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-socket\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.066022 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.065963    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:55.067375 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.067354    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 20:46:55.067518 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.067481    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:46:55.067844 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.067827    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-token" (OuterVolumeSpecName: "istio-token") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:46:55.067941 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.067909    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-kube-api-access-dlcnj" (OuterVolumeSpecName: "kube-api-access-dlcnj") pod "94faf2b1-d888-44cc-8f27-543e2f27e610" (UID: "94faf2b1-d888-44cc-8f27-543e2f27e610"). InnerVolumeSpecName "kube-api-access-dlcnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:46:55.166612 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.166572    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-podinfo\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.166612 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.166606    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-token\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.166816 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.166615    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlcnj\" (UniqueName: \"kubernetes.io/projected/94faf2b1-d888-44cc-8f27-543e2f27e610-kube-api-access-dlcnj\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.166816 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.166636    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-istio-envoy\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.166816 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.166645    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94faf2b1-d888-44cc-8f27-543e2f27e610-istiod-ca-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.166816 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.166653    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94faf2b1-d888-44cc-8f27-543e2f27e610-workload-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:46:55.233840 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.233807    2570 generic.go:356] "Generic (PLEG): container finished" podID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerID="c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c" exitCode=0
Sep 09 20:46:55.234067 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.233862    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"
Sep 09 20:46:55.234067 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.233890    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" event={"ID":"94faf2b1-d888-44cc-8f27-543e2f27e610","Type":"ContainerDied","Data":"c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c"}
Sep 09 20:46:55.234067 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.233971    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65" event={"ID":"94faf2b1-d888-44cc-8f27-543e2f27e610","Type":"ContainerDied","Data":"80a1b027b2e223aec0afd8a9705172fd9bcfa72924b64d85ea7d5ae298588057"}
Sep 09 20:46:55.234067 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.234003    2570 scope.go:117] "RemoveContainer" containerID="c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c"
Sep 09 20:46:55.244062 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.244040    2570 scope.go:117] "RemoveContainer" containerID="06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"
Sep 09 20:46:55.252153 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.252136    2570 scope.go:117] "RemoveContainer" containerID="c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c"
Sep 09 20:46:55.252418 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:46:55.252402    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c\": container with ID starting with c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c not found: ID does not exist" containerID="c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c"
Sep 09 20:46:55.252464 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.252425    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c"} err="failed to get container status \"c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c\": rpc error: code = NotFound desc = could not find container \"c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c\": container with ID starting with c61775f8ade78b4ecbfe223ed35e3ac72eb69402d2ce20ef06943c2f991acb7c not found: ID does not exist"
Sep 09 20:46:55.252464 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.252440    2570 scope.go:117] "RemoveContainer" containerID="06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"
Sep 09 20:46:55.252656 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:46:55.252638    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6\": container with ID starting with 06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6 not found: ID does not exist" containerID="06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"
Sep 09 20:46:55.252695 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.252659    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6"} err="failed to get container status \"06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6\": rpc error: code = NotFound desc = could not find container \"06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6\": container with ID starting with 06d27ac58a28eb660e92b87abfb19452c5e9304734fa899e2e00b5ed0a4a7ce6 not found: ID does not exist"
Sep 09 20:46:55.281551 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.281526    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"]
Sep 09 20:46:55.292267 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:55.292244    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65"]
Sep 09 20:46:56.306686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:46:56.306657    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" path="/var/lib/kubelet/pods/94faf2b1-d888-44cc-8f27-543e2f27e610/volumes"
Sep 09 20:47:00.984630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:00.984599    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"]
Sep 09 20:47:00.985023 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:00.984820    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp" podUID="ffc32fcb-ccf5-48a3-93e8-330f3ed293de" containerName="maas-api" containerID="cri-o://34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379" gracePeriod=30
Sep 09 20:47:01.244101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.244032    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:47:01.270043 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.270007    2570 generic.go:356] "Generic (PLEG): container finished" podID="ffc32fcb-ccf5-48a3-93e8-330f3ed293de" containerID="34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379" exitCode=0
Sep 09 20:47:01.270238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.270108    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"
Sep 09 20:47:01.270238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.270113    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp" event={"ID":"ffc32fcb-ccf5-48a3-93e8-330f3ed293de","Type":"ContainerDied","Data":"34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379"}
Sep 09 20:47:01.270238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.270166    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp" event={"ID":"ffc32fcb-ccf5-48a3-93e8-330f3ed293de","Type":"ContainerDied","Data":"4b2967d64f40acd0ddbd73f304667b0b709d4f0ede2ab07e80900d7a4acae53e"}
Sep 09 20:47:01.270238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.270195    2570 scope.go:117] "RemoveContainer" containerID="34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379"
Sep 09 20:47:01.280122 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.280097    2570 scope.go:117] "RemoveContainer" containerID="34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379"
Sep 09 20:47:01.280427 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:47:01.280407    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379\": container with ID starting with 34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379 not found: ID does not exist" containerID="34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379"
Sep 09 20:47:01.280533 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.280436    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379"} err="failed to get container status \"34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379\": rpc error: code = NotFound desc = could not find container \"34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379\": container with ID starting with 34328d4778b4231660d30bb067c90e81af5dff7f82d7268891ecb81252724379 not found: ID does not exist"
Sep 09 20:47:01.315272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.315239    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtqvv\" (UniqueName: \"kubernetes.io/projected/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-kube-api-access-xtqvv\") pod \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") "
Sep 09 20:47:01.315272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.315275    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-openshift-service-ca\") pod \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") "
Sep 09 20:47:01.315465 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.315324    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-metrics-certs\") pod \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") "
Sep 09 20:47:01.315465 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.315370    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-maas-api-tls\") pod \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\" (UID: \"ffc32fcb-ccf5-48a3-93e8-330f3ed293de\") "
Sep 09 20:47:01.315686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.315662    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffc32fcb-ccf5-48a3-93e8-330f3ed293de" (UID: "ffc32fcb-ccf5-48a3-93e8-330f3ed293de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:47:01.317987 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.317957    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-kube-api-access-xtqvv" (OuterVolumeSpecName: "kube-api-access-xtqvv") pod "ffc32fcb-ccf5-48a3-93e8-330f3ed293de" (UID: "ffc32fcb-ccf5-48a3-93e8-330f3ed293de"). InnerVolumeSpecName "kube-api-access-xtqvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:47:01.318104 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.317960    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ffc32fcb-ccf5-48a3-93e8-330f3ed293de" (UID: "ffc32fcb-ccf5-48a3-93e8-330f3ed293de"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:01.318104 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.318052    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffc32fcb-ccf5-48a3-93e8-330f3ed293de" (UID: "ffc32fcb-ccf5-48a3-93e8-330f3ed293de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:01.416550 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.416523    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtqvv\" (UniqueName: \"kubernetes.io/projected/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-kube-api-access-xtqvv\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:01.416550 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.416547    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:01.416710 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.416557    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:01.416710 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.416565    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc32fcb-ccf5-48a3-93e8-330f3ed293de-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:01.630238 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.630203    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"]
Sep 09 20:47:01.648644 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:01.648620    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4101f2-9bc5566b7-pj6mp"]
Sep 09 20:47:02.306656 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:02.306624    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffc32fcb-ccf5-48a3-93e8-330f3ed293de" path="/var/lib/kubelet/pods/ffc32fcb-ccf5-48a3-93e8-330f3ed293de/volumes"
Sep 09 20:47:13.999098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:13.999065    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c4df4974f-kpv2w"]
Sep 09 20:47:13.999471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:13.999254    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c4df4974f-kpv2w" podUID="4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" containerName="manager" containerID="cri-o://0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18" gracePeriod=30
Sep 09 20:47:14.249751 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.249696    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:47:14.337236 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.337207    2570 generic.go:356] "Generic (PLEG): container finished" podID="4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" containerID="0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18" exitCode=0
Sep 09 20:47:14.337365 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.337246    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-kpv2w"
Sep 09 20:47:14.337365 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.337293    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-kpv2w" event={"ID":"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac","Type":"ContainerDied","Data":"0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18"}
Sep 09 20:47:14.337365 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.337351    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-kpv2w" event={"ID":"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac","Type":"ContainerDied","Data":"09ca246fe4c77208ed6a5bce9b3e261776a2cbf9a274f99aa336fdbd04bbf6cb"}
Sep 09 20:47:14.337492 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.337383    2570 scope.go:117] "RemoveContainer" containerID="0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18"
Sep 09 20:47:14.346557 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.346536    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-webhook-cert\") pod \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") "
Sep 09 20:47:14.346667 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.346566    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh95m\" (UniqueName: \"kubernetes.io/projected/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-kube-api-access-bh95m\") pod \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") "
Sep 09 20:47:14.346667 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.346625    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-metrics-certs\") pod \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\" (UID: \"4c3e5707-0d3b-4391-b533-fe6bbabaf5ac\") "
Sep 09 20:47:14.347763 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.347738    2570 scope.go:117] "RemoveContainer" containerID="0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18"
Sep 09 20:47:14.348172 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:47:14.348146    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18\": container with ID starting with 0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18 not found: ID does not exist" containerID="0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18"
Sep 09 20:47:14.348292 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.348182    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18"} err="failed to get container status \"0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18\": rpc error: code = NotFound desc = could not find container \"0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18\": container with ID starting with 0be8f770754649b6b25da49c53309de3932fbf6c02fa1c0134c0d53b9697da18 not found: ID does not exist"
Sep 09 20:47:14.348825 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.348799    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" (UID: "4c3e5707-0d3b-4391-b533-fe6bbabaf5ac"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:14.348992 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.348966    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" (UID: "4c3e5707-0d3b-4391-b533-fe6bbabaf5ac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:47:14.349095 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.349070    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-kube-api-access-bh95m" (OuterVolumeSpecName: "kube-api-access-bh95m") pod "4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" (UID: "4c3e5707-0d3b-4391-b533-fe6bbabaf5ac"). InnerVolumeSpecName "kube-api-access-bh95m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:47:14.447780 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.447743    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:14.447780 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.447775    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-webhook-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:14.448012 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.447790    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh95m\" (UniqueName: \"kubernetes.io/projected/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac-kube-api-access-bh95m\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:47:14.680380 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.680350    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c4df4974f-kpv2w"]
Sep 09 20:47:14.683025 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:14.682995    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c4df4974f-kpv2w"]
Sep 09 20:47:16.311362 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:47:16.311322    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" path="/var/lib/kubelet/pods/4c3e5707-0d3b-4391-b533-fe6bbabaf5ac/volumes"
Sep 09 20:48:15.567802 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.567760    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c4df4974f-bgs4g"]
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568195    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568206    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568214    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="837ca12c-e8ae-400e-9c97-06e12ce6d5b0" containerName="maas-api"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568221    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="837ca12c-e8ae-400e-9c97-06e12ce6d5b0" containerName="maas-api"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568234    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" containerName="manager"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568240    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" containerName="manager"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568251    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d9b9e4-3495-4837-919a-ed8eea554979" containerName="maas-api"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568256    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d9b9e4-3495-4837-919a-ed8eea554979" containerName="maas-api"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568263    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b25c0892-9dde-4ab8-9fbe-8380a67190fe" containerName="maas-api"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568268    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b25c0892-9dde-4ab8-9fbe-8380a67190fe" containerName="maas-api"
Sep 09 20:48:15.568271 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568275    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568280    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568286    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc32fcb-ccf5-48a3-93e8-330f3ed293de" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568290    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc32fcb-ccf5-48a3-93e8-330f3ed293de" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568299    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="276264c0-1bb4-4ff9-b52d-746fe2c7457c" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568304    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="276264c0-1bb4-4ff9-b52d-746fe2c7457c" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568369    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc32fcb-ccf5-48a3-93e8-330f3ed293de" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568376    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568384    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="276264c0-1bb4-4ff9-b52d-746fe2c7457c" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568390    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="837ca12c-e8ae-400e-9c97-06e12ce6d5b0" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568396    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c3e5707-0d3b-4391-b533-fe6bbabaf5ac" containerName="manager"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568403    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b25c0892-9dde-4ab8-9fbe-8380a67190fe" containerName="maas-api"
Sep 09 20:48:15.568719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.568408    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d9b9e4-3495-4837-919a-ed8eea554979" containerName="maas-api"
Sep 09 20:48:15.571545 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.571527    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.576264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.576208    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 20:48:15.576390 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.576283    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nk8km\""
Sep 09 20:48:15.576390 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.576228    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 20:48:15.576483 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.576402    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 20:48:15.586305 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.586283    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4df4974f-bgs4g"]
Sep 09 20:48:15.709630 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.709591    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtxgz\" (UniqueName: \"kubernetes.io/projected/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-kube-api-access-qtxgz\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.709813 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.709657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-webhook-cert\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.709813 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.709702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-metrics-certs\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.810907 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.810880    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtxgz\" (UniqueName: \"kubernetes.io/projected/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-kube-api-access-qtxgz\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.811108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.810952    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-webhook-cert\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.811108 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.810985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-metrics-certs\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.813570 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.813542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-metrics-certs\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.813570 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.813560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-webhook-cert\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.820998 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.820952    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtxgz\" (UniqueName: \"kubernetes.io/projected/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-kube-api-access-qtxgz\") pod \"maas-controller-c4df4974f-bgs4g\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") " pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:15.882897 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:15.882873    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:16.164379 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:16.164357    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4df4974f-bgs4g"]
Sep 09 20:48:16.166468 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:48:16.166446    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c4ce6f_7e94_446e_b9a4_9ffe42555c77.slice/crio-0da872ad12b3cf5e6f61f447a7995a92d20353be8a57c4965bddc3702cd9d1ee WatchSource:0}: Error finding container 0da872ad12b3cf5e6f61f447a7995a92d20353be8a57c4965bddc3702cd9d1ee: Status 404 returned error can't find the container with id 0da872ad12b3cf5e6f61f447a7995a92d20353be8a57c4965bddc3702cd9d1ee
Sep 09 20:48:16.168159 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:16.168140    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:48:16.659416 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:16.659375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-bgs4g" event={"ID":"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77","Type":"ContainerStarted","Data":"0da872ad12b3cf5e6f61f447a7995a92d20353be8a57c4965bddc3702cd9d1ee"}
Sep 09 20:48:17.666548 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:17.666507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-bgs4g" event={"ID":"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77","Type":"ContainerStarted","Data":"80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677"}
Sep 09 20:48:17.666913 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:17.666605    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:17.716923 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:17.716871    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c4df4974f-bgs4g" podStartSLOduration=2.008952121 podStartE2EDuration="2.71685645s" totalImagesPullingTime="707.904329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:17.71642367 +0000 UTC m=+1901.943374430" watchObservedRunningTime="2026-09-09 20:48:17.71685645 +0000 UTC m=+1901.943807211"
Sep 09 20:48:28.674993 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:28.674954    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:40.197686 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.197645    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c4df4974f-bgs4g"]
Sep 09 20:48:40.198276 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.197962    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c4df4974f-bgs4g" podUID="e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" containerName="manager" containerID="cri-o://80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677" gracePeriod=30
Sep 09 20:48:40.549950 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.549907    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:40.632101 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.632073    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-metrics-certs\") pod \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") "
Sep 09 20:48:40.632274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.632147    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-webhook-cert\") pod \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") "
Sep 09 20:48:40.632274 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.632173    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtxgz\" (UniqueName: \"kubernetes.io/projected/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-kube-api-access-qtxgz\") pod \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\" (UID: \"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77\") "
Sep 09 20:48:40.634386 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.634354    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" (UID: "e9c4ce6f-7e94-446e-b9a4-9ffe42555c77"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:48:40.634503 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.634413    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" (UID: "e9c4ce6f-7e94-446e-b9a4-9ffe42555c77"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:48:40.634503 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.634428    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-kube-api-access-qtxgz" (OuterVolumeSpecName: "kube-api-access-qtxgz") pod "e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" (UID: "e9c4ce6f-7e94-446e-b9a4-9ffe42555c77"). InnerVolumeSpecName "kube-api-access-qtxgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:48:40.733107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.733028    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:48:40.733107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.733054    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-webhook-cert\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:48:40.733107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.733064    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtxgz\" (UniqueName: \"kubernetes.io/projected/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77-kube-api-access-qtxgz\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:48:40.797850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.797813    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" containerID="80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677" exitCode=0
Sep 09 20:48:40.797850 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.797853    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-bgs4g"
Sep 09 20:48:40.798098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.797900    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-bgs4g" event={"ID":"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77","Type":"ContainerDied","Data":"80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677"}
Sep 09 20:48:40.798098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.797974    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-bgs4g" event={"ID":"e9c4ce6f-7e94-446e-b9a4-9ffe42555c77","Type":"ContainerDied","Data":"0da872ad12b3cf5e6f61f447a7995a92d20353be8a57c4965bddc3702cd9d1ee"}
Sep 09 20:48:40.798098 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.797997    2570 scope.go:117] "RemoveContainer" containerID="80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677"
Sep 09 20:48:40.807467 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.807443    2570 scope.go:117] "RemoveContainer" containerID="80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677"
Sep 09 20:48:40.807728 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:48:40.807710    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677\": container with ID starting with 80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677 not found: ID does not exist" containerID="80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677"
Sep 09 20:48:40.807773 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.807736    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677"} err="failed to get container status \"80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677\": rpc error: code = NotFound desc = could not find container \"80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677\": container with ID starting with 80ed35124bfa868417b5ecca8388a6ceb79c3d261494c472c679f7151ba84677 not found: ID does not exist"
Sep 09 20:48:40.831679 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.831647    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c4df4974f-bgs4g"]
Sep 09 20:48:40.838515 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:40.838491    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c4df4974f-bgs4g"]
Sep 09 20:48:41.675911 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.675879    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c4df4974f-r7rxb"]
Sep 09 20:48:41.676347 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.676333    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" containerName="manager"
Sep 09 20:48:41.676392 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.676349    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" containerName="manager"
Sep 09 20:48:41.676428 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.676415    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" containerName="manager"
Sep 09 20:48:41.676428 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.676425    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="94faf2b1-d888-44cc-8f27-543e2f27e610" containerName="istio-proxy"
Sep 09 20:48:41.680907 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.680888    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.686070 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.686048    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nk8km\""
Sep 09 20:48:41.686191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.686053    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 20:48:41.686191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.686120    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 20:48:41.686191 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.686099    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 20:48:41.697499 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.697476    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4df4974f-r7rxb"]
Sep 09 20:48:41.741824 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.741790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8khqb\" (UniqueName: \"kubernetes.io/projected/c900c5a8-ab3f-407a-ae4e-32eb87742380-kube-api-access-8khqb\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.741967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.741851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c900c5a8-ab3f-407a-ae4e-32eb87742380-metrics-certs\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.741967 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.741911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c900c5a8-ab3f-407a-ae4e-32eb87742380-webhook-cert\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.842722 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.842695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c900c5a8-ab3f-407a-ae4e-32eb87742380-metrics-certs\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.842881 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.842744    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c900c5a8-ab3f-407a-ae4e-32eb87742380-webhook-cert\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.842881 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.842804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8khqb\" (UniqueName: \"kubernetes.io/projected/c900c5a8-ab3f-407a-ae4e-32eb87742380-kube-api-access-8khqb\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.845423 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.845403    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c900c5a8-ab3f-407a-ae4e-32eb87742380-webhook-cert\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.845562 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.845543    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c900c5a8-ab3f-407a-ae4e-32eb87742380-metrics-certs\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.862616 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.862596    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8khqb\" (UniqueName: \"kubernetes.io/projected/c900c5a8-ab3f-407a-ae4e-32eb87742380-kube-api-access-8khqb\") pod \"maas-controller-c4df4974f-r7rxb\" (UID: \"c900c5a8-ab3f-407a-ae4e-32eb87742380\") " pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:41.991875 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:41.991818    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:42.270638 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:42.270610    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c4df4974f-r7rxb"]
Sep 09 20:48:42.271743 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:48:42.271710    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc900c5a8_ab3f_407a_ae4e_32eb87742380.slice/crio-f24bc2eebab05a93029411d177ccdbfdc3c8d0ea794b4519cfe65a4cc3dd1ace WatchSource:0}: Error finding container f24bc2eebab05a93029411d177ccdbfdc3c8d0ea794b4519cfe65a4cc3dd1ace: Status 404 returned error can't find the container with id f24bc2eebab05a93029411d177ccdbfdc3c8d0ea794b4519cfe65a4cc3dd1ace
Sep 09 20:48:42.307073 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:42.307050    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9c4ce6f-7e94-446e-b9a4-9ffe42555c77" path="/var/lib/kubelet/pods/e9c4ce6f-7e94-446e-b9a4-9ffe42555c77/volumes"
Sep 09 20:48:42.811599 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:42.811569    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-r7rxb" event={"ID":"c900c5a8-ab3f-407a-ae4e-32eb87742380","Type":"ContainerStarted","Data":"f24bc2eebab05a93029411d177ccdbfdc3c8d0ea794b4519cfe65a4cc3dd1ace"}
Sep 09 20:48:43.819021 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:43.818975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c4df4974f-r7rxb" event={"ID":"c900c5a8-ab3f-407a-ae4e-32eb87742380","Type":"ContainerStarted","Data":"2597e0bac31743030b7ee1ac64f6982c7da30376e8e3255063b4b8849e5df6de"}
Sep 09 20:48:43.819418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:43.819136    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:48:43.848877 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:43.848829    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c4df4974f-r7rxb" podStartSLOduration=2.372677436 podStartE2EDuration="2.84881433s" totalImagesPullingTime="476.136894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:43.846922163 +0000 UTC m=+1928.073872927" watchObservedRunningTime="2026-09-09 20:48:43.84881433 +0000 UTC m=+1928.075765090"
Sep 09 20:48:54.826583 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:48:54.826546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c4df4974f-r7rxb"
Sep 09 20:53:16.639471 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.639433    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"]
Sep 09 20:53:16.644048 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.644025    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.656738 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.656713    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"]
Sep 09 20:53:16.791923 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.791893    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca18df54-189f-444e-b9d2-b7a86d58b594-openshift-service-ca\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.792107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.791955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knkpm\" (UniqueName: \"kubernetes.io/projected/ca18df54-189f-444e-b9d2-b7a86d58b594-kube-api-access-knkpm\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.792107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.792029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca18df54-189f-444e-b9d2-b7a86d58b594-metrics-certs\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.792107 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.792059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca18df54-189f-444e-b9d2-b7a86d58b594-maas-api-tls\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.893576 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.893488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca18df54-189f-444e-b9d2-b7a86d58b594-openshift-service-ca\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.893576 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.893523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knkpm\" (UniqueName: \"kubernetes.io/projected/ca18df54-189f-444e-b9d2-b7a86d58b594-kube-api-access-knkpm\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.893576 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.893569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca18df54-189f-444e-b9d2-b7a86d58b594-metrics-certs\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.893849 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.893591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca18df54-189f-444e-b9d2-b7a86d58b594-maas-api-tls\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.894253 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.894224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca18df54-189f-444e-b9d2-b7a86d58b594-openshift-service-ca\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.896272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.896247    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca18df54-189f-444e-b9d2-b7a86d58b594-metrics-certs\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.896393 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.896328    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca18df54-189f-444e-b9d2-b7a86d58b594-maas-api-tls\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.910568 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.910542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knkpm\" (UniqueName: \"kubernetes.io/projected/ca18df54-189f-444e-b9d2-b7a86d58b594-kube-api-access-knkpm\") pod \"maas-api-6bc9c6c88c-bwqvq\" (UID: \"ca18df54-189f-444e-b9d2-b7a86d58b594\") " pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:16.958715 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:16.958687    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:17.249386 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:17.249317    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"]
Sep 09 20:53:17.252893 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:53:17.252860    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca18df54_189f_444e_b9d2_b7a86d58b594.slice/crio-b83d5d2cb9207564267c873b4562aa8f0db7fa0b7bb3ffe2340928d405c7ce30 WatchSource:0}: Error finding container b83d5d2cb9207564267c873b4562aa8f0db7fa0b7bb3ffe2340928d405c7ce30: Status 404 returned error can't find the container with id b83d5d2cb9207564267c873b4562aa8f0db7fa0b7bb3ffe2340928d405c7ce30
Sep 09 20:53:17.254024 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:17.254009    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:53:18.234730 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:18.234698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq" event={"ID":"ca18df54-189f-444e-b9d2-b7a86d58b594","Type":"ContainerStarted","Data":"aebe052c73e7998eba5dbcff18a8c4de6366b464e38565110dd85ea7ecce33e1"}
Sep 09 20:53:18.235146 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:18.234754    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq" event={"ID":"ca18df54-189f-444e-b9d2-b7a86d58b594","Type":"ContainerStarted","Data":"b83d5d2cb9207564267c873b4562aa8f0db7fa0b7bb3ffe2340928d405c7ce30"}
Sep 09 20:53:18.235146 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:18.234831    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:18.258838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:18.258791    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq" podStartSLOduration=1.856380391 podStartE2EDuration="2.258778812s" totalImagesPullingTime="402.398421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:18.257705555 +0000 UTC m=+2202.484656317" watchObservedRunningTime="2026-09-09 20:53:18.258778812 +0000 UTC m=+2202.485729627"
Sep 09 20:53:24.244330 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:24.244301    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6bc9c6c88c-bwqvq"
Sep 09 20:53:24.348536 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:24.348500    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"]
Sep 09 20:53:24.349001 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:24.348953    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4" podUID="a86279ee-b392-4f39-8986-1df60360909c" containerName="maas-api" containerID="cri-o://a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f" gracePeriod=30
Sep 09 20:53:25.600566 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.600539    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:53:25.672848 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.672762    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbzss\" (UniqueName: \"kubernetes.io/projected/a86279ee-b392-4f39-8986-1df60360909c-kube-api-access-hbzss\") pod \"a86279ee-b392-4f39-8986-1df60360909c\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") "
Sep 09 20:53:25.673026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.672879    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls\") pod \"a86279ee-b392-4f39-8986-1df60360909c\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") "
Sep 09 20:53:25.673026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.672909    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86279ee-b392-4f39-8986-1df60360909c-openshift-service-ca\") pod \"a86279ee-b392-4f39-8986-1df60360909c\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") "
Sep 09 20:53:25.673026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.673000    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs\") pod \"a86279ee-b392-4f39-8986-1df60360909c\" (UID: \"a86279ee-b392-4f39-8986-1df60360909c\") "
Sep 09 20:53:25.673378 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.673349    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a86279ee-b392-4f39-8986-1df60360909c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a86279ee-b392-4f39-8986-1df60360909c" (UID: "a86279ee-b392-4f39-8986-1df60360909c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:53:25.675250 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.675217    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a86279ee-b392-4f39-8986-1df60360909c" (UID: "a86279ee-b392-4f39-8986-1df60360909c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:53:25.675372 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.675263    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a86279ee-b392-4f39-8986-1df60360909c" (UID: "a86279ee-b392-4f39-8986-1df60360909c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:53:25.675372 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.675326    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86279ee-b392-4f39-8986-1df60360909c-kube-api-access-hbzss" (OuterVolumeSpecName: "kube-api-access-hbzss") pod "a86279ee-b392-4f39-8986-1df60360909c" (UID: "a86279ee-b392-4f39-8986-1df60360909c"). InnerVolumeSpecName "kube-api-access-hbzss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:53:25.774719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.774676    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-maas-api-tls\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:53:25.774719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.774710    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a86279ee-b392-4f39-8986-1df60360909c-openshift-service-ca\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:53:25.774719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.774719    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a86279ee-b392-4f39-8986-1df60360909c-metrics-certs\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:53:25.774719 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:25.774727    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbzss\" (UniqueName: \"kubernetes.io/projected/a86279ee-b392-4f39-8986-1df60360909c-kube-api-access-hbzss\") on node \"ip-10-0-143-224.ec2.internal\" DevicePath \"\""
Sep 09 20:53:26.275565 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.275528    2570 generic.go:356] "Generic (PLEG): container finished" podID="a86279ee-b392-4f39-8986-1df60360909c" containerID="a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f" exitCode=0
Sep 09 20:53:26.275754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.275581    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"
Sep 09 20:53:26.275754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.275584    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4" event={"ID":"a86279ee-b392-4f39-8986-1df60360909c","Type":"ContainerDied","Data":"a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f"}
Sep 09 20:53:26.275754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.275707    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4" event={"ID":"a86279ee-b392-4f39-8986-1df60360909c","Type":"ContainerDied","Data":"12c3c1b269eebbda07b5d19d081b128b0a422c516c17eef1edb30acc0564c96a"}
Sep 09 20:53:26.275754 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.275740    2570 scope.go:117] "RemoveContainer" containerID="a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f"
Sep 09 20:53:26.285628 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.285608    2570 scope.go:117] "RemoveContainer" containerID="a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f"
Sep 09 20:53:26.285913 ip-10-0-143-224 kubenswrapper[2570]: E0909 20:53:26.285894    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f\": container with ID starting with a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f not found: ID does not exist" containerID="a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f"
Sep 09 20:53:26.286017 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.285920    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f"} err="failed to get container status \"a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f\": rpc error: code = NotFound desc = could not find container \"a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f\": container with ID starting with a59ac4ecce807f9c284d77d97bd3cb9dab588b8f80471fa7436623b672b7d62f not found: ID does not exist"
Sep 09 20:53:26.306193 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.306169    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"]
Sep 09 20:53:26.311087 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:26.311060    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c576cc74c-vr8b4"]
Sep 09 20:53:28.305987 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:28.305952    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86279ee-b392-4f39-8986-1df60360909c" path="/var/lib/kubelet/pods/a86279ee-b392-4f39-8986-1df60360909c/volumes"
Sep 09 20:53:44.164563 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:44.164535    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2dmsj_2017f025-fef8-406d-81e9-27483cac3cbc/manager/0.log"
Sep 09 20:53:44.301507 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:44.301476    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kb5xm_36bee04e-e724-4561-bc8b-32b7d61ea780/manager/0.log"
Sep 09 20:53:44.441385 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:44.441306    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c4df4974f-r7rxb_c900c5a8-ab3f-407a-ae4e-32eb87742380/manager/0.log"
Sep 09 20:53:44.589050 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:44.589020    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2g5cc_6b888170-86e1-428e-8f9c-09f0e74cf5de/server/0.log"
Sep 09 20:53:45.161890 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:45.161859    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf_7a4eb6f6-b155-4b68-ad9a-14d47b317b6b/copy-manifests/0.log"
Sep 09 20:53:45.175627 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:45.175607    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf_7a4eb6f6-b155-4b68-ad9a-14d47b317b6b/manager/0.log"
Sep 09 20:53:45.647917 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:45.647888    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6bc9c6c88c-bwqvq_ca18df54-189f-444e-b9d2-b7a86d58b594/maas-api/0.log"
Sep 09 20:53:46.000547 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:46.000466    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hjhgq_c299fedb-8dfb-4b7e-afa6-ef7cd7cdb32f/postgres/0.log"
Sep 09 20:53:47.082002 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:47.081969    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-xwkhl_979628ba-ea6e-4b9f-bb2a-f0032867137d/manager/0.log"
Sep 09 20:53:47.604311 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:47.604282    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-ntvjv_e2d0bbef-dbd6-42ee-813c-0982203cfde6/manager/0.log"
Sep 09 20:53:48.441486 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:48.441453    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/1.log"
Sep 09 20:53:49.141917 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:49.141887    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nsrqb_e13c477c-ab6a-4e23-8cba-728f7b951a35/main/0.log"
Sep 09 20:53:49.256017 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:49.255989    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-n95k8_899c3999-bd92-490f-845c-0fd816e97d02/main/0.log"
Sep 09 20:53:49.369776 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:53:49.369743    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-f7mqd_0ecc14e1-57b8-4a9b-849d-81d5e3015a8a/main/0.log"
Sep 09 20:54:00.530418 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:00.530323    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lgw5x_a6d2414e-c9b5-4aa6-a125-8b397fa50821/global-pull-secret-syncer/0.log"
Sep 09 20:54:00.909154 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:00.909112    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k6ltm_73ee5668-f149-473d-941e-7516cf2c4b4e/konnectivity-agent/0.log"
Sep 09 20:54:01.232356 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:01.232268    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-224.ec2.internal_200c6fd4f46529840321e03c7f401cfd/haproxy/0.log"
Sep 09 20:54:05.346615 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:05.346578    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-xwkhl_979628ba-ea6e-4b9f-bb2a-f0032867137d/manager/0.log"
Sep 09 20:54:05.686232 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:05.686199    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-ntvjv_e2d0bbef-dbd6-42ee-813c-0982203cfde6/manager/0.log"
Sep 09 20:54:07.035290 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.035205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/alertmanager/0.log"
Sep 09 20:54:07.070242 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.070210    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/config-reloader/0.log"
Sep 09 20:54:07.103859 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.103833    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/kube-rbac-proxy-web/0.log"
Sep 09 20:54:07.141311 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.141291    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/kube-rbac-proxy/0.log"
Sep 09 20:54:07.168225 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.168196    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/kube-rbac-proxy-metric/0.log"
Sep 09 20:54:07.196730 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.196703    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/prom-label-proxy/0.log"
Sep 09 20:54:07.224944 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.224894    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b2a939eb-cb64-467e-b96d-ec3c72d458ea/init-config-reloader/0.log"
Sep 09 20:54:07.312177 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.312102    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xwzv6_34520952-484e-4bf0-8d98-c129d47bf85a/kube-state-metrics/0.log"
Sep 09 20:54:07.370845 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.370819    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xwzv6_34520952-484e-4bf0-8d98-c129d47bf85a/kube-rbac-proxy-main/0.log"
Sep 09 20:54:07.461615 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.461582    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xwzv6_34520952-484e-4bf0-8d98-c129d47bf85a/kube-rbac-proxy-self/0.log"
Sep 09 20:54:07.547607 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.547570    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b5df9d7f8-n6dc8_27ae7b6a-7e49-4546-89a6-addb283660e3/metrics-server/0.log"
Sep 09 20:54:07.624204 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.624176    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-lf2vf_a38d07f7-f482-4f15-bce5-4b6dc43d6554/monitoring-plugin/0.log"
Sep 09 20:54:07.674245 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.674217    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qjjn_44064230-a2e2-426a-9d5d-6fc643aba0c0/node-exporter/0.log"
Sep 09 20:54:07.724060 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.724036    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qjjn_44064230-a2e2-426a-9d5d-6fc643aba0c0/kube-rbac-proxy/0.log"
Sep 09 20:54:07.770084 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:07.770055    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qjjn_44064230-a2e2-426a-9d5d-6fc643aba0c0/init-textfile/0.log"
Sep 09 20:54:08.012330 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.012303    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-cfxqr_05389ef5-0585-4d83-b5c0-2534efecc5fa/kube-rbac-proxy-main/0.log"
Sep 09 20:54:08.038774 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.038741    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-cfxqr_05389ef5-0585-4d83-b5c0-2534efecc5fa/kube-rbac-proxy-self/0.log"
Sep 09 20:54:08.067758 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.067733    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-cfxqr_05389ef5-0585-4d83-b5c0-2534efecc5fa/openshift-state-metrics/0.log"
Sep 09 20:54:08.128487 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.128449    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/prometheus/0.log"
Sep 09 20:54:08.154058 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.154024    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/config-reloader/0.log"
Sep 09 20:54:08.192243 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.192175    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/thanos-sidecar/0.log"
Sep 09 20:54:08.220178 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.220150    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/kube-rbac-proxy-web/0.log"
Sep 09 20:54:08.255051 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.255021    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/kube-rbac-proxy/0.log"
Sep 09 20:54:08.283097 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.283056    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/kube-rbac-proxy-thanos/0.log"
Sep 09 20:54:08.307879 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.307843    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac69531f-5cbb-4e98-bed9-11d944053466/init-config-reloader/0.log"
Sep 09 20:54:08.362999 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.362973    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-shhgj_0a0a97b1-8699-49c5-83b4-8a19c2141667/prometheus-operator/0.log"
Sep 09 20:54:08.391065 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.391041    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-shhgj_0a0a97b1-8699-49c5-83b4-8a19c2141667/kube-rbac-proxy/0.log"
Sep 09 20:54:08.438572 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.438538    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-dtlbf_0f0ec81a-535d-4ec5-9992-5441e3e8efda/prometheus-operator-admission-webhook/0.log"
Sep 09 20:54:08.477171 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.477097    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b94cbdcf9-c4t4j_80114dbb-e308-4cab-9c37-b7b6f0a1739a/telemeter-client/0.log"
Sep 09 20:54:08.506901 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.506876    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b94cbdcf9-c4t4j_80114dbb-e308-4cab-9c37-b7b6f0a1739a/reload/0.log"
Sep 09 20:54:08.552914 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.552880    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b94cbdcf9-c4t4j_80114dbb-e308-4cab-9c37-b7b6f0a1739a/kube-rbac-proxy/0.log"
Sep 09 20:54:08.593799 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.593769    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744d9bc747-q66r8_e51332b8-4013-4a38-920f-bd3682bb1e39/thanos-query/0.log"
Sep 09 20:54:08.620697 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.620664    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744d9bc747-q66r8_e51332b8-4013-4a38-920f-bd3682bb1e39/kube-rbac-proxy-web/0.log"
Sep 09 20:54:08.647142 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.647109    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744d9bc747-q66r8_e51332b8-4013-4a38-920f-bd3682bb1e39/kube-rbac-proxy/0.log"
Sep 09 20:54:08.680086 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.680057    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744d9bc747-q66r8_e51332b8-4013-4a38-920f-bd3682bb1e39/prom-label-proxy/0.log"
Sep 09 20:54:08.710073 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.710046    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744d9bc747-q66r8_e51332b8-4013-4a38-920f-bd3682bb1e39/kube-rbac-proxy-rules/0.log"
Sep 09 20:54:08.739060 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:08.738971    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744d9bc747-q66r8_e51332b8-4013-4a38-920f-bd3682bb1e39/kube-rbac-proxy-metrics/0.log"
Sep 09 20:54:10.068353 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.068297    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"]
Sep 09 20:54:10.069110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.069072    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86279ee-b392-4f39-8986-1df60360909c" containerName="maas-api"
Sep 09 20:54:10.069110 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.069101    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86279ee-b392-4f39-8986-1df60360909c" containerName="maas-api"
Sep 09 20:54:10.069299 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.069205    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86279ee-b392-4f39-8986-1df60360909c" containerName="maas-api"
Sep 09 20:54:10.073653 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.073626    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.076537 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.076513    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mp9c5\"/\"openshift-service-ca.crt\""
Sep 09 20:54:10.077661 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.077637    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mp9c5\"/\"default-dockercfg-j5dnh\""
Sep 09 20:54:10.077768 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.077637    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mp9c5\"/\"kube-root-ca.crt\""
Sep 09 20:54:10.082279 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.082256    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"]
Sep 09 20:54:10.185659 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.185626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-podres\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.185838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.185672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcl4r\" (UniqueName: \"kubernetes.io/projected/58d094f5-5127-4ab6-afe4-d24ff8123564-kube-api-access-gcl4r\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.185838 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.185745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-sys\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.185914 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.185858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-proc\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.185914 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.185889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-lib-modules\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287413 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcl4r\" (UniqueName: \"kubernetes.io/projected/58d094f5-5127-4ab6-afe4-d24ff8123564-kube-api-access-gcl4r\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-sys\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287486    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-proc\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287503    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-lib-modules\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-proc\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287616    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-podres\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287642 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287629    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-lib-modules\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287901 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-podres\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.287901 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.287589    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d094f5-5127-4ab6-afe4-d24ff8123564-sys\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.296602 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.296570    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcl4r\" (UniqueName: \"kubernetes.io/projected/58d094f5-5127-4ab6-afe4-d24ff8123564-kube-api-access-gcl4r\") pod \"perf-node-gather-daemonset-jbhhb\" (UID: \"58d094f5-5127-4ab6-afe4-d24ff8123564\") " pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.385008 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.384969    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:10.668167 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:10.668144    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"]
Sep 09 20:54:10.670534 ip-10-0-143-224 kubenswrapper[2570]: W0909 20:54:10.670501    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58d094f5_5127_4ab6_afe4_d24ff8123564.slice/crio-ff0269e5c3120874cbe1f751469fc7b4766b80a8482796d449f2e6316f55fccd WatchSource:0}: Error finding container ff0269e5c3120874cbe1f751469fc7b4766b80a8482796d449f2e6316f55fccd: Status 404 returned error can't find the container with id ff0269e5c3120874cbe1f751469fc7b4766b80a8482796d449f2e6316f55fccd
Sep 09 20:54:11.351250 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:11.351213    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-zlmfh_c4c8015b-5dc4-4e7f-b9f5-fe9bcafaeb5d/download-server/0.log"
Sep 09 20:54:11.510576 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:11.510535    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb" event={"ID":"58d094f5-5127-4ab6-afe4-d24ff8123564","Type":"ContainerStarted","Data":"970e493c1fbf365f37c214b2ab2b57a6722bc12acd133f0b875956d48456ca1b"}
Sep 09 20:54:11.510762 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:11.510610    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:11.510762 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:11.510638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb" event={"ID":"58d094f5-5127-4ab6-afe4-d24ff8123564","Type":"ContainerStarted","Data":"ff0269e5c3120874cbe1f751469fc7b4766b80a8482796d449f2e6316f55fccd"}
Sep 09 20:54:11.535457 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:11.535401    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb" podStartSLOduration=1.5353859330000001 podStartE2EDuration="1.535385933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:54:11.533614997 +0000 UTC m=+2255.760565762" watchObservedRunningTime="2026-09-09 20:54:11.535385933 +0000 UTC m=+2255.762336693"
Sep 09 20:54:13.254412 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:13.254382    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9z5n_35d90237-edc3-494c-8baf-a91fca26ec9a/dns/0.log"
Sep 09 20:54:13.277168 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:13.277122    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9z5n_35d90237-edc3-494c-8baf-a91fca26ec9a/kube-rbac-proxy/0.log"
Sep 09 20:54:13.377161 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:13.377132    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8wgsl_b7b6de42-915f-4699-85a2-23b6c7e6144e/dns-node-resolver/0.log"
Sep 09 20:54:14.062340 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:14.062310    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vb4mq_55da36f3-5875-4fe6-94ef-5cfd122f0226/node-ca/0.log"
Sep 09 20:54:15.729145 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:15.729115    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/0.log"
Sep 09 20:54:15.736585 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:15.736550    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/1.log"
Sep 09 20:54:16.842264 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:16.842240    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbhxq_57fcc175-91c6-4500-b8e3-4ee251fdc142/serve-healthcheck-canary/0.log"
Sep 09 20:54:17.526269 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:17.526236    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mp9c5/perf-node-gather-daemonset-jbhhb"
Sep 09 20:54:17.597026 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:17.596993    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlpw9_280fd9e3-6edf-4d5c-a020-125722b9520b/kube-rbac-proxy/0.log"
Sep 09 20:54:17.625610 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:17.625587    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlpw9_280fd9e3-6edf-4d5c-a020-125722b9520b/exporter/0.log"
Sep 09 20:54:17.664764 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:17.664729    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlpw9_280fd9e3-6edf-4d5c-a020-125722b9520b/extractor/0.log"
Sep 09 20:54:20.344989 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:20.344959    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2dmsj_2017f025-fef8-406d-81e9-27483cac3cbc/manager/0.log"
Sep 09 20:54:20.515776 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:20.515683    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kb5xm_36bee04e-e724-4561-bc8b-32b7d61ea780/manager/0.log"
Sep 09 20:54:20.567912 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:20.567873    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c4df4974f-r7rxb_c900c5a8-ab3f-407a-ae4e-32eb87742380/manager/0.log"
Sep 09 20:54:20.593978 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:20.593954    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2g5cc_6b888170-86e1-428e-8f9c-09f0e74cf5de/server/0.log"
Sep 09 20:54:21.044244 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:21.044213    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf_7a4eb6f6-b155-4b68-ad9a-14d47b317b6b/manager/0.log"
Sep 09 20:54:21.088272 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:21.088250    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbdbfdc7-qcpgf_7a4eb6f6-b155-4b68-ad9a-14d47b317b6b/copy-manifests/0.log"
Sep 09 20:54:21.356445 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:21.356425    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/0.log"
Sep 09 20:54:21.364144 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:21.364126    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/1.log"
Sep 09 20:54:22.480351 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:22.480325    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bc9df88-677vw_5f344e90-9d9c-4f52-81b7-d366b86f9c4e/manager/0.log"
Sep 09 20:54:23.490240 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:23.490204    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/0.log"
Sep 09 20:54:23.501330 ip-10-0-143-224 kubenswrapper[2570]: I0909 20:54:23.501296    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fstnx_c8882585-c8d8-4858-8926-8f137546bf8e/istio-proxy/1.log"