Aug 04 18:08:41.022180 ip-10-0-137-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 18:08:41.022194 ip-10-0-137-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 18:08:41.022204 ip-10-0-137-226 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 18:08:41.022558 ip-10-0-137-226 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 18:08:51.152099 ip-10-0-137-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 18:08:51.152115 ip-10-0-137-226 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b63bc57679784b2e947e110876f5a5c3 --
Aug 04 18:10:44.160959 ip-10-0-137-226 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 18:10:44.576374 ip-10-0-137-226 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:10:44.576374 ip-10-0-137-226 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 18:10:44.576374 ip-10-0-137-226 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:10:44.576374 ip-10-0-137-226 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 18:10:44.576374 ip-10-0-137-226 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 18:10:44.577207 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.577081    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583682    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583702    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583707    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583711    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583713    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583716    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583719    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:10:44.583709 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583721    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583724    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583727    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583730    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583732    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583735    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583737    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583740    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583742    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583745    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583748    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583751    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583753    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583756    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583759    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583762    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583765    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583769    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583771    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583774    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:10:44.583994 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583776    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583779    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583782    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583784    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583787    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583790    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583792    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583794    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583797    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583799    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583801    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583804    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583806    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583809    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583813    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583816    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583818    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583821    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583823    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:10:44.584474 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583826    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583829    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583831    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583834    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583836    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583839    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583841    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583844    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583846    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583849    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583851    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583854    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583856    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583858    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583861    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583863    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583866    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583869    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583872    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583874    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:10:44.584950 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583876    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583879    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583881    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583883    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583886    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583888    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583891    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583896    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583900    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583903    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583906    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583908    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583912    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583914    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583917    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583919    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583921    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583924    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583927    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583929    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:10:44.585476 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583932    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583935    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583937    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583940    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583942    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583945    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583949    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583953    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583955    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583958    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583961    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583964    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.583968    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584703    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584711    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584714    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584718    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584720    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:10:44.585978 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584723    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584727    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584730    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584733    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584736    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584738    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584741    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584743    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584746    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584748    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584751    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584753    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584756    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584759    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584761    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584764    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584767    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584769    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584771    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:10:44.586421 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584774    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584776    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584779    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584781    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584784    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584787    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584790    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584792    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584795    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584799    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584803    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584806    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584809    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584812    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584815    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584818    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584821    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584823    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584826    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:10:44.586924 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584828    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584831    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584834    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584838    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584840    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584843    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584846    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584849    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584851    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584854    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584856    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584859    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584862    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584864    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584867    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584869    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584872    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584874    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584879    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:10:44.587382 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584882    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584885    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584888    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584890    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584893    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584895    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584897    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584900    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584903    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584906    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584910    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584912    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584915    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584917    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584919    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584922    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584924    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584927    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584929    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584932    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:10:44.587863 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584934    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584937    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584940    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584943    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584945    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584948    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584950    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584953    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584955    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584958    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584960    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584963    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584966    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584969    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584971    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584974    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.584976    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585375    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585380    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:10:44.588357 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585383    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585387    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585389    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585392    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585395    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585398    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585400    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585403    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585405    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585408    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585411    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585413    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585415    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585418    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585421    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585424    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585427    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585430    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585432    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585434    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:10:44.588844 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585437    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585439    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585441    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585444    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585446    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585448    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585451    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585453    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585456    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585459    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585461    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585464    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585467    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585469    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585471    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585474    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585476    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585479    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585482    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585484    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:10:44.589338 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585487    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585489    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585492    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585494    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585497    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585499    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585503    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585507    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585512    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585515    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585517    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585520    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585523    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585525    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585528    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585530    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585532    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585535    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585537    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:10:44.589960 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585540    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585545    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585549    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585553    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585556    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585559    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585562    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585564    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585567    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585569    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585572    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585574    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585576    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585579    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585581    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585583    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585586    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585588    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585591    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:10:44.590429 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585593    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585595    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585604    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585607    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585609    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585611    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585614    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585617    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585619    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585622    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585624    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585640    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585643    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585646    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585648    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585651    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585653    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585656    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.585658    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585733    2579 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585741    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 18:10:44.590914 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585748    2579 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585752    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585757    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585760    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585764    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585768    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585772    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585775    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585778    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585781    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585784    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585787    2579 flags.go:64] FLAG: --cgroup-root=""
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585790    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585797    2579 flags.go:64] FLAG: --client-ca-file=""
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585801    2579 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585804    2579 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585808    2579 flags.go:64] FLAG: --cluster-domain=""
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585811    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585814    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585817    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585820    2579 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585824    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585827    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 18:10:44.591418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585830    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585833    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585836    2579 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585839    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585842    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585845    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585847    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585852    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585855    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585858    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585860    2579 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585864    2579 flags.go:64] FLAG: --enable-server="true"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585866    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585871    2579 flags.go:64] FLAG: --event-burst="100"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585874    2579 flags.go:64] FLAG: --event-qps="50"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585877    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585880    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585883    2579 flags.go:64] FLAG: --eviction-hard=""
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585887    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585890    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585893    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585895    2579 flags.go:64] FLAG: --eviction-soft=""
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585900    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585903    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585907    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 18:10:44.591995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585910    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585912    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585915    2579 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585918    2579 flags.go:64] FLAG: --feature-gates=""
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585922    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585924    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585928    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585931    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585934    2579 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585937    2579 flags.go:64] FLAG: --help="false"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585940    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585943    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585946    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585949    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585952    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585955    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585958    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585961    2579 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585964    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585967    2579 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585970    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585972    2579 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585976    2579 flags.go:64] FLAG: --kube-reserved=""
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585979    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 18:10:44.592617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585981    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585984    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585987    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585990    2579 flags.go:64] FLAG: --lock-file=""
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585993    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.585997    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586000    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586006    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586009    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586012    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586015    2579 flags.go:64] FLAG: --logging-format="text"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586018    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586021    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586024    2579 flags.go:64] FLAG: --manifest-url=""
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586027    2579 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586031    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586034    2579 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586038    2579 flags.go:64] FLAG: --max-pods="110"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586041    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586043    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586046    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586049    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586052    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586055    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586058    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 18:10:44.593268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586065    2579 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586068    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586071    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586074    2579 flags.go:64] FLAG: --pod-cidr=""
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586077    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586083    2579 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586085    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586089    2579 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586092    2579 flags.go:64] FLAG: --port="10250"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586095    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586098    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0120b7f8a6d197f27"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586101    2579 flags.go:64] FLAG: --qos-reserved=""
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586104    2579 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586108    2579 flags.go:64] FLAG: --register-node="true"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586111    2579 flags.go:64] FLAG: --register-with-taints=""
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586115    2579 flags.go:64] FLAG: --registry-burst="10"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586118    2579 flags.go:64] FLAG: --registry-qps="5"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586121    2579 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586124    2579 flags.go:64] FLAG: --reserved-memory=""
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586127    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586130    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586133    2579 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586136    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586139    2579 flags.go:64] FLAG: --runonce="false"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586142    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 18:10:44.593933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586145    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586148    2579 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586151    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586154    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586157    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586160    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586163    2579 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586166    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586169    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586172    2579 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586175    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586178    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586181    2579 flags.go:64] FLAG: --system-cgroups=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586184    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586189    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586192    2579 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586194    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586198    2579 flags.go:64] FLAG: --tls-min-version=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586201    2579 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586204    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586208    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586211    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586214    2579 flags.go:64] FLAG: --v="2"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586218    2579 flags.go:64] FLAG: --version="false"
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586222    2579 flags.go:64] FLAG: --vmodule=""
Aug 04 18:10:44.594541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586226    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.586230    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586357    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586362    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586365    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586368    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586371    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586374    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586376    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586379    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586381    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586384    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586387    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586389    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586392    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586396    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586399    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586402    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586405    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586407    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:10:44.595167 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586409    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586412    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586414    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586417    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586419    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586422    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586424    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586429    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586431    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586434    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586437    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586439    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586442    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586444    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586447    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586449    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586452    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586454    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586457    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586459    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:10:44.595672 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586462    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586464    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586467    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586469    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586471    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586474    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586476    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586479    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586483    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586485    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586487    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586490    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586494    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586497    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586500    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586503    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586505    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586508    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586510    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:10:44.596153 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586514    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586516    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586519    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586521    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586524    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586526    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586530    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586532    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586535    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586537    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586540    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586542    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586544    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586547    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586549    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586552    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586554    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586558    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586560    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:10:44.596615 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586563    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586566    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586569    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586572    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586574    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586577    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586579    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586581    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586584    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586586    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586589    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586591    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586594    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586598    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586600    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586603    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586605    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586608    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586610    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586613    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:10:44.597072 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586616    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586619    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.586621    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.587139    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.594386    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.594404    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.595116    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.595124    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595203    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595209    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595212    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595215    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595218    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595221    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595225    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:10:44.597578 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595228    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595231    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595234    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595237    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595240    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595242    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595245    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595247    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595250    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595252    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595255    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595258    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595260    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595263    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595266    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595268    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595271    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595273    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595275    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595278    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:10:44.597962 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595280    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595283    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595286    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595289    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595292    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595295    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595300    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595304    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595308    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595311    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595314    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595317    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595320    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595324    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595328    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595331    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595334    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595336    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:10:44.598456 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595339    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595341    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595344    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595346    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595349    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595352    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595355    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595357    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595360    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595362    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595365    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595367    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595370    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595373    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595376    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595378    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595381    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595384    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595387    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595389    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:10:44.598999 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595392    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595394    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595397    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595399    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595402    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595405    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595407    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595409    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595412    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595414    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595416    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595419    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595421    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595423    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595426    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595428    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595430    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595433    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595435    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595438    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:10:44.599510 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595440    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595442    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595445    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595447    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595450    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595452    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595455    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595457    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595460    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595462    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595466    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595468    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595471    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595473    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.595478    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:10:44.600046 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595594    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595600    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595603    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595606    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595609    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595612    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595615    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595617    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595620    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595623    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595639    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595642    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595644    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595648    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595652    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595656    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595659    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595661    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595664    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595667    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 18:10:44.600410 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595670    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595673    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595676    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595678    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595681    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595683    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595686    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595688    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595691    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595694    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595696    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595699    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595701    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595704    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595706    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595709    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595711    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595713    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595716    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595718    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 18:10:44.600904 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595721    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595723    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595726    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595728    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595731    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595733    2579 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595736    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595739    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595741    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595744    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595748    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595751    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595754    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595756    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595759    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595761    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595764    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595766    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595768    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595771    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 18:10:44.601390 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595774    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595777    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595779    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595781    2579 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595784    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595787    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595790    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595793    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595796    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595798    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595801    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595806    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595809    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595811    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595814    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595816    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595819    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595821    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595823    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 18:10:44.601881 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595826    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595828    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595831    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595833    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595835    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595838    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595840    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595843    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595845    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595848    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595850    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595853    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595855    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595857    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595860    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595863    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595865    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595868    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595870    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 18:10:44.602365 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:44.595873    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.595878    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.596031    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.598161    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.599846    2579 server.go:1019] "Starting client certificate rotation"
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.599956    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.599991    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 18:10:44.602946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.602067    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:10:44.603254 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.603232    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 18:10:44.613215 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.613195    2579 log.go:25] "Validated CRI v1 runtime API"
Aug 04 18:10:44.615316 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.615296    2579 log.go:25] "Validated CRI v1 image API"
Aug 04 18:10:44.616179 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.616160    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 18:10:44.621826 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.621677    2579 fs.go:135] Filesystem UUIDs: map[0709fcaf-f18f-412f-85c3-2b06ea02df3c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bcd50075-a7f8-4283-bab6-d18291d41964:/dev/nvme0n1p4]
Aug 04 18:10:44.621826 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.621707    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 18:10:44.627858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.627730    2579 manager.go:216] Machine: {Timestamp:2026-08-04 18:10:44.626364941 +0000 UTC m=+0.341557921 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099211 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf1930bda188f125359647b6b68e7 SystemUUID:ec2bf193-0bda-188f-1253-59647b6b68e7 BootID:b63bc576-7978-4b2e-947e-110876f5a5c3 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:71:3b:ef:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:71:3b:ef:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:3b:fc:27:79:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 18:10:44.627858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.627848    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 18:10:44.627982 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.627941    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 18:10:44.628617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.628599    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:10:44.631219 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.631185    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 18:10:44.631370 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.631223    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 18:10:44.632678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.632667    2579 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 18:10:44.632721 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.632681    2579 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 18:10:44.632721 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.632688    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:10:44.633302 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.633290    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 18:10:44.634099 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.634088    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 18:10:44.637836 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.637820    2579 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:10:44.637972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.637962    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 18:10:44.638003 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.637995    2579 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 18:10:44.638039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.638005    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 18:10:44.638039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.638015    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 18:10:44.638039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.638025    2579 kubelet.go:398] "Adding apiserver pod source"
Aug 04 18:10:44.638039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.638035    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 18:10:44.638469 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.638447    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:10:44.638542 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.638476    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 18:10:44.640754 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.640733    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 18:10:44.642590 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.642562    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 18:10:44.642713 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.642615    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 18:10:44.643877 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643856    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 18:10:44.643877 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643882    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643901    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643910    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643924    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643933    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643947    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643955    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643967    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643976    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.643988    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 18:10:44.644009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.644001    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 18:10:44.645422 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.645401    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 18:10:44.645422 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.645425    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 18:10:44.647651 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.647615    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 18:10:44.647961 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.647939    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 18:10:44.648011 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.647942    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 18:10:44.649253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.649240    2579 server.go:1268] "Started kubelet"
Aug 04 18:10:44.649332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.649309    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 18:10:44.649566 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.649382    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 18:10:44.649566 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.649471    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 18:10:44.650705 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.650689    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 18:10:44.654127 ip-10-0-137-226 systemd[1]: Started Kubernetes Kubelet.
Aug 04 18:10:44.654334 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.654321    2579 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 18:10:44.654984 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.654969    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 18:10:44.658381 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.658364    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 18:10:44.658459 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.658363    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 18:10:44.658509 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.658491    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:44.658999 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.658963    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 18:10:44.659074 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659022    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 18:10:44.659162 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659145    2579 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 18:10:44.659162 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659159    2579 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 18:10:44.659322 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659227    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 18:10:44.659483 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659432    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 18:10:44.659483 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659485    2579 factory.go:55] Registering systemd factory
Aug 04 18:10:44.659587 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659493    2579 factory.go:223] Registration of the systemd container factory successfully
Aug 04 18:10:44.659748 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659735    2579 factory.go:153] Registering CRI-O factory
Aug 04 18:10:44.659798 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659751    2579 factory.go:223] Registration of the crio container factory successfully
Aug 04 18:10:44.659798 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659775    2579 factory.go:103] Registering Raw factory
Aug 04 18:10:44.659798 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.659787    2579 manager.go:1196] Started watching for new ooms in manager
Aug 04 18:10:44.660183 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.660172    2579 manager.go:349] Starting recovery of all containers
Aug 04 18:10:44.662096 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.662077    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9zz7"
Aug 04 18:10:44.663682 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.663652    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 18:10:44.663828 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.663786    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 18:10:44.664822 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.663707    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-226.ec2.internal.18c8ac9d7c646419  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-226.ec2.internal,UID:ip-10-0-137-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-226.ec2.internal,},FirstTimestamp:2026-08-04 18:10:44.649198617 +0000 UTC m=+0.364391597,LastTimestamp:2026-08-04 18:10:44.649198617 +0000 UTC m=+0.364391597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-226.ec2.internal,}"
Aug 04 18:10:44.668043 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.668008    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 18:10:44.671143 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.671099    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9zz7"
Aug 04 18:10:44.671719 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.671700    2579 manager.go:354] Recovery completed
Aug 04 18:10:44.678552 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.678539    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.681524 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.681509    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.681589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.681538    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.681589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.681554    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.682078 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682064    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 18:10:44.682146 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682080    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 18:10:44.682146 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682099    2579 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 18:10:44.682146 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682120    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.682870 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682854    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.682920 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682881    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.682920 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.682894    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.683307 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.683295    2579 policy_none.go:49] "None policy: Start"
Aug 04 18:10:44.683341 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.683311    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 18:10:44.683341 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.683323    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 18:10:44.683784 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.683712    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-226.ec2.internal.18c8ac9d7e51a6d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-226.ec2.internal,UID:ip-10-0-137-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-226.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-226.ec2.internal,},FirstTimestamp:2026-08-04 18:10:44.681524945 +0000 UTC m=+0.396717924,LastTimestamp:2026-08-04 18:10:44.681524945 +0000 UTC m=+0.396717924,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-226.ec2.internal,}"
Aug 04 18:10:44.684324 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.684313    2579 policy_none.go:47] "Start"
Aug 04 18:10:44.706453 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706267    2579 manager.go:337] "Starting Device Plugin manager"
Aug 04 18:10:44.706554 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.706476    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 18:10:44.706554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706488    2579 server.go:87] "Starting device plugin registration server"
Aug 04 18:10:44.706721 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706709    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 18:10:44.706793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706722    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 18:10:44.707055 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706888    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 18:10:44.707055 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706976    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 18:10:44.707055 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.706985    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 18:10:44.707454 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.707431    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 18:10:44.707545 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.707491    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:44.765443 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.765416    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 18:10:44.766022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.765460    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 18:10:44.766022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.765489    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 18:10:44.766022 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.765525    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 18:10:44.768000 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.767976    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:10:44.807338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.807289    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.808335 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.808319    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.808440 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.808356    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.808440 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.808368    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.808440 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.808392    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.817645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.817616    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.817716 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.817659    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-226.ec2.internal\": node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:44.836700 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.836611    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:44.866491 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.866461    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"]
Aug 04 18:10:44.866567 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.866531    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.868196 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.868180    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.868283 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.868208    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.868283 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.868217    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.869364 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.869352    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.869472 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.869456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.869524 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.869491    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.870034 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.870017    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.870147 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.870046    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.870147 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.870062    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.870147 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.870131    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.870297 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.870163    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.870297 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.870178    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.871104 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.871089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.871162 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.871115    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 18:10:44.871840 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.871821    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 18:10:44.871840 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.871849    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 18:10:44.871971 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.871863    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeHasSufficientPID"
Aug 04 18:10:44.891345 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.891321    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-226.ec2.internal\" not found" node="ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.895410 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.895390    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-226.ec2.internal\" not found" node="ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.937114 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:44.937076    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:44.960679 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.960646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1acc9acdb627038ced602e1bd940b3b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"f1acc9acdb627038ced602e1bd940b3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.960679 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.960679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1acc9acdb627038ced602e1bd940b3b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"f1acc9acdb627038ced602e1bd940b3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:44.960856 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:44.960703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd8bc490af8a6a5247a729399b554aa6-config\") pod \"kube-apiserver-proxy-ip-10-0-137-226.ec2.internal\" (UID: \"dd8bc490af8a6a5247a729399b554aa6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.037219 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:45.037185    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:45.061598 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.061566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1acc9acdb627038ced602e1bd940b3b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"f1acc9acdb627038ced602e1bd940b3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.061740 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.061605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1acc9acdb627038ced602e1bd940b3b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"f1acc9acdb627038ced602e1bd940b3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.061740 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.061653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd8bc490af8a6a5247a729399b554aa6-config\") pod \"kube-apiserver-proxy-ip-10-0-137-226.ec2.internal\" (UID: \"dd8bc490af8a6a5247a729399b554aa6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.061740 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.061677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1acc9acdb627038ced602e1bd940b3b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"f1acc9acdb627038ced602e1bd940b3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.061740 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.061699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dd8bc490af8a6a5247a729399b554aa6-config\") pod \"kube-apiserver-proxy-ip-10-0-137-226.ec2.internal\" (UID: \"dd8bc490af8a6a5247a729399b554aa6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.061740 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.061679    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1acc9acdb627038ced602e1bd940b3b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal\" (UID: \"f1acc9acdb627038ced602e1bd940b3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.137950 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:45.137875    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:45.194562 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.194531    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.197615 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.197594    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:45.238648 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:45.238607    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:45.339206 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:45.339154    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:45.439752 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:45.439675    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:45.472755 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:45.472731    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:10:46.930902 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:46.930871    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:46.989418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:46.989387    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 18:10:46.989911 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:46.989536    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:10:46.989911 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:46.989556    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 18:10:47.031006 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:47.030971    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:47.065646 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.065570    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 18:05:46 +0000 UTC" deadline="2028-03-06 12:44:50.579784821 +0000 UTC"
Aug 04 18:10:47.065646 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.065636    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13914h34m3.514153464s"
Aug 04 18:10:47.098839 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:47.098796    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1acc9acdb627038ced602e1bd940b3b.slice/crio-75f459834fa2ba18a2c74c69053a3dd244f22882bbe783cab00f0aa4a6840905 WatchSource:0}: Error finding container 75f459834fa2ba18a2c74c69053a3dd244f22882bbe783cab00f0aa4a6840905: Status 404 returned error can't find the container with id 75f459834fa2ba18a2c74c69053a3dd244f22882bbe783cab00f0aa4a6840905
Aug 04 18:10:47.099075 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:47.099058    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8bc490af8a6a5247a729399b554aa6.slice/crio-2797a799f77461f63a42faeb61f9717b1572da625c6cda1f30000f529480876b WatchSource:0}: Error finding container 2797a799f77461f63a42faeb61f9717b1572da625c6cda1f30000f529480876b: Status 404 returned error can't find the container with id 2797a799f77461f63a42faeb61f9717b1572da625c6cda1f30000f529480876b
Aug 04 18:10:47.103706 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.103684    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:10:47.111564 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.110312    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:10:47.131135 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:47.131082    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:47.158688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.158631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal" event={"ID":"dd8bc490af8a6a5247a729399b554aa6","Type":"ContainerStarted","Data":"2797a799f77461f63a42faeb61f9717b1572da625c6cda1f30000f529480876b"}
Aug 04 18:10:47.159749 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.159714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" event={"ID":"f1acc9acdb627038ced602e1bd940b3b","Type":"ContainerStarted","Data":"75f459834fa2ba18a2c74c69053a3dd244f22882bbe783cab00f0aa4a6840905"}
Aug 04 18:10:47.231960 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:47.231911    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:47.332498 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:47.332458    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:47.433052 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:47.432987    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:47.533942 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:47.533899    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-226.ec2.internal\" not found"
Aug 04 18:10:47.576148 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.576115    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:10:47.649820 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.649784    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:47.664993 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.664960    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:10:47.666204 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.666179    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal"
Aug 04 18:10:47.674042 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:47.674017    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 18:10:48.029313 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.029280    2579 apiserver.go:52] "Watching apiserver"
Aug 04 18:10:48.038483 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.038447    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 18:10:48.038940 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.038910    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-k9qds","kube-system/global-pull-secret-syncer-mwfzl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x","openshift-dns/node-resolver-jv9x4","openshift-multus/network-metrics-daemon-mz44f","openshift-network-diagnostics/network-check-target-28xt9","openshift-ovn-kubernetes/ovnkube-node-nzbpk","kube-system/konnectivity-agent-8zkpv","kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lgd4d","openshift-image-registry/node-ca-fm6ff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal","openshift-multus/multus-additional-cni-plugins-pppwl","openshift-multus/multus-w2c5q"]
Aug 04 18:10:48.040694 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.040665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.042013 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.041988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.043891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.043081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.043891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.043554    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 18:10:48.043891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.043565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.043891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.043803    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 18:10:48.043891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.043749    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 18:10:48.044883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.044862    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-988kc\""
Aug 04 18:10:48.045110 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.045093    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.045339 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.045320    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 18:10:48.045549 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.045535    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.045758 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.045708    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 18:10:48.046897 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046878    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:48.046980 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.046947    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:10:48.046980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.047094 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046231    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.047186 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046432    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 18:10:48.047236 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046348    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d2ztn\""
Aug 04 18:10:48.047281 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046470    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.047404 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.047498 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046389    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 18:10:48.047498 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.047467    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:10:48.047498 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v2qq4\""
Aug 04 18:10:48.047679 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046548    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 18:10:48.047679 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.046863    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.048112 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.047913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.050345 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.049295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.050345 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.049642    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 18:10:48.051749 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.050771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.051749 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.050868    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:10:48.051749 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.051096    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-52wr9\""
Aug 04 18:10:48.051749 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.051461    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j2n4w\""
Aug 04 18:10:48.051980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.051922    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.052034 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.052007    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.052624 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.052605    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 18:10:48.053144 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.053125    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.053230 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.053222    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p6v29\""
Aug 04 18:10:48.053485 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.053467    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 18:10:48.054114 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.053705    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.057172 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.056815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.058220 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.058204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.059715 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.059306    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.059715 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.059369    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.059715 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.059436    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.059985 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.059770    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-twwwp\""
Aug 04 18:10:48.060557 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.060540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w2w9k\""
Aug 04 18:10:48.060786 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.060555    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 18:10:48.060884 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.060828    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 18:10:48.060947 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.060645    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.061926    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zf8p8\""
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.061995    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-os-release\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-socket-dir-parent\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-cnibin\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmtm\" (UniqueName: \"kubernetes.io/projected/75d37ff4-3080-4a7a-8f78-cb53035d2849-kube-api-access-rzmtm\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-system-cni-dir\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-systemd\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-k8s-cni-cncf-io\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-hostroot\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062359    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-ovn\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-cni-netd\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-kubelet\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55f67dd0-e011-484d-8788-922e108e96cd-hosts-file\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.063397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8jmf\" (UniqueName: \"kubernetes.io/projected/78459739-509b-47f0-a534-4fc07c936c59-kube-api-access-f8jmf\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-node-log\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-os-release\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-sys-fs\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-run-netns\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2b08036-6367-42c9-a6fe-32683902f7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-cnibin\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-conf-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f59ae9e-8f44-41e0-88e5-1885731e226a-iptables-alerter-script\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b20b5f74-9033-4fd4-a1ba-e72aece50d92-kubelet-config\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-kubelet\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9r79\" (UniqueName: \"kubernetes.io/projected/b2b08036-6367-42c9-a6fe-32683902f7ac-kube-api-access-l9r79\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064251 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-daemon-config\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-multus-certs\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-socket-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55f67dd0-e011-484d-8788-922e108e96cd-tmp-dir\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-slash\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-etc-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-system-cni-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-cni-bin\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.062982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8h4w\" (UniqueName: \"kubernetes.io/projected/1f59ae9e-8f44-41e0-88e5-1885731e226a-kube-api-access-t8h4w\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-cni-binary-copy\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-device-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-registration-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f59ae9e-8f44-41e0-88e5-1885731e226a-host-slash\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-var-lib-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-cni-bin\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-ovnkube-config\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.064784 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-cni-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnsqs\" (UniqueName: \"kubernetes.io/projected/1dbd02fe-957e-421c-b520-9322d2bf7ed1-kube-api-access-qnsqs\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-netns\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-cni-multus\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b20b5f74-9033-4fd4-a1ba-e72aece50d92-dbus\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8pcx\" (UniqueName: \"kubernetes.io/projected/1b492484-4d29-4bea-ac04-4a2e71e28090-kube-api-access-t8pcx\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-env-overrides\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-etc-kubernetes\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-ovnkube-script-lib\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063748    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp2f8\" (UniqueName: \"kubernetes.io/projected/55f67dd0-e011-484d-8788-922e108e96cd-kube-api-access-dp2f8\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75d37ff4-3080-4a7a-8f78-cb53035d2849-cni-binary-copy\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.063977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.065446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.064029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-systemd-units\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.066052 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.064057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-log-socket\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.066983 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.066963    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 18:10:48.093039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.093011    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-82nln"
Aug 04 18:10:48.106165 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.106137    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-82nln"
Aug 04 18:10:48.150514 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.150475    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 18:10:48.164335 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-ovnkube-script-lib\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.164335 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-var-lib-kubelet\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce74f133-1e9c-42c7-a860-45c19a0186db-serviceca\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp2f8\" (UniqueName: \"kubernetes.io/projected/55f67dd0-e011-484d-8788-922e108e96cd-kube-api-access-dp2f8\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75d37ff4-3080-4a7a-8f78-cb53035d2849-cni-binary-copy\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.164501    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-lib-modules\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.164578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-systemd-units\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-systemd-units\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.164602    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:48.664563966 +0000 UTC m=+2.989667086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-etc-selinux\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-log-socket\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-os-release\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-socket-dir-parent\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.164987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-cnibin\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmtm\" (UniqueName: \"kubernetes.io/projected/75d37ff4-3080-4a7a-8f78-cb53035d2849-kube-api-access-rzmtm\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-system-cni-dir\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-modprobe-d\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-systemd\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75d37ff4-3080-4a7a-8f78-cb53035d2849-cni-binary-copy\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-socket-dir-parent\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-k8s-cni-cncf-io\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-log-socket\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-cnibin\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-os-release\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-system-cni-dir\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-hostroot\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-systemd\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-k8s-cni-cncf-io\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165363    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-hostroot\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.165448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-sys\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-ovn\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-cni-netd\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-kubelet\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-ovn\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-systemd\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-cni-netd\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165510    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-kubelet\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-tuned\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55f67dd0-e011-484d-8788-922e108e96cd-hosts-file\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8jmf\" (UniqueName: \"kubernetes.io/projected/78459739-509b-47f0-a534-4fc07c936c59-kube-api-access-f8jmf\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55f67dd0-e011-484d-8788-922e108e96cd-hosts-file\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-node-log\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-os-release\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-sys-fs\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-tmp\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165789    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-ovnkube-script-lib\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-run-netns\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2b08036-6367-42c9-a6fe-32683902f7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-node-log\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b492484-4d29-4bea-ac04-4a2e71e28090-os-release\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-cnibin\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-conf-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165915    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-sys-fs\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-cnibin\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-kubernetes\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-conf-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.166992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-run\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.165991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-run-netns\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce74f133-1e9c-42c7-a860-45c19a0186db-host\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f59ae9e-8f44-41e0-88e5-1885731e226a-iptables-alerter-script\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b20b5f74-9033-4fd4-a1ba-e72aece50d92-kubelet-config\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b20b5f74-9033-4fd4-a1ba-e72aece50d92-kubelet-config\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-kubelet\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9r79\" (UniqueName: \"kubernetes.io/projected/b2b08036-6367-42c9-a6fe-32683902f7ac-kube-api-access-l9r79\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-daemon-config\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166208    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166230    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-run-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-multus-certs\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-multus-certs\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-socket-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55f67dd0-e011-484d-8788-922e108e96cd-tmp-dir\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-slash\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-etc-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.167860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-system-cni-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-cni-bin\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8h4w\" (UniqueName: \"kubernetes.io/projected/1f59ae9e-8f44-41e0-88e5-1885731e226a-kube-api-access-t8h4w\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-cni-binary-copy\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-device-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-registration-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srxk\" (UniqueName: \"kubernetes.io/projected/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-kube-api-access-9srxk\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8x4r\" (UniqueName: \"kubernetes.io/projected/ce74f133-1e9c-42c7-a860-45c19a0186db-kube-api-access-z8x4r\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e1daf79-fc08-41eb-bb03-cccbc2294956-konnectivity-ca\") pod \"konnectivity-agent-8zkpv\" (UID: \"7e1daf79-fc08-41eb-bb03-cccbc2294956\") " pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f59ae9e-8f44-41e0-88e5-1885731e226a-host-slash\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f59ae9e-8f44-41e0-88e5-1885731e226a-iptables-alerter-script\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysconfig\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55f67dd0-e011-484d-8788-922e108e96cd-tmp-dir\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-var-lib-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-cni-bin\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-ovnkube-config\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-cni-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.168447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-socket-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-daemon-config\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnsqs\" (UniqueName: \"kubernetes.io/projected/1dbd02fe-957e-421c-b520-9322d2bf7ed1-kube-api-access-qnsqs\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-registration-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-cni-bin\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f59ae9e-8f44-41e0-88e5-1885731e226a-host-slash\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysctl-d\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1dbd02fe-957e-421c-b520-9322d2bf7ed1-device-dir\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysctl-conf\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e1daf79-fc08-41eb-bb03-cccbc2294956-agent-certs\") pod \"konnectivity-agent-8zkpv\" (UID: \"7e1daf79-fc08-41eb-bb03-cccbc2294956\") " pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-multus-cni-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-netns\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-cni-multus\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b20b5f74-9033-4fd4-a1ba-e72aece50d92-dbus\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8pcx\" (UniqueName: \"kubernetes.io/projected/1b492484-4d29-4bea-ac04-4a2e71e28090-kube-api-access-t8pcx\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-host\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.169062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-env-overrides\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-etc-kubernetes\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-slash\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-cni-bin\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-run-netns\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-ovnkube-config\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.167593    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.167658    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:48.667639405 +0000 UTC m=+2.992742509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-cni-binary-copy\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-etc-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-etc-kubernetes\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-system-cni-dir\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.167997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-var-lib-openvswitch\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.168039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/75d37ff4-3080-4a7a-8f78-cb53035d2849-host-var-lib-cni-multus\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.166215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2b08036-6367-42c9-a6fe-32683902f7ac-host-kubelet\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.168082    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b492484-4d29-4bea-ac04-4a2e71e28090-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.169655 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.168097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b20b5f74-9033-4fd4-a1ba-e72aece50d92-dbus\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.170331 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.168186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2b08036-6367-42c9-a6fe-32683902f7ac-env-overrides\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.175275 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.175249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2b08036-6367-42c9-a6fe-32683902f7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.176123 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.176096    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:10:48.176123 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.176126    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:10:48.176300 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.176140    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:48.176300 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.176201    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:10:48.676182998 +0000 UTC m=+3.001286116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:48.177714 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.177684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmtm\" (UniqueName: \"kubernetes.io/projected/75d37ff4-3080-4a7a-8f78-cb53035d2849-kube-api-access-rzmtm\") pod \"multus-w2c5q\" (UID: \"75d37ff4-3080-4a7a-8f78-cb53035d2849\") " pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.177843 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.177765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp2f8\" (UniqueName: \"kubernetes.io/projected/55f67dd0-e011-484d-8788-922e108e96cd-kube-api-access-dp2f8\") pod \"node-resolver-jv9x4\" (UID: \"55f67dd0-e011-484d-8788-922e108e96cd\") " pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.178523 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.178468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8jmf\" (UniqueName: \"kubernetes.io/projected/78459739-509b-47f0-a534-4fc07c936c59-kube-api-access-f8jmf\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.179443 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.179422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9r79\" (UniqueName: \"kubernetes.io/projected/b2b08036-6367-42c9-a6fe-32683902f7ac-kube-api-access-l9r79\") pod \"ovnkube-node-nzbpk\" (UID: \"b2b08036-6367-42c9-a6fe-32683902f7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.179991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.179966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8h4w\" (UniqueName: \"kubernetes.io/projected/1f59ae9e-8f44-41e0-88e5-1885731e226a-kube-api-access-t8h4w\") pod \"iptables-alerter-k9qds\" (UID: \"1f59ae9e-8f44-41e0-88e5-1885731e226a\") " pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.181271 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.181248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnsqs\" (UniqueName: \"kubernetes.io/projected/1dbd02fe-957e-421c-b520-9322d2bf7ed1-kube-api-access-qnsqs\") pod \"aws-ebs-csi-driver-node-rvg2x\" (UID: \"1dbd02fe-957e-421c-b520-9322d2bf7ed1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.181661 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.181640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8pcx\" (UniqueName: \"kubernetes.io/projected/1b492484-4d29-4bea-ac04-4a2e71e28090-kube-api-access-t8pcx\") pod \"multus-additional-cni-plugins-pppwl\" (UID: \"1b492484-4d29-4bea-ac04-4a2e71e28090\") " pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-host\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-var-lib-kubelet\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce74f133-1e9c-42c7-a860-45c19a0186db-serviceca\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-lib-modules\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-host\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-var-lib-kubelet\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-modprobe-d\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-sys\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-lib-modules\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-systemd\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-systemd\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268952    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-modprobe-d\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-tuned\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.268994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-sys\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-tmp\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-kubernetes\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-run\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.269546 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce74f133-1e9c-42c7-a860-45c19a0186db-host\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srxk\" (UniqueName: \"kubernetes.io/projected/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-kube-api-access-9srxk\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8x4r\" (UniqueName: \"kubernetes.io/projected/ce74f133-1e9c-42c7-a860-45c19a0186db-kube-api-access-z8x4r\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e1daf79-fc08-41eb-bb03-cccbc2294956-konnectivity-ca\") pod \"konnectivity-agent-8zkpv\" (UID: \"7e1daf79-fc08-41eb-bb03-cccbc2294956\") " pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce74f133-1e9c-42c7-a860-45c19a0186db-serviceca\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysconfig\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysctl-d\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269275    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce74f133-1e9c-42c7-a860-45c19a0186db-host\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-kubernetes\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysctl-conf\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e1daf79-fc08-41eb-bb03-cccbc2294956-agent-certs\") pod \"konnectivity-agent-8zkpv\" (UID: \"7e1daf79-fc08-41eb-bb03-cccbc2294956\") " pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysconfig\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-run\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysctl-conf\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-sysctl-d\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.270482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.269966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e1daf79-fc08-41eb-bb03-cccbc2294956-konnectivity-ca\") pod \"konnectivity-agent-8zkpv\" (UID: \"7e1daf79-fc08-41eb-bb03-cccbc2294956\") " pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.272085 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.272064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e1daf79-fc08-41eb-bb03-cccbc2294956-agent-certs\") pod \"konnectivity-agent-8zkpv\" (UID: \"7e1daf79-fc08-41eb-bb03-cccbc2294956\") " pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.272205 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.272112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-tmp\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.272864 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.272841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-etc-tuned\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.283748 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.283657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srxk\" (UniqueName: \"kubernetes.io/projected/835019f2-fc13-4c12-bc7c-ddfa5e81a69a-kube-api-access-9srxk\") pod \"tuned-lgd4d\" (UID: \"835019f2-fc13-4c12-bc7c-ddfa5e81a69a\") " pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.284131 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.284107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8x4r\" (UniqueName: \"kubernetes.io/projected/ce74f133-1e9c-42c7-a860-45c19a0186db-kube-api-access-z8x4r\") pod \"node-ca-fm6ff\" (UID: \"ce74f133-1e9c-42c7-a860-45c19a0186db\") " pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.357609 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.357569    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:10:48.366534 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.366502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pppwl"
Aug 04 18:10:48.373678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.373653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x"
Aug 04 18:10:48.380300 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.380278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jv9x4"
Aug 04 18:10:48.389110 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.389070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w2c5q"
Aug 04 18:10:48.396948 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.396927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k9qds"
Aug 04 18:10:48.403574 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.403543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgd4d"
Aug 04 18:10:48.411173 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.411150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fm6ff"
Aug 04 18:10:48.418895 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.418874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:10:48.439999 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.439963    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:10:48.640392 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.640321    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 18:10:48.673025 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.672985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:48.673025 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.673029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:48.673252 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.673152    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:48.673252 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.673154    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:48.673252 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.673219    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:49.673202664 +0000 UTC m=+3.998305775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:48.673252 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.673240    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:49.673229157 +0000 UTC m=+3.998332256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:48.773972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:48.773940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:48.774139 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.774077    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:10:48.774139 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.774092    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:10:48.774139 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.774101    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:48.774299 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:48.774158    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:10:49.774139458 +0000 UTC m=+4.099242559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:49.048144 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:49.048121    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce74f133_1e9c_42c7_a860_45c19a0186db.slice/crio-5b49f5bb240ac1d3d0bb9dae9b275a5206713ee65869adef6feeba91627b3ecd WatchSource:0}: Error finding container 5b49f5bb240ac1d3d0bb9dae9b275a5206713ee65869adef6feeba91627b3ecd: Status 404 returned error can't find the container with id 5b49f5bb240ac1d3d0bb9dae9b275a5206713ee65869adef6feeba91627b3ecd
Aug 04 18:10:49.052645 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:10:49.049453    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1daf79_fc08_41eb_bb03_cccbc2294956.slice/crio-fd24a9fb238a586b1c6920a4fa54c957c8c45b79baa9ee6869557a91f42d2144 WatchSource:0}: Error finding container fd24a9fb238a586b1c6920a4fa54c957c8c45b79baa9ee6869557a91f42d2144: Status 404 returned error can't find the container with id fd24a9fb238a586b1c6920a4fa54c957c8c45b79baa9ee6869557a91f42d2144
Aug 04 18:10:49.110069 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.107956    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 18:05:48 +0000 UTC" deadline="2028-04-24 12:02:21.269869656 +0000 UTC"
Aug 04 18:10:49.110069 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.108211    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15089h51m32.161665057s"
Aug 04 18:10:49.156238 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.156206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:49.156414 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.156340    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:10:49.165377 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.165350    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w2c5q" event={"ID":"75d37ff4-3080-4a7a-8f78-cb53035d2849","Type":"ContainerStarted","Data":"7c6415903faa5da9cf81996404b27b4a78842133f0430b72d6478009952a38e8"}
Aug 04 18:10:49.168813 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.168785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k9qds" event={"ID":"1f59ae9e-8f44-41e0-88e5-1885731e226a","Type":"ContainerStarted","Data":"c90701e14c2e4025e0f1cf176deb3215acff654d3761f5078d18a3a0b4d689b8"}
Aug 04 18:10:49.171026 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.171002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x" event={"ID":"1dbd02fe-957e-421c-b520-9322d2bf7ed1","Type":"ContainerStarted","Data":"2682a69f3c910bb31e41589056e231b45ce55ae8564530801f93ae2f7a20dff7"}
Aug 04 18:10:49.171942 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.171915    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jv9x4" event={"ID":"55f67dd0-e011-484d-8788-922e108e96cd","Type":"ContainerStarted","Data":"9e64245e15cc20be6f07eaf873a1c6812ebcd7c8e54ef0db01dd786c3e432281"}
Aug 04 18:10:49.173768 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.173749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fm6ff" event={"ID":"ce74f133-1e9c-42c7-a860-45c19a0186db","Type":"ContainerStarted","Data":"5b49f5bb240ac1d3d0bb9dae9b275a5206713ee65869adef6feeba91627b3ecd"}
Aug 04 18:10:49.175849 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.175829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"89a09a998d863f21b5d7fbae0d122add8e7997b4cbfb9c50bace9169ac9f3916"}
Aug 04 18:10:49.177998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.177972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal" event={"ID":"dd8bc490af8a6a5247a729399b554aa6","Type":"ContainerStarted","Data":"f7bf5652eadd10dcf0c6744a58d6ee15a32b1407c5925ed1675abd5cb6ac9edb"}
Aug 04 18:10:49.181615 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.181593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgd4d" event={"ID":"835019f2-fc13-4c12-bc7c-ddfa5e81a69a","Type":"ContainerStarted","Data":"d711f52e39266db0a608b80d25826244bd30d17ca17728dc998ab3b8d5efff1f"}
Aug 04 18:10:49.183984 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.183953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zkpv" event={"ID":"7e1daf79-fc08-41eb-bb03-cccbc2294956","Type":"ContainerStarted","Data":"fd24a9fb238a586b1c6920a4fa54c957c8c45b79baa9ee6869557a91f42d2144"}
Aug 04 18:10:49.186012 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.185993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerStarted","Data":"d64347b3f7f4f0a37eadf5867da692fd44ed3f7f8324c9d27807345c74d9a940"}
Aug 04 18:10:49.194420 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.194376    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-226.ec2.internal" podStartSLOduration=2.194362654 podStartE2EDuration="2.194362654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:10:49.194017246 +0000 UTC m=+3.519120366" watchObservedRunningTime="2026-08-04 18:10:49.194362654 +0000 UTC m=+3.519465777"
Aug 04 18:10:49.681997 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.681109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:49.681997 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.681162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:49.681997 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.681332    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:49.681997 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.681393    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:51.68137329 +0000 UTC m=+6.006476404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:49.681997 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.681845    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:49.681997 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.681895    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:51.681880925 +0000 UTC m=+6.006984028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:49.782575 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:49.781799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:49.782575 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.782120    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:10:49.782575 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.782141    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:10:49.782575 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.782155    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:49.782575 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:49.782213    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:10:51.782194691 +0000 UTC m=+6.107297792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:50.109101 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:50.108983    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 18:05:48 +0000 UTC" deadline="2028-05-11 21:24:31.577014168 +0000 UTC"
Aug 04 18:10:50.109101 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:50.109022    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15507h13m41.467997387s"
Aug 04 18:10:50.160503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:50.157473    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:50.160503 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:50.157611    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:10:50.160503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:50.158031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:50.160503 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:50.158129    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:10:50.201214 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:50.200648    2579 generic.go:356] "Generic (PLEG): container finished" podID="f1acc9acdb627038ced602e1bd940b3b" containerID="588822af769d12113ab0830863f0424d9d7adab2ec4ee58fbf3dfab6a903ff69" exitCode=0
Aug 04 18:10:50.201214 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:50.200880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" event={"ID":"f1acc9acdb627038ced602e1bd940b3b","Type":"ContainerDied","Data":"588822af769d12113ab0830863f0424d9d7adab2ec4ee58fbf3dfab6a903ff69"}
Aug 04 18:10:51.156848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:51.156810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:51.157318 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.156960    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:10:51.225679 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:51.224988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" event={"ID":"f1acc9acdb627038ced602e1bd940b3b","Type":"ContainerStarted","Data":"8d82af94d91ec0293ae1fa32c63fd623d064419fd7ec46a09734efb38f88a98a"}
Aug 04 18:10:51.700119 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:51.699338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:51.700119 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:51.699394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:51.700119 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.699550    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:51.700119 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.699610    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:55.699591242 +0000 UTC m=+10.024694344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:51.700119 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.700038    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:51.700119 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.700084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:10:55.700068105 +0000 UTC m=+10.025171204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:51.802935 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:51.800309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:51.807980 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.803795    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:10:51.807980 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.803831    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:10:51.807980 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.803845    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:51.807980 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:51.803916    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:10:55.80389778 +0000 UTC m=+10.129000894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:52.160555 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:52.159998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:52.160555 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:52.160105    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:10:52.160555 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:52.160415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:52.160555 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:52.160476    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:10:53.156008 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:53.155972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:53.156181 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:53.156120    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:10:54.156657 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:54.156018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:54.156657 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:54.156156    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:10:54.156657 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:54.156017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:54.156657 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:54.156568    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:10:55.157072 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:55.156536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:55.157072 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.156684    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:10:55.736170 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:55.735847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:55.736170 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:55.735974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:55.736170 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.736033    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:55.736170 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.736092    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:55.736170 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.736117    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:03.736096354 +0000 UTC m=+18.061199467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:10:55.736170 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.736145    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:03.736126956 +0000 UTC m=+18.061230062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:10:55.837563 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:55.836949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:55.837563 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.837126    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:10:55.837563 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.837149    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:10:55.837563 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.837172    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:55.837563 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:55.837229    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:11:03.837213775 +0000 UTC m=+18.162316873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:10:56.161991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:56.161907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:56.162423 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:56.162033    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:10:56.162423 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:56.162386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:56.162534 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:56.162470    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:10:57.156405 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:57.156361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:57.156585 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:57.156515    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:10:58.155933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:58.155892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:10:58.156413 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:58.156025    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:10:58.156697 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:58.156678    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:10:58.159211 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:58.159162    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:10:59.155945 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:10:59.155910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:10:59.156426 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:10:59.156032    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:00.155887 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:00.155844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:00.156054 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:00.155989    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:00.156054 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:00.155844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:00.156436 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:00.156135    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:01.156112 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:01.156071    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:01.156554 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:01.156204    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:02.156161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:02.156124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:02.156608 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:02.156255    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:02.156608 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:02.156315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:02.156608 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:02.156423    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:03.156828 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:03.156788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:03.157313 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.156933    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:03.799163 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:03.799124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:03.799163 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:03.799168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:03.799392 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.799300    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:11:03.799392 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.799301    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:11:03.799392 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.799373    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:19.79935273 +0000 UTC m=+34.124455829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:11:03.799392 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.799392    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:19.799382269 +0000 UTC m=+34.124485370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:11:03.899813 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:03.899697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:03.899991 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.899864    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:11:03.899991 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.899887    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:11:03.899991 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.899897    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:11:03.899991 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:03.899961    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:11:19.899945325 +0000 UTC m=+34.225048448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:11:04.156853 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:04.156775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:04.157289 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:04.156894    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:04.157289 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:04.156986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:04.157289 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:04.157090    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:05.156083 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:05.156046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:05.156251 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:05.156172    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:06.157912 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:06.157418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:06.157912 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:06.157533    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:06.157912 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:06.157590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:06.157912 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:06.157685    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:07.156451 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:07.156404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:07.156622 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:07.156537    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:08.156632 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.156387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:08.157210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.156454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:08.157210 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:08.156686    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:08.157210 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:08.156819    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:08.263376 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.263342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w2c5q" event={"ID":"75d37ff4-3080-4a7a-8f78-cb53035d2849","Type":"ContainerStarted","Data":"0255acabf5ae36f54f035ad2a140080afa4a729b5b0cf703b84cc0b6c0dd7757"}
Aug 04 18:11:08.264916 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.264887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x" event={"ID":"1dbd02fe-957e-421c-b520-9322d2bf7ed1","Type":"ContainerStarted","Data":"93c7665854a84cf43e4338f86643d5326f5a3ed2a1f5543bd3ffc782531fe466"}
Aug 04 18:11:08.266515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.266487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jv9x4" event={"ID":"55f67dd0-e011-484d-8788-922e108e96cd","Type":"ContainerStarted","Data":"facd1c6cafb804226faba825ada1ab35d7454a398788c502e73a1ff7adb9a822"}
Aug 04 18:11:08.268426 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.268399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fm6ff" event={"ID":"ce74f133-1e9c-42c7-a860-45c19a0186db","Type":"ContainerStarted","Data":"b80690782219565d13e3e4fb894eac69a34c2c0c51e8a87ee7a911f2b61cb893"}
Aug 04 18:11:08.270270 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.270249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:11:08.270599 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.270574    2579 generic.go:356] "Generic (PLEG): container finished" podID="b2b08036-6367-42c9-a6fe-32683902f7ac" containerID="5162e43ac0b67eb0eb17ef39afa8292af34c5cdd371609698d6aaaa3a5ea31cb" exitCode=1
Aug 04 18:11:08.270708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.270639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerDied","Data":"5162e43ac0b67eb0eb17ef39afa8292af34c5cdd371609698d6aaaa3a5ea31cb"}
Aug 04 18:11:08.270792 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.270754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"d00d32ece274c7f282328cbe3a9e6847723187f439fcada8202fc4dbc06f46a2"}
Aug 04 18:11:08.272184 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.272153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgd4d" event={"ID":"835019f2-fc13-4c12-bc7c-ddfa5e81a69a","Type":"ContainerStarted","Data":"f62ed2e475a180873ef267ce11fb228fefc5d56a8910f1c3c92fc3925b4adb1a"}
Aug 04 18:11:08.273530 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.273499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zkpv" event={"ID":"7e1daf79-fc08-41eb-bb03-cccbc2294956","Type":"ContainerStarted","Data":"148f875671eb63afe9001cef15df1269c62f57b3d08f38f20164bd39afaddb19"}
Aug 04 18:11:08.275093 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.275014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerStarted","Data":"4b0dbcd7beaaf5851511592da0cdb63e39d51afebb256e2af15ce4b1e18ec002"}
Aug 04 18:11:08.285359 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.285307    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-226.ec2.internal" podStartSLOduration=21.285291614 podStartE2EDuration="21.285291614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:10:51.250466629 +0000 UTC m=+5.575569765" watchObservedRunningTime="2026-08-04 18:11:08.285291614 +0000 UTC m=+22.610394735"
Aug 04 18:11:08.285535 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.285482    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w2c5q" podStartSLOduration=3.535842782 podStartE2EDuration="22.2854762s" totalImagesPullingTime="18.749633418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:08.285021062 +0000 UTC m=+22.610124207" watchObservedRunningTime="2026-08-04 18:11:08.2854762 +0000 UTC m=+22.610579328"
Aug 04 18:11:08.301278 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.301221    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jv9x4" podStartSLOduration=3.562382913 podStartE2EDuration="22.301204724s" totalImagesPullingTime="18.738821811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:08.300555111 +0000 UTC m=+22.625658251" watchObservedRunningTime="2026-08-04 18:11:08.301204724 +0000 UTC m=+22.626307842"
Aug 04 18:11:08.318654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.318605    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8zkpv" podStartSLOduration=8.195205896 podStartE2EDuration="22.318587644s" totalImagesPullingTime="14.123381748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:08.318553307 +0000 UTC m=+22.643656454" watchObservedRunningTime="2026-08-04 18:11:08.318587644 +0000 UTC m=+22.643690758"
Aug 04 18:11:08.363102 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.363048    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lgd4d" podStartSLOduration=3.6308508489999998 podStartE2EDuration="22.363033091s" totalImagesPullingTime="18.732182242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:08.362713076 +0000 UTC m=+22.687816234" watchObservedRunningTime="2026-08-04 18:11:08.363033091 +0000 UTC m=+22.688136211"
Aug 04 18:11:08.381046 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:08.380998    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fm6ff" podStartSLOduration=3.642003677 podStartE2EDuration="22.380981254s" totalImagesPullingTime="18.738977577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:08.380404716 +0000 UTC m=+22.705507855" watchObservedRunningTime="2026-08-04 18:11:08.380981254 +0000 UTC m=+22.706084428"
Aug 04 18:11:09.156331 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.156085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:09.156500 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:09.156382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:09.279457 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.279423    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b492484-4d29-4bea-ac04-4a2e71e28090" containerID="4b0dbcd7beaaf5851511592da0cdb63e39d51afebb256e2af15ce4b1e18ec002" exitCode=0
Aug 04 18:11:09.280346 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.279496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerDied","Data":"4b0dbcd7beaaf5851511592da0cdb63e39d51afebb256e2af15ce4b1e18ec002"}
Aug 04 18:11:09.281584 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.281554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k9qds" event={"ID":"1f59ae9e-8f44-41e0-88e5-1885731e226a","Type":"ContainerStarted","Data":"1ab17357e60eedd64831c4df5a2bdb8b701c99ede2a5f7cd14a5fed29103efd4"}
Aug 04 18:11:09.285463 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.285440    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:11:09.286518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.285870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"20ba915a0a8de2949f5966df9073a0026d47e3f9173e825042a6fcea1456ca58"}
Aug 04 18:11:09.286518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.285967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"2a5c95b10d633adbe04e6ec15254241c9f6965802b0974ac5f4ab9db1715848e"}
Aug 04 18:11:09.286518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.286025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"ac720e6387f6d396e37d607a93b9c8e24a90fdcbc501fe414a07d591c749b058"}
Aug 04 18:11:09.286518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.286077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"9ce1b8708b0ca73abf29c659e2e25f92e42e25d48a1649aa06a3b1360550b789"}
Aug 04 18:11:09.375844 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:09.375820    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 18:11:10.108176 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:10.108054    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T18:11:09.375837089Z","UUID":"5013a3f1-a6fb-40a9-b5b8-bab4a858dd02","Handler":null,"Name":"","Endpoint":""}
Aug 04 18:11:10.110348 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:10.110321    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 18:11:10.110494 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:10.110368    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 18:11:10.156017 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:10.155983    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:10.156177 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:10.156112    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:10.156177 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:10.156165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:10.156355 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:10.156252    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:10.290660 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:10.290621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x" event={"ID":"1dbd02fe-957e-421c-b520-9322d2bf7ed1","Type":"ContainerStarted","Data":"31bf081bf3d3cbbd78577784edd308319c3e3f88d7c1df303d1ab5079b6bef07"}
Aug 04 18:11:11.156697 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:11.156666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:11.156880 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:11.156802    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:11.295219 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:11.295188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x" event={"ID":"1dbd02fe-957e-421c-b520-9322d2bf7ed1","Type":"ContainerStarted","Data":"b30e4d807b5b01973a12df48f7cd1cc52d6856b08b7ae781a5ab677fffc34233"}
Aug 04 18:11:11.298573 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:11.298546    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:11:11.299000 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:11.298975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"3ead0b6e612f545a418466a800a31b93e61e0bedf58b768168ff5ba1580cf07a"}
Aug 04 18:11:11.327559 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:11.327506    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k9qds" podStartSLOduration=6.598507842 podStartE2EDuration="25.32748805s" totalImagesPullingTime="18.728980208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:09.321220042 +0000 UTC m=+23.646323162" watchObservedRunningTime="2026-08-04 18:11:11.32748805 +0000 UTC m=+25.652591169"
Aug 04 18:11:12.156576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:12.156383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:12.156806 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:12.156439    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:12.156806 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:12.156655    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:12.156806 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:12.156736    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:13.155999 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:13.155914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:13.156571 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:13.156085    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:13.262176 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:13.262137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:11:13.262870 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:13.262845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:11:13.280702 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:13.280652    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rvg2x" podStartSLOduration=6.044400812 podStartE2EDuration="27.280629286s" totalImagesPullingTime="21.236228474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:11.327752332 +0000 UTC m=+25.652855454" watchObservedRunningTime="2026-08-04 18:11:13.280629286 +0000 UTC m=+27.605732409"
Aug 04 18:11:13.304103 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:13.304072    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:11:13.304636 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:13.304614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8zkpv"
Aug 04 18:11:14.156068 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.155814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:14.156823 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.155885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:14.156823 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:14.156185    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:14.156823 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:14.156227    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:14.309322 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.309292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:11:14.309683 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.309653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"fe56b5ca3a3f9df5f1088fcb23ca15052a64d5b64764d8bfc629f083a474ce32"}
Aug 04 18:11:14.310023 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.310001    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:11:14.310152 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.310134    2579 scope.go:117] "RemoveContainer" containerID="5162e43ac0b67eb0eb17ef39afa8292af34c5cdd371609698d6aaaa3a5ea31cb"
Aug 04 18:11:14.311418 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.311389    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b492484-4d29-4bea-ac04-4a2e71e28090" containerID="f5151c78cfaeb591d1d7e0ded430bcba7045b3d1a26f729f9d15e4a4e1926dc2" exitCode=0
Aug 04 18:11:14.311538 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.311434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerDied","Data":"f5151c78cfaeb591d1d7e0ded430bcba7045b3d1a26f729f9d15e4a4e1926dc2"}
Aug 04 18:11:14.327061 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:14.327032    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:11:15.155978 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.155945    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:15.156136 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:15.156055    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:15.326046 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.326019    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:11:15.326496 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.326457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" event={"ID":"b2b08036-6367-42c9-a6fe-32683902f7ac","Type":"ContainerStarted","Data":"afb69173650f9ce9addf131808d2ff75d96f247c5145dee264071738a2df5eb1"}
Aug 04 18:11:15.326964 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.326931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:11:15.327064 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.327005    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:11:15.330604 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.330569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerStarted","Data":"63d1dd5c2883a536e952efb583b9f2e07f64022b50090be797c764ff0df370ed"}
Aug 04 18:11:15.346473 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.346447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:11:15.363841 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:15.363793    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk" podStartSLOduration=10.56593024 podStartE2EDuration="29.363778667s" totalImagesPullingTime="18.797848427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:15.363420642 +0000 UTC m=+29.688523783" watchObservedRunningTime="2026-08-04 18:11:15.363778667 +0000 UTC m=+29.688881803"
Aug 04 18:11:16.157903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.157876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:16.158287 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:16.157979    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:16.158287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.158013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:16.158287 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:16.158070    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:16.336027 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.335830    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b492484-4d29-4bea-ac04-4a2e71e28090" containerID="63d1dd5c2883a536e952efb583b9f2e07f64022b50090be797c764ff0df370ed" exitCode=0
Aug 04 18:11:16.336027 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.336021    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b492484-4d29-4bea-ac04-4a2e71e28090" containerID="49d32812d22f9be501aff94fe94b9d35d7ffe633c58a70bab3209b7224d11ea7" exitCode=0
Aug 04 18:11:16.336027 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.335921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerDied","Data":"63d1dd5c2883a536e952efb583b9f2e07f64022b50090be797c764ff0df370ed"}
Aug 04 18:11:16.336258 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.336083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerDied","Data":"49d32812d22f9be501aff94fe94b9d35d7ffe633c58a70bab3209b7224d11ea7"}
Aug 04 18:11:16.399290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.399214    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-28xt9"]
Aug 04 18:11:16.399453 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.399397    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:16.399543 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:16.399520    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:16.402263 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.402233    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mwfzl"]
Aug 04 18:11:16.402414 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.402360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:16.402503 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:16.402481    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:16.414150 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.414117    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mz44f"]
Aug 04 18:11:16.414259 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:16.414251    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:16.414380 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:16.414362    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:18.156586 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:18.156535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:18.157138 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:18.156544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:18.157138 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:18.156664    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:18.157138 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:18.156713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:18.157138 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:18.156842    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:18.157138 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:18.156917    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:19.815648 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:19.815603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:19.816313 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:19.815664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:19.816313 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.815791    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 18:11:19.816313 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.815804    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:11:19.816313 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.815867    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret podName:b20b5f74-9033-4fd4-a1ba-e72aece50d92 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:51.815846643 +0000 UTC m=+66.140949758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret") pod "global-pull-secret-syncer-mwfzl" (UID: "b20b5f74-9033-4fd4-a1ba-e72aece50d92") : object "kube-system"/"original-pull-secret" not registered
Aug 04 18:11:19.816313 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.815888    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs podName:78459739-509b-47f0-a534-4fc07c936c59 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:51.815878516 +0000 UTC m=+66.140981620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs") pod "network-metrics-daemon-mz44f" (UID: "78459739-509b-47f0-a534-4fc07c936c59") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 18:11:19.916983 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:19.916949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:19.917166 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.917102    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 18:11:19.917166 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.917119    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 18:11:19.917166 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.917129    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mjxfx for pod openshift-network-diagnostics/network-check-target-28xt9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:11:19.917306 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:19.917178    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx podName:41042758-27f8-4f08-b044-a1695980021d nodeName:}" failed. No retries permitted until 2026-08-04 18:11:51.917164092 +0000 UTC m=+66.242267190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjxfx" (UniqueName: "kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx") pod "network-check-target-28xt9" (UID: "41042758-27f8-4f08-b044-a1695980021d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 18:11:20.156733 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:20.156623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:20.156903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:20.156623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:20.156903 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:20.156785    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mz44f" podUID="78459739-509b-47f0-a534-4fc07c936c59"
Aug 04 18:11:20.156903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:20.156793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:20.156903 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:20.156840    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mwfzl" podUID="b20b5f74-9033-4fd4-a1ba-e72aece50d92"
Aug 04 18:11:20.157118 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:20.156903    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-28xt9" podUID="41042758-27f8-4f08-b044-a1695980021d"
Aug 04 18:11:21.019435 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.019400    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-226.ec2.internal" event="NodeReady"
Aug 04 18:11:21.019935 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.019586    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 18:11:21.075037 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.075005    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l7wqs"]
Aug 04 18:11:21.089589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.089558    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tmbs9"]
Aug 04 18:11:21.089703 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.089686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.095007 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.094981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 18:11:21.095106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.095056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khq2z\""
Aug 04 18:11:21.095950 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.095930    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 18:11:21.105419 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.105372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.107962 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.107909    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l7wqs"]
Aug 04 18:11:21.108580 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.108563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tmbs9"]
Aug 04 18:11:21.110516 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.110495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rwz87\""
Aug 04 18:11:21.110612 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.110565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 18:11:21.110670 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.110495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 18:11:21.110754 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.110745    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 18:11:21.236209 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.236173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.236209 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.236205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c25caaa8-9d11-4e7b-8904-2596aef01fc1-tmp-dir\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.236449 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.236225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c5587ab-c910-4bc0-94f0-3700cfe5b79e-cert\") pod \"ingress-canary-tmbs9\" (UID: \"2c5587ab-c910-4bc0-94f0-3700cfe5b79e\") " pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.236449 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.236266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8rjv\" (UniqueName: \"kubernetes.io/projected/2c5587ab-c910-4bc0-94f0-3700cfe5b79e-kube-api-access-k8rjv\") pod \"ingress-canary-tmbs9\" (UID: \"2c5587ab-c910-4bc0-94f0-3700cfe5b79e\") " pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.236449 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.236386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c25caaa8-9d11-4e7b-8904-2596aef01fc1-config-volume\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.236449 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.236415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzxl\" (UniqueName: \"kubernetes.io/projected/c25caaa8-9d11-4e7b-8904-2596aef01fc1-kube-api-access-qmzxl\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.337560 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.337560 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c25caaa8-9d11-4e7b-8904-2596aef01fc1-tmp-dir\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.337846 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c5587ab-c910-4bc0-94f0-3700cfe5b79e-cert\") pod \"ingress-canary-tmbs9\" (UID: \"2c5587ab-c910-4bc0-94f0-3700cfe5b79e\") " pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.337846 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8rjv\" (UniqueName: \"kubernetes.io/projected/2c5587ab-c910-4bc0-94f0-3700cfe5b79e-kube-api-access-k8rjv\") pod \"ingress-canary-tmbs9\" (UID: \"2c5587ab-c910-4bc0-94f0-3700cfe5b79e\") " pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.337846 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:21.337701    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:11:21.337846 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:21.337801    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls podName:c25caaa8-9d11-4e7b-8904-2596aef01fc1 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:21.837776728 +0000 UTC m=+36.162879839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls") pod "dns-default-l7wqs" (UID: "c25caaa8-9d11-4e7b-8904-2596aef01fc1") : secret "dns-default-metrics-tls" not found
Aug 04 18:11:21.337846 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c25caaa8-9d11-4e7b-8904-2596aef01fc1-config-volume\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.338080 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzxl\" (UniqueName: \"kubernetes.io/projected/c25caaa8-9d11-4e7b-8904-2596aef01fc1-kube-api-access-qmzxl\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.338080 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.337983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c25caaa8-9d11-4e7b-8904-2596aef01fc1-tmp-dir\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.338319 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.338298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c25caaa8-9d11-4e7b-8904-2596aef01fc1-config-volume\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.341974 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.341957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c5587ab-c910-4bc0-94f0-3700cfe5b79e-cert\") pod \"ingress-canary-tmbs9\" (UID: \"2c5587ab-c910-4bc0-94f0-3700cfe5b79e\") " pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.349374 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.349347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8rjv\" (UniqueName: \"kubernetes.io/projected/2c5587ab-c910-4bc0-94f0-3700cfe5b79e-kube-api-access-k8rjv\") pod \"ingress-canary-tmbs9\" (UID: \"2c5587ab-c910-4bc0-94f0-3700cfe5b79e\") " pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.350452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.350428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzxl\" (UniqueName: \"kubernetes.io/projected/c25caaa8-9d11-4e7b-8904-2596aef01fc1-kube-api-access-qmzxl\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.351867 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.351844    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b492484-4d29-4bea-ac04-4a2e71e28090" containerID="1c61660a21a30aa19d9d54e6c14ec058f013df9720c9b9210a519107dddf0be9" exitCode=0
Aug 04 18:11:21.351957 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.351878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerDied","Data":"1c61660a21a30aa19d9d54e6c14ec058f013df9720c9b9210a519107dddf0be9"}
Aug 04 18:11:21.449706 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.449675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tmbs9"
Aug 04 18:11:21.651634 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.651339    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tmbs9"]
Aug 04 18:11:21.656756 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:21.656673    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5587ab_c910_4bc0_94f0_3700cfe5b79e.slice/crio-3c6aa563bd698eeffcac608a8d2dfb678022a850a4698478499016663177b894 WatchSource:0}: Error finding container 3c6aa563bd698eeffcac608a8d2dfb678022a850a4698478499016663177b894: Status 404 returned error can't find the container with id 3c6aa563bd698eeffcac608a8d2dfb678022a850a4698478499016663177b894
Aug 04 18:11:21.841274 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:21.841237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:21.841446 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:21.841361    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:11:21.841446 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:21.841421    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls podName:c25caaa8-9d11-4e7b-8904-2596aef01fc1 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:22.8414088 +0000 UTC m=+37.166511897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls") pod "dns-default-l7wqs" (UID: "c25caaa8-9d11-4e7b-8904-2596aef01fc1") : secret "dns-default-metrics-tls" not found
Aug 04 18:11:22.156768 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.156739    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:22.157302 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.156740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:22.157302 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.156740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:22.161828 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.161803    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:11:22.161968 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.161908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wz6f8\""
Aug 04 18:11:22.162017 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.161983    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:11:22.162881 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.162863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:11:22.163281 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.163261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:11:22.163592 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.163578    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kp5sr\""
Aug 04 18:11:22.182268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.182241    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ctwpn"]
Aug 04 18:11:22.206181 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.206153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.228548 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.228518    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 18:11:22.228548 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.228531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 18:11:22.229144 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.229126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctwpn"]
Aug 04 18:11:22.229431 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.229418    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 18:11:22.236266 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.236243    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r6h4z\""
Aug 04 18:11:22.236266 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.236245    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 18:11:22.345340 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.345300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be07886b-58ca-43dc-a15f-61f25526d904-crio-socket\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.345340 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.345338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be07886b-58ca-43dc-a15f-61f25526d904-data-volume\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.345577 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.345505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhnb\" (UniqueName: \"kubernetes.io/projected/be07886b-58ca-43dc-a15f-61f25526d904-kube-api-access-trhnb\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.345577 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.345539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.345670 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.345589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.355151 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.355113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tmbs9" event={"ID":"2c5587ab-c910-4bc0-94f0-3700cfe5b79e","Type":"ContainerStarted","Data":"3c6aa563bd698eeffcac608a8d2dfb678022a850a4698478499016663177b894"}
Aug 04 18:11:22.358063 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.358033    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b492484-4d29-4bea-ac04-4a2e71e28090" containerID="ae788b9e77093262bd69a647d3ce39d333ea05dd47424a4961f0477038da9065" exitCode=0
Aug 04 18:11:22.358192 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.358067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerDied","Data":"ae788b9e77093262bd69a647d3ce39d333ea05dd47424a4961f0477038da9065"}
Aug 04 18:11:22.446817 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.446784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be07886b-58ca-43dc-a15f-61f25526d904-crio-socket\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.446817 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.446827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be07886b-58ca-43dc-a15f-61f25526d904-data-volume\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.447048 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.446963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhnb\" (UniqueName: \"kubernetes.io/projected/be07886b-58ca-43dc-a15f-61f25526d904-kube-api-access-trhnb\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.447048 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.446991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.447155 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.447073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.447637 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.447615    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:11:22.447781 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.447684    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:22.947667641 +0000 UTC m=+37.272770739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : configmap "kube-rbac-proxy" not found
Aug 04 18:11:22.447781 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.447769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be07886b-58ca-43dc-a15f-61f25526d904-crio-socket\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.447924 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.447855    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:22.447924 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.447912    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:22.947895171 +0000 UTC m=+37.272998282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:22.448064 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.448041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be07886b-58ca-43dc-a15f-61f25526d904-data-volume\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.480481 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.480450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhnb\" (UniqueName: \"kubernetes.io/projected/be07886b-58ca-43dc-a15f-61f25526d904-kube-api-access-trhnb\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.592902 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.592862    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"]
Aug 04 18:11:22.614290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.614024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"]
Aug 04 18:11:22.614290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.614170    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"
Aug 04 18:11:22.617635 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.617432    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 18:11:22.617635 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.617532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wmnfn\""
Aug 04 18:11:22.617885 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.617870    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 18:11:22.749200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.749113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vhf5\" (UniqueName: \"kubernetes.io/projected/464814d7-c93c-49dd-bc5b-06e408139705-kube-api-access-7vhf5\") pod \"migrator-68bc745d87-nrpgd\" (UID: \"464814d7-c93c-49dd-bc5b-06e408139705\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"
Aug 04 18:11:22.850972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.850537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:22.850972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.850638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vhf5\" (UniqueName: \"kubernetes.io/projected/464814d7-c93c-49dd-bc5b-06e408139705-kube-api-access-7vhf5\") pod \"migrator-68bc745d87-nrpgd\" (UID: \"464814d7-c93c-49dd-bc5b-06e408139705\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"
Aug 04 18:11:22.850972 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.850734    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:11:22.850972 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.850806    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls podName:c25caaa8-9d11-4e7b-8904-2596aef01fc1 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:24.850788036 +0000 UTC m=+39.175891135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls") pod "dns-default-l7wqs" (UID: "c25caaa8-9d11-4e7b-8904-2596aef01fc1") : secret "dns-default-metrics-tls" not found
Aug 04 18:11:22.862355 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.862323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vhf5\" (UniqueName: \"kubernetes.io/projected/464814d7-c93c-49dd-bc5b-06e408139705-kube-api-access-7vhf5\") pod \"migrator-68bc745d87-nrpgd\" (UID: \"464814d7-c93c-49dd-bc5b-06e408139705\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"
Aug 04 18:11:22.926237 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.926198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"
Aug 04 18:11:22.950996 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.950960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.951137 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:22.951054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:22.951137 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.951092    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:11:22.951230 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.951155    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:23.951136575 +0000 UTC m=+38.276239674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : configmap "kube-rbac-proxy" not found
Aug 04 18:11:22.951230 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.951204    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:22.951350 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:22.951240    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:23.951229856 +0000 UTC m=+38.276332959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:23.092793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.092522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd"]
Aug 04 18:11:23.097862 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:23.097823    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464814d7_c93c_49dd_bc5b_06e408139705.slice/crio-a1d305d6fb64f1eaf849c6c0f6c19a22f3104f60237411a02406075af1ba9dc3 WatchSource:0}: Error finding container a1d305d6fb64f1eaf849c6c0f6c19a22f3104f60237411a02406075af1ba9dc3: Status 404 returned error can't find the container with id a1d305d6fb64f1eaf849c6c0f6c19a22f3104f60237411a02406075af1ba9dc3
Aug 04 18:11:23.362153 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.362059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd" event={"ID":"464814d7-c93c-49dd-bc5b-06e408139705","Type":"ContainerStarted","Data":"a1d305d6fb64f1eaf849c6c0f6c19a22f3104f60237411a02406075af1ba9dc3"}
Aug 04 18:11:23.365073 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.365046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pppwl" event={"ID":"1b492484-4d29-4bea-ac04-4a2e71e28090","Type":"ContainerStarted","Data":"220aae6265378cf657a030a0bbf9f2818717eb39b5bac1151558be07b61ddb53"}
Aug 04 18:11:23.393031 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.392966    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pppwl" podStartSLOduration=7.662786481 podStartE2EDuration="37.392941726s" totalImagesPullingTime="29.730155245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:23.391087327 +0000 UTC m=+37.716190472" watchObservedRunningTime="2026-08-04 18:11:23.392941726 +0000 UTC m=+37.718044848"
Aug 04 18:11:23.895599 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.895571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jv9x4_55f67dd0-e011-484d-8788-922e108e96cd/dns-node-resolver/0.log"
Aug 04 18:11:23.959878 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.959846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:23.960047 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:23.959936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:23.960047 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:23.960023    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 18:11:23.960047 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:23.960023    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:23.960218 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:23.960078    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:25.960059412 +0000 UTC m=+40.285162517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : configmap "kube-rbac-proxy" not found
Aug 04 18:11:23.960218 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:23.960097    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:25.960087739 +0000 UTC m=+40.285190836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:24.866742 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:24.866689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:24.867416 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:24.866830    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:11:24.867416 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:24.866891    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls podName:c25caaa8-9d11-4e7b-8904-2596aef01fc1 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:28.866875608 +0000 UTC m=+43.191978706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls") pod "dns-default-l7wqs" (UID: "c25caaa8-9d11-4e7b-8904-2596aef01fc1") : secret "dns-default-metrics-tls" not found
Aug 04 18:11:24.898069 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:24.898042    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fm6ff_ce74f133-1e9c-42c7-a860-45c19a0186db/node-ca/0.log"
Aug 04 18:11:25.371789 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:25.371757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tmbs9" event={"ID":"2c5587ab-c910-4bc0-94f0-3700cfe5b79e","Type":"ContainerStarted","Data":"9ce13a4e056b56f55417279eaef64bf86498a8d80fe7db5723beb687ead1c41a"}
Aug 04 18:11:25.389544 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:25.389458    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tmbs9" podStartSLOduration=1.754562155 podStartE2EDuration="4.389441636s" totalImagesPullingTime="2.634879481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:25.38832688 +0000 UTC m=+39.713429990" watchObservedRunningTime="2026-08-04 18:11:25.389441636 +0000 UTC m=+39.714544756"
Aug 04 18:11:25.894432 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:25.894192    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tmbs9_2c5587ab-c910-4bc0-94f0-3700cfe5b79e/serve-healthcheck-canary/0.log"
Aug 04 18:11:25.974623 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:25.974575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:25.974798 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:25.974703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:25.974798 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:25.974748    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:25.974913 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:25.974825    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:29.97480683 +0000 UTC m=+44.299909931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:25.975270 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:25.975243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be07886b-58ca-43dc-a15f-61f25526d904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:26.375678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:26.375579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd" event={"ID":"464814d7-c93c-49dd-bc5b-06e408139705","Type":"ContainerStarted","Data":"d4e2e7bc45f19e4e9180c1cfe7a4d2f9fc4862aebae443f9e1e2fce88d3336a1"}
Aug 04 18:11:26.375678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:26.375645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd" event={"ID":"464814d7-c93c-49dd-bc5b-06e408139705","Type":"ContainerStarted","Data":"27f0119c82e59332abd96879c6c84e65374258832658d5d6921fe3f279b30409"}
Aug 04 18:11:26.398526 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:26.398473    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-nrpgd" podStartSLOduration=1.975490328 podStartE2EDuration="4.398456918s" totalImagesPullingTime="2.42296659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:26.397786852 +0000 UTC m=+40.722889982" watchObservedRunningTime="2026-08-04 18:11:26.398456918 +0000 UTC m=+40.723560037"
Aug 04 18:11:28.895420 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:28.895385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:28.895818 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:28.895551    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 18:11:28.895818 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:28.895619    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls podName:c25caaa8-9d11-4e7b-8904-2596aef01fc1 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:36.895603035 +0000 UTC m=+51.220706132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls") pod "dns-default-l7wqs" (UID: "c25caaa8-9d11-4e7b-8904-2596aef01fc1") : secret "dns-default-metrics-tls" not found
Aug 04 18:11:30.003393 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:30.003352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:30.003780 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:30.003516    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:30.003780 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:30.003579    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls podName:be07886b-58ca-43dc-a15f-61f25526d904 nodeName:}" failed. No retries permitted until 2026-08-04 18:11:38.003564185 +0000 UTC m=+52.328667285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwpn" (UID: "be07886b-58ca-43dc-a15f-61f25526d904") : secret "insights-runtime-extractor-tls" not found
Aug 04 18:11:36.956887 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:36.956848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:36.960250 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:36.960227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25caaa8-9d11-4e7b-8904-2596aef01fc1-metrics-tls\") pod \"dns-default-l7wqs\" (UID: \"c25caaa8-9d11-4e7b-8904-2596aef01fc1\") " pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:37.044602 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:37.044551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:37.198254 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:37.198084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l7wqs"]
Aug 04 18:11:37.200572 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:37.200537    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25caaa8_9d11_4e7b_8904_2596aef01fc1.slice/crio-1e53edc9daee23105b2b0de9d5451b4a2cf159ed6073b109779dea5fa4c2c32c WatchSource:0}: Error finding container 1e53edc9daee23105b2b0de9d5451b4a2cf159ed6073b109779dea5fa4c2c32c: Status 404 returned error can't find the container with id 1e53edc9daee23105b2b0de9d5451b4a2cf159ed6073b109779dea5fa4c2c32c
Aug 04 18:11:37.403411 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:37.403325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l7wqs" event={"ID":"c25caaa8-9d11-4e7b-8904-2596aef01fc1","Type":"ContainerStarted","Data":"1e53edc9daee23105b2b0de9d5451b4a2cf159ed6073b109779dea5fa4c2c32c"}
Aug 04 18:11:38.067840 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:38.067795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:38.070737 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:38.070691    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be07886b-58ca-43dc-a15f-61f25526d904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwpn\" (UID: \"be07886b-58ca-43dc-a15f-61f25526d904\") " pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:38.114868 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:38.114836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctwpn"
Aug 04 18:11:38.292095 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:38.292040    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctwpn"]
Aug 04 18:11:38.295401 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:38.295372    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe07886b_58ca_43dc_a15f_61f25526d904.slice/crio-3d0c516aa22c44e5e14f82151b983ed69f5ef4254f18a51e6169feb19c1abe39 WatchSource:0}: Error finding container 3d0c516aa22c44e5e14f82151b983ed69f5ef4254f18a51e6169feb19c1abe39: Status 404 returned error can't find the container with id 3d0c516aa22c44e5e14f82151b983ed69f5ef4254f18a51e6169feb19c1abe39
Aug 04 18:11:38.408086 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:38.408053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwpn" event={"ID":"be07886b-58ca-43dc-a15f-61f25526d904","Type":"ContainerStarted","Data":"3d0c516aa22c44e5e14f82151b983ed69f5ef4254f18a51e6169feb19c1abe39"}
Aug 04 18:11:39.412791 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:39.412753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwpn" event={"ID":"be07886b-58ca-43dc-a15f-61f25526d904","Type":"ContainerStarted","Data":"77a48190b0501bc48011abe34e71d6ad88e5ac36d12c2f6c20830c7ba18e85da"}
Aug 04 18:11:40.418250 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:40.418219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l7wqs" event={"ID":"c25caaa8-9d11-4e7b-8904-2596aef01fc1","Type":"ContainerStarted","Data":"1421e22751879e94675a81239c615dee2581c38bd062d7e9823e19c23628fbf6"}
Aug 04 18:11:40.418250 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:40.418269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l7wqs" event={"ID":"c25caaa8-9d11-4e7b-8904-2596aef01fc1","Type":"ContainerStarted","Data":"bd1e95fc4280c6d0cc5b755b68b9a87ef5f0064f26f730db0d20d40f2e42d928"}
Aug 04 18:11:40.418762 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:40.418343    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:40.420032 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:40.420011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwpn" event={"ID":"be07886b-58ca-43dc-a15f-61f25526d904","Type":"ContainerStarted","Data":"5eb14d6972fb71704ecad6c5966aefef0273559b992f4c5df7d279ccd538457a"}
Aug 04 18:11:42.432041 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:42.432003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwpn" event={"ID":"be07886b-58ca-43dc-a15f-61f25526d904","Type":"ContainerStarted","Data":"cb4b0ffcb90922eca38f3feed6293aa2cd86776514cd599b7f0ca2aed5e5a556"}
Aug 04 18:11:42.454988 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:42.454938    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l7wqs" podStartSLOduration=19.150040813 podStartE2EDuration="21.454921358s" totalImagesPullingTime="2.304880545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:40.442122512 +0000 UTC m=+54.767225652" watchObservedRunningTime="2026-08-04 18:11:42.454921358 +0000 UTC m=+56.780024456"
Aug 04 18:11:42.455273 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:42.455252    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ctwpn" podStartSLOduration=17.501219228 podStartE2EDuration="20.455247697s" totalImagesPullingTime="2.954028469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:11:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:42.45388466 +0000 UTC m=+56.778987791" watchObservedRunningTime="2026-08-04 18:11:42.455247697 +0000 UTC m=+56.780350843"
Aug 04 18:11:47.351073 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:47.351040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzbpk"
Aug 04 18:11:48.525968 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.525934    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"]
Aug 04 18:11:48.528861 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.528835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.532528 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.532505    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 18:11:48.532664 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.532509    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 18:11:48.533676 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.533656    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 04 18:11:48.533786 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.533659    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 18:11:48.533786 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.533714    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mbwhp\""
Aug 04 18:11:48.545681 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.545652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"]
Aug 04 18:11:48.547797 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.547772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5484584548-f4rzm\" (UID: \"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.547916 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.547842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2zzg\" (UniqueName: \"kubernetes.io/projected/5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3-kube-api-access-x2zzg\") pod \"managed-serviceaccount-addon-agent-5484584548-f4rzm\" (UID: \"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.595592 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.595562    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"]
Aug 04 18:11:48.597500 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.597470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:48.598603 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.598578    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-zct58"]
Aug 04 18:11:48.600449 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.600430    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6977db9676-r82zm"]
Aug 04 18:11:48.600566 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.600539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:11:48.601766 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.601747    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pvggk\""
Aug 04 18:11:48.601897 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.601839    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 04 18:11:48.602098 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.602082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.602360 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.602343    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"]
Aug 04 18:11:48.603786 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.603767    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 18:11:48.603892 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.603834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4jjzd\""
Aug 04 18:11:48.604049 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.604031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.604964 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.604949    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 18:11:48.605430 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.605411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 18:11:48.606081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.606064    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zjg4n\""
Aug 04 18:11:48.606211 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.606197    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 18:11:48.606429 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.606413    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xc2zs\""
Aug 04 18:11:48.607927 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.607906    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 04 18:11:48.608018 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.607929    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 04 18:11:48.609477 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.609458    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 18:11:48.613867 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.613845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 18:11:48.620284 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.620264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"]
Aug 04 18:11:48.628780 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.628751    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-zct58"]
Aug 04 18:11:48.633542 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.633513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6977db9676-r82zm"]
Aug 04 18:11:48.648178 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca0e9ea7-abae-4a7c-aa74-51a17562b27a-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-d6s4m\" (UID: \"ca0e9ea7-abae-4a7c-aa74-51a17562b27a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.648338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/110f73a1-6e71-4165-ae41-d297b4ce384e-image-registry-private-configuration\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-bound-sa-token\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-registry-tls\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648484 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5484584548-f4rzm\" (UID: \"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.648484 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0cf52470-6702-4d3e-9aee-1f246bd783c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-gwd28\" (UID: \"0cf52470-6702-4d3e-9aee-1f246bd783c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:48.648569 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2zzg\" (UniqueName: \"kubernetes.io/projected/5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3-kube-api-access-x2zzg\") pod \"managed-serviceaccount-addon-agent-5484584548-f4rzm\" (UID: \"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.648569 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648549    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca0e9ea7-abae-4a7c-aa74-51a17562b27a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6s4m\" (UID: \"ca0e9ea7-abae-4a7c-aa74-51a17562b27a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.648665 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/110f73a1-6e71-4165-ae41-d297b4ce384e-registry-certificates\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648665 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/110f73a1-6e71-4165-ae41-d297b4ce384e-trusted-ca\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648665 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s88vl\" (UniqueName: \"kubernetes.io/projected/991511a5-ab50-4fc1-88ba-8eab5391ee95-kube-api-access-s88vl\") pod \"downloads-77c974ffcf-zct58\" (UID: \"991511a5-ab50-4fc1-88ba-8eab5391ee95\") " pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:11:48.648665 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/110f73a1-6e71-4165-ae41-d297b4ce384e-ca-trust-extracted\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648869 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/110f73a1-6e71-4165-ae41-d297b4ce384e-installation-pull-secrets\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.648869 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.648698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhphr\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-kube-api-access-dhphr\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.649446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.649422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"]
Aug 04 18:11:48.651579 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.651553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5484584548-f4rzm\" (UID: \"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.660846 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.660811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2zzg\" (UniqueName: \"kubernetes.io/projected/5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3-kube-api-access-x2zzg\") pod \"managed-serviceaccount-addon-agent-5484584548-f4rzm\" (UID: \"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.749421 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhphr\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-kube-api-access-dhphr\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.749421 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca0e9ea7-abae-4a7c-aa74-51a17562b27a-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-d6s4m\" (UID: \"ca0e9ea7-abae-4a7c-aa74-51a17562b27a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.749623 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/110f73a1-6e71-4165-ae41-d297b4ce384e-image-registry-private-configuration\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.749623 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-bound-sa-token\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.749694 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-registry-tls\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.749786 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0cf52470-6702-4d3e-9aee-1f246bd783c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-gwd28\" (UID: \"0cf52470-6702-4d3e-9aee-1f246bd783c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:48.749841 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca0e9ea7-abae-4a7c-aa74-51a17562b27a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6s4m\" (UID: \"ca0e9ea7-abae-4a7c-aa74-51a17562b27a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.749841 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/110f73a1-6e71-4165-ae41-d297b4ce384e-registry-certificates\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.749936 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/110f73a1-6e71-4165-ae41-d297b4ce384e-trusted-ca\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.749936 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s88vl\" (UniqueName: \"kubernetes.io/projected/991511a5-ab50-4fc1-88ba-8eab5391ee95-kube-api-access-s88vl\") pod \"downloads-77c974ffcf-zct58\" (UID: \"991511a5-ab50-4fc1-88ba-8eab5391ee95\") " pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:11:48.749936 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.749909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/110f73a1-6e71-4165-ae41-d297b4ce384e-ca-trust-extracted\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.750678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.750203    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca0e9ea7-abae-4a7c-aa74-51a17562b27a-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-d6s4m\" (UID: \"ca0e9ea7-abae-4a7c-aa74-51a17562b27a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.750678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.750617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/110f73a1-6e71-4165-ae41-d297b4ce384e-registry-certificates\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.750678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.750668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/110f73a1-6e71-4165-ae41-d297b4ce384e-installation-pull-secrets\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.750956 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.750920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/110f73a1-6e71-4165-ae41-d297b4ce384e-trusted-ca\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.751165 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.751131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/110f73a1-6e71-4165-ae41-d297b4ce384e-ca-trust-extracted\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.752702 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.752671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0cf52470-6702-4d3e-9aee-1f246bd783c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-gwd28\" (UID: \"0cf52470-6702-4d3e-9aee-1f246bd783c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:48.752881 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.752858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca0e9ea7-abae-4a7c-aa74-51a17562b27a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-d6s4m\" (UID: \"ca0e9ea7-abae-4a7c-aa74-51a17562b27a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:48.752937 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.752917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-registry-tls\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.752984 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.752966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/110f73a1-6e71-4165-ae41-d297b4ce384e-image-registry-private-configuration\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.753077 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.753061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/110f73a1-6e71-4165-ae41-d297b4ce384e-installation-pull-secrets\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.760740 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.760703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhphr\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-kube-api-access-dhphr\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.761562 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.761536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/110f73a1-6e71-4165-ae41-d297b4ce384e-bound-sa-token\") pod \"image-registry-6977db9676-r82zm\" (UID: \"110f73a1-6e71-4165-ae41-d297b4ce384e\") " pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.762599 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.762560    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s88vl\" (UniqueName: \"kubernetes.io/projected/991511a5-ab50-4fc1-88ba-8eab5391ee95-kube-api-access-s88vl\") pod \"downloads-77c974ffcf-zct58\" (UID: \"991511a5-ab50-4fc1-88ba-8eab5391ee95\") " pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:11:48.851765 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.851639    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"
Aug 04 18:11:48.908284 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.908255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:48.913651 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.913556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:11:48.922126 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.922103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:48.928094 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:48.927891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"
Aug 04 18:11:49.006001 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.005934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm"]
Aug 04 18:11:49.011459 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:49.011422    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a1bb23c_a0e7_48cd_88ff_1bc1bd553eb3.slice/crio-fb4b86eff6dab8ccd805039b7d675d2b937933910314df0e47792ed5257d88c0 WatchSource:0}: Error finding container fb4b86eff6dab8ccd805039b7d675d2b937933910314df0e47792ed5257d88c0: Status 404 returned error can't find the container with id fb4b86eff6dab8ccd805039b7d675d2b937933910314df0e47792ed5257d88c0
Aug 04 18:11:49.087420 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.087383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-zct58"]
Aug 04 18:11:49.090733 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:49.090684    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991511a5_ab50_4fc1_88ba_8eab5391ee95.slice/crio-6f643429c82e383be33f6b7fb369c7c74155a2864f3114a6295f3706667ea3fe WatchSource:0}: Error finding container 6f643429c82e383be33f6b7fb369c7c74155a2864f3114a6295f3706667ea3fe: Status 404 returned error can't find the container with id 6f643429c82e383be33f6b7fb369c7c74155a2864f3114a6295f3706667ea3fe
Aug 04 18:11:49.132334 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.132251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m"]
Aug 04 18:11:49.135953 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:49.135916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0e9ea7_abae_4a7c_aa74_51a17562b27a.slice/crio-8336c30c6a209774ce34e9a0e68e57f0a9bffd02f885bd910774d1144f975c8a WatchSource:0}: Error finding container 8336c30c6a209774ce34e9a0e68e57f0a9bffd02f885bd910774d1144f975c8a: Status 404 returned error can't find the container with id 8336c30c6a209774ce34e9a0e68e57f0a9bffd02f885bd910774d1144f975c8a
Aug 04 18:11:49.321116 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.321083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"]
Aug 04 18:11:49.322135 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.322115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6977db9676-r82zm"]
Aug 04 18:11:49.325009 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:49.324985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf52470_6702_4d3e_9aee_1f246bd783c1.slice/crio-9d2cb7190e2d3bb98c1e33e74608cdaec3e5efbb0e3a9c042e11f2a380690bf8 WatchSource:0}: Error finding container 9d2cb7190e2d3bb98c1e33e74608cdaec3e5efbb0e3a9c042e11f2a380690bf8: Status 404 returned error can't find the container with id 9d2cb7190e2d3bb98c1e33e74608cdaec3e5efbb0e3a9c042e11f2a380690bf8
Aug 04 18:11:49.325607 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:49.325533    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110f73a1_6e71_4165_ae41_d297b4ce384e.slice/crio-c3518dbe8450d21a3e3929691eb2f5491d15350b33f1f7ce568af32c10a5d6a3 WatchSource:0}: Error finding container c3518dbe8450d21a3e3929691eb2f5491d15350b33f1f7ce568af32c10a5d6a3: Status 404 returned error can't find the container with id c3518dbe8450d21a3e3929691eb2f5491d15350b33f1f7ce568af32c10a5d6a3
Aug 04 18:11:49.452849 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.452808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m" event={"ID":"ca0e9ea7-abae-4a7c-aa74-51a17562b27a","Type":"ContainerStarted","Data":"8336c30c6a209774ce34e9a0e68e57f0a9bffd02f885bd910774d1144f975c8a"}
Aug 04 18:11:49.454452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.454422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6977db9676-r82zm" event={"ID":"110f73a1-6e71-4165-ae41-d297b4ce384e","Type":"ContainerStarted","Data":"28cee7fd21dba80072ef88d2a7d29014b225722c46fa969418cc638011aeac1b"}
Aug 04 18:11:49.454613 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.454474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6977db9676-r82zm" event={"ID":"110f73a1-6e71-4165-ae41-d297b4ce384e","Type":"ContainerStarted","Data":"c3518dbe8450d21a3e3929691eb2f5491d15350b33f1f7ce568af32c10a5d6a3"}
Aug 04 18:11:49.454613 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.454547    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:11:49.455858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.455830    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28" event={"ID":"0cf52470-6702-4d3e-9aee-1f246bd783c1","Type":"ContainerStarted","Data":"9d2cb7190e2d3bb98c1e33e74608cdaec3e5efbb0e3a9c042e11f2a380690bf8"}
Aug 04 18:11:49.457126 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.457094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm" event={"ID":"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3","Type":"ContainerStarted","Data":"fb4b86eff6dab8ccd805039b7d675d2b937933910314df0e47792ed5257d88c0"}
Aug 04 18:11:49.458218 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.458196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-zct58" event={"ID":"991511a5-ab50-4fc1-88ba-8eab5391ee95","Type":"ContainerStarted","Data":"6f643429c82e383be33f6b7fb369c7c74155a2864f3114a6295f3706667ea3fe"}
Aug 04 18:11:49.478830 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:49.478774    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6977db9676-r82zm" podStartSLOduration=1.478755394 podStartE2EDuration="1.478755394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:49.478095771 +0000 UTC m=+63.803198915" watchObservedRunningTime="2026-08-04 18:11:49.478755394 +0000 UTC m=+63.803858542"
Aug 04 18:11:50.432433 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:50.431787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l7wqs"
Aug 04 18:11:51.478236 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.478198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m" event={"ID":"ca0e9ea7-abae-4a7c-aa74-51a17562b27a","Type":"ContainerStarted","Data":"58e419cb6cd4c27bb74d4b0967c427386650b2749a9466365120bd915880496e"}
Aug 04 18:11:51.480280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.480246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28" event={"ID":"0cf52470-6702-4d3e-9aee-1f246bd783c1","Type":"ContainerStarted","Data":"bd5157a9ca61e9507088d304f3419a9cffe0f70dc33e47c6b98e506567308b67"}
Aug 04 18:11:51.480565 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.480542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:51.486446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.486420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28"
Aug 04 18:11:51.500571 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.500525    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-d6s4m" podStartSLOduration=1.540242345 podStartE2EDuration="3.500509965s" totalImagesPullingTime="1.96026762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:51.499372216 +0000 UTC m=+65.824475326" watchObservedRunningTime="2026-08-04 18:11:51.500509965 +0000 UTC m=+65.825613062"
Aug 04 18:11:51.758158 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.758054    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-gwd28" podStartSLOduration=1.984391987 podStartE2EDuration="3.758038102s" totalImagesPullingTime="1.773646115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:51.519756346 +0000 UTC m=+65.844859467" watchObservedRunningTime="2026-08-04 18:11:51.758038102 +0000 UTC m=+66.083141221"
Aug 04 18:11:51.759048 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.759029    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"]
Aug 04 18:11:51.825041 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.825006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"]
Aug 04 18:11:51.825227 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.825151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.828519 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.828428    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 18:11:51.828519 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.828454    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 18:11:51.829676 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.829476    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 18:11:51.829676 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.829533    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wflrq\""
Aug 04 18:11:51.829676 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.829608    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 18:11:51.829917 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.829775    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 18:11:51.881290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.881251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:51.881290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.881292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:51.881503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.881326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.881503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.881399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.881503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.881435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879px\" (UniqueName: \"kubernetes.io/projected/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-kube-api-access-879px\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.881503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.881471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.884351 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.884320    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 18:11:51.884571 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.884553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 18:11:51.895371 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.895328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b20b5f74-9033-4fd4-a1ba-e72aece50d92-original-pull-secret\") pod \"global-pull-secret-syncer-mwfzl\" (UID: \"b20b5f74-9033-4fd4-a1ba-e72aece50d92\") " pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:51.896049 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.896027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78459739-509b-47f0-a534-4fc07c936c59-metrics-certs\") pod \"network-metrics-daemon-mz44f\" (UID: \"78459739-509b-47f0-a534-4fc07c936c59\") " pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:51.982127 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.982084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.982312 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.982154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.982312 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.982200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:51.982312 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.982235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.982312 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.982269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879px\" (UniqueName: \"kubernetes.io/projected/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-kube-api-access-879px\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.982312 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:51.982293    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 04 18:11:51.982575 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:11:51.982360    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-tls podName:a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a nodeName:}" failed. No retries permitted until 2026-08-04 18:11:52.482340887 +0000 UTC m=+66.807443990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-5jbfl" (UID: "a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a") : secret "prometheus-operator-tls" not found
Aug 04 18:11:51.983276 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.983247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.984997 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.984975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.987021 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.987000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 18:11:51.994475 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.994444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-879px\" (UniqueName: \"kubernetes.io/projected/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-kube-api-access-879px\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:51.995822 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:51.995806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 18:11:52.006897 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.006871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxfx\" (UniqueName: \"kubernetes.io/projected/41042758-27f8-4f08-b044-a1695980021d-kube-api-access-mjxfx\") pod \"network-check-target-28xt9\" (UID: \"41042758-27f8-4f08-b044-a1695980021d\") " pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:52.170547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.170464    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kp5sr\""
Aug 04 18:11:52.174206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.174172    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mwfzl"
Aug 04 18:11:52.178347 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.178314    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:52.181409 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.181380    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wz6f8\""
Aug 04 18:11:52.188783 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.188758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mz44f"
Aug 04 18:11:52.486644 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.486609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:52.489493 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.489460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5jbfl\" (UID: \"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:52.699221 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.698039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-28xt9"]
Aug 04 18:11:52.716402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.716364    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mwfzl"]
Aug 04 18:11:52.735105 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.735072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mz44f"]
Aug 04 18:11:52.737531 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:52.737472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"
Aug 04 18:11:52.840460 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:52.840414    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41042758_27f8_4f08_b044_a1695980021d.slice/crio-2a3da3e98a643d47b803007a4b977f2edea865e66508cb99da0c74f5d23d9c0f WatchSource:0}: Error finding container 2a3da3e98a643d47b803007a4b977f2edea865e66508cb99da0c74f5d23d9c0f: Status 404 returned error can't find the container with id 2a3da3e98a643d47b803007a4b977f2edea865e66508cb99da0c74f5d23d9c0f
Aug 04 18:11:52.841000 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:52.840964    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20b5f74_9033_4fd4_a1ba_e72aece50d92.slice/crio-0227f3a0e7bb9e6495ae68f4051fbd524f00dff746ddb9b0d050543c7b4a9680 WatchSource:0}: Error finding container 0227f3a0e7bb9e6495ae68f4051fbd524f00dff746ddb9b0d050543c7b4a9680: Status 404 returned error can't find the container with id 0227f3a0e7bb9e6495ae68f4051fbd524f00dff746ddb9b0d050543c7b4a9680
Aug 04 18:11:52.841991 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:52.841960    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78459739_509b_47f0_a534_4fc07c936c59.slice/crio-e7a48d16437cee6c6cfa104b2be1c4463786b699021ce44c0e4f26b1a154bd1b WatchSource:0}: Error finding container e7a48d16437cee6c6cfa104b2be1c4463786b699021ce44c0e4f26b1a154bd1b: Status 404 returned error can't find the container with id e7a48d16437cee6c6cfa104b2be1c4463786b699021ce44c0e4f26b1a154bd1b
Aug 04 18:11:53.012942 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.012912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5jbfl"]
Aug 04 18:11:53.014436 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:53.014405    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0cb3d83_cffa_46c6_b208_8e6fdb55cf6a.slice/crio-6b46711df83b41a4a379e2c9155766f56beef5dd93f8dee9c539b36309f1219a WatchSource:0}: Error finding container 6b46711df83b41a4a379e2c9155766f56beef5dd93f8dee9c539b36309f1219a: Status 404 returned error can't find the container with id 6b46711df83b41a4a379e2c9155766f56beef5dd93f8dee9c539b36309f1219a
Aug 04 18:11:53.493206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.493137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm" event={"ID":"5a1bb23c-a0e7-48cd-88ff-1bc1bd553eb3","Type":"ContainerStarted","Data":"41c6e67b5abaa5ed0f169efb085dfa67d6e976a119ed8a54a5c439617b70521e"}
Aug 04 18:11:53.495060 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.494982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl" event={"ID":"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a","Type":"ContainerStarted","Data":"6b46711df83b41a4a379e2c9155766f56beef5dd93f8dee9c539b36309f1219a"}
Aug 04 18:11:53.496958 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.496917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mz44f" event={"ID":"78459739-509b-47f0-a534-4fc07c936c59","Type":"ContainerStarted","Data":"e7a48d16437cee6c6cfa104b2be1c4463786b699021ce44c0e4f26b1a154bd1b"}
Aug 04 18:11:53.498805 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.498712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-28xt9" event={"ID":"41042758-27f8-4f08-b044-a1695980021d","Type":"ContainerStarted","Data":"2a3da3e98a643d47b803007a4b977f2edea865e66508cb99da0c74f5d23d9c0f"}
Aug 04 18:11:53.500617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.500245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mwfzl" event={"ID":"b20b5f74-9033-4fd4-a1ba-e72aece50d92","Type":"ContainerStarted","Data":"0227f3a0e7bb9e6495ae68f4051fbd524f00dff746ddb9b0d050543c7b4a9680"}
Aug 04 18:11:53.521181 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:53.521017    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5484584548-f4rzm" podStartSLOduration=1.669736707 podStartE2EDuration="5.520992902s" totalImagesPullingTime="3.851256195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:53.518509968 +0000 UTC m=+67.843613089" watchObservedRunningTime="2026-08-04 18:11:53.520992902 +0000 UTC m=+67.846096026"
Aug 04 18:11:54.508474 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:54.508373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mz44f" event={"ID":"78459739-509b-47f0-a534-4fc07c936c59","Type":"ContainerStarted","Data":"f7e2cf8657ee57cefad2c282d1b745860faf1657d4c02b20d940de58249eab52"}
Aug 04 18:11:54.508474 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:54.508431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mz44f" event={"ID":"78459739-509b-47f0-a534-4fc07c936c59","Type":"ContainerStarted","Data":"d09ea5bcb86e347cecd22507d40b978b3d6cfc22580652529065ecef6b41aacb"}
Aug 04 18:11:54.537283 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:54.537106    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mz44f" podStartSLOduration=67.273187403 podStartE2EDuration="1m8.537075199s" totalImagesPullingTime="1.263887796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:54.52863251 +0000 UTC m=+68.853735632" watchObservedRunningTime="2026-08-04 18:11:54.537075199 +0000 UTC m=+68.862178319"
Aug 04 18:11:55.517832 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:55.517227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl" event={"ID":"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a","Type":"ContainerStarted","Data":"fd2ab1921031769dccd21d50c6dbc930589ecca096fa80fb3fedec8b91c92afd"}
Aug 04 18:11:55.517832 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:55.517339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl" event={"ID":"a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a","Type":"ContainerStarted","Data":"1cb2bfe4acb22fe12612e2a6d2887c12b8355b3321bbe630c2ad48358555a33c"}
Aug 04 18:11:57.435550 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.435487    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-5jbfl" podStartSLOduration=4.54609751 podStartE2EDuration="6.435464261s" totalImagesPullingTime="1.889366751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:55.539793785 +0000 UTC m=+69.864896906" watchObservedRunningTime="2026-08-04 18:11:57.435464261 +0000 UTC m=+71.760567382"
Aug 04 18:11:57.436099 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.436077    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t9s4p"]
Aug 04 18:11:57.438709 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.438683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.443574 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.442657    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wk8r4\""
Aug 04 18:11:57.443574 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.443027    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 18:11:57.443574 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.443204    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 18:11:57.443574 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.443427    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 18:11:57.531898 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.531849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24d1ee97-9b3f-4188-a4dc-d770b524956e-metrics-client-ca\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.531898 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.531906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-tls\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532129 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.531941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532129 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.531984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh57m\" (UniqueName: \"kubernetes.io/projected/24d1ee97-9b3f-4188-a4dc-d770b524956e-kube-api-access-sh57m\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532129 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.532045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532129 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.532113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-root\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532270 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.532133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-sys\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532270 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.532163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-textfile\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.532270 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.532190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-wtmp\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633353 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-wtmp\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24d1ee97-9b3f-4188-a4dc-d770b524956e-metrics-client-ca\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-tls\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh57m\" (UniqueName: \"kubernetes.io/projected/24d1ee97-9b3f-4188-a4dc-d770b524956e-kube-api-access-sh57m\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-wtmp\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633540 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-root\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633842 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-sys\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.633842 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-textfile\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.634017 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.633998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-textfile\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.634119 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.634071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-sys\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.634119 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.634083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24d1ee97-9b3f-4188-a4dc-d770b524956e-root\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.634337 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.634303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24d1ee97-9b3f-4188-a4dc-d770b524956e-metrics-client-ca\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.634452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.634341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.636562 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.636536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.636713 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.636690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d1ee97-9b3f-4188-a4dc-d770b524956e-node-exporter-tls\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.644249 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.644222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh57m\" (UniqueName: \"kubernetes.io/projected/24d1ee97-9b3f-4188-a4dc-d770b524956e-kube-api-access-sh57m\") pod \"node-exporter-t9s4p\" (UID: \"24d1ee97-9b3f-4188-a4dc-d770b524956e\") " pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:57.752326 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:57.752246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9s4p"
Aug 04 18:11:58.374118 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.374087    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:11:58.380824 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.380790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.384318 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.384275    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 18:11:58.396810 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.396781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 18:11:58.396810 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.396801    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xth4f\""
Aug 04 18:11:58.397086 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.396801    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 18:11:58.397086 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.396781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 18:11:58.397086 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.396933    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 18:11:58.397086 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.397041    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 18:11:58.397896 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.397876    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 18:11:58.398801 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.398781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 18:11:58.402413 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.402211    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 18:11:58.416585 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.416557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-web-config\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.440996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.441024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-out\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.441045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.441076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.441102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.441155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6bh\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-kube-api-access-6h6bh\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.441671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.441201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.542475 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.542438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.542654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.542483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.542654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.542530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.542654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.542564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.542654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.542603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-web-config\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.542654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.542630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544711 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-out\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544867 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544867 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6bh\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-kube-api-access-6h6bh\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.544980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.544963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.545290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.545229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.549766 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.548567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.549766 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.549125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.552590 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.552541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-out\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.552771 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.552740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.552895 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.552870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.552972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.552950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.553331 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.553311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.553652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.553632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-web-config\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.553817 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.553713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.553888 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.553830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-volume\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.554944 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.554917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.557135 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.557109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6bh\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-kube-api-access-6h6bh\") pod \"alertmanager-main-0\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:58.693566 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:58.693524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:11:59.106279 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.106259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:11:59.108859 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:11:59.108832    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb64e7da_aadb_40d9_b381_10d2ef22e40f.slice/crio-b187ae486ba5845b41723a866773116b936dbf56263e50741c0ffbc8bdd90ef1 WatchSource:0}: Error finding container b187ae486ba5845b41723a866773116b936dbf56263e50741c0ffbc8bdd90ef1: Status 404 returned error can't find the container with id b187ae486ba5845b41723a866773116b936dbf56263e50741c0ffbc8bdd90ef1
Aug 04 18:11:59.537052 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.537020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-28xt9" event={"ID":"41042758-27f8-4f08-b044-a1695980021d","Type":"ContainerStarted","Data":"246b426bf929d5ffff9625d3343c1e554678ebf9b486f40116e9a800834695b2"}
Aug 04 18:11:59.537505 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.537130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:11:59.538089 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.538068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"b187ae486ba5845b41723a866773116b936dbf56263e50741c0ffbc8bdd90ef1"}
Aug 04 18:11:59.539541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.539493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mwfzl" event={"ID":"b20b5f74-9033-4fd4-a1ba-e72aece50d92","Type":"ContainerStarted","Data":"0101faa4e6807a14a50a01284d767e29dab61a650d660e87b19c0b779df16330"}
Aug 04 18:11:59.540889 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.540866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9s4p" event={"ID":"24d1ee97-9b3f-4188-a4dc-d770b524956e","Type":"ContainerStarted","Data":"5d61ac0ab1e14d6bf166cccd7a51afe01e9d56a29b86cf72cece446b21004bf8"}
Aug 04 18:11:59.562364 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.562310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-28xt9" podStartSLOduration=67.484851922 podStartE2EDuration="1m13.562292606s" totalImagesPullingTime="6.077440684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:59.560965254 +0000 UTC m=+73.886068400" watchObservedRunningTime="2026-08-04 18:11:59.562292606 +0000 UTC m=+73.887395720"
Aug 04 18:11:59.582240 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:11:59.582180    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mwfzl" podStartSLOduration=67.49416991 podStartE2EDuration="1m13.582163586s" totalImagesPullingTime="6.087993676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:11:59.581807302 +0000 UTC m=+73.906910461" watchObservedRunningTime="2026-08-04 18:11:59.582163586 +0000 UTC m=+73.907266757"
Aug 04 18:12:00.264430 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.263749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5668775658-99ppw"]
Aug 04 18:12:00.267713 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.267686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.271292 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.271249    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 18:12:00.272144 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.271691    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 18:12:00.272144 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.271784    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 18:12:00.272144 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.271908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 18:12:00.272144 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.271994    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7fkbbabj650rt\""
Aug 04 18:12:00.272463 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.272271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zkjdr\""
Aug 04 18:12:00.272463 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.272393    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 18:12:00.292899 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.292863    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5668775658-99ppw"]
Aug 04 18:12:00.361332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-metrics-client-ca\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361502 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-grpc-tls\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361502 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361502 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-tls\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361502 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361677 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mp2v\" (UniqueName: \"kubernetes.io/projected/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-kube-api-access-4mp2v\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361677 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.361677 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.361620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.462907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.462958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mp2v\" (UniqueName: \"kubernetes.io/projected/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-kube-api-access-4mp2v\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.462985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.463009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.463046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-metrics-client-ca\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.463086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-grpc-tls\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.463137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.463995 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.463160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-tls\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.465274 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.465237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-metrics-client-ca\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.467016 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.466984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-grpc-tls\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.467121 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.467067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.467824 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.467795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.472430 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.472391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.475913 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.475883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mp2v\" (UniqueName: \"kubernetes.io/projected/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-kube-api-access-4mp2v\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.481652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.481621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.481809 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.481622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f-secret-thanos-querier-tls\") pod \"thanos-querier-5668775658-99ppw\" (UID: \"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f\") " pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.585053 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.584974    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:00.782311 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:00.782262    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5668775658-99ppw"]
Aug 04 18:12:00.805503 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:12:00.805472    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f42c5a0_e3ce_47eb_a1c1_a28ecb413e4f.slice/crio-52c055db32175e288483c0d5ccd63600d216e9d3d2e6987fe2a97eff25092903 WatchSource:0}: Error finding container 52c055db32175e288483c0d5ccd63600d216e9d3d2e6987fe2a97eff25092903: Status 404 returned error can't find the container with id 52c055db32175e288483c0d5ccd63600d216e9d3d2e6987fe2a97eff25092903
Aug 04 18:12:01.552637 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.552600    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="44fa72a0835435f50c57acdeacbf308e4de293cc73ce49a17433e0cbc0b48cd8" exitCode=0
Aug 04 18:12:01.552862 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.552705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"44fa72a0835435f50c57acdeacbf308e4de293cc73ce49a17433e0cbc0b48cd8"}
Aug 04 18:12:01.554298 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.554227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"52c055db32175e288483c0d5ccd63600d216e9d3d2e6987fe2a97eff25092903"}
Aug 04 18:12:01.556094 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.556071    2579 generic.go:356] "Generic (PLEG): container finished" podID="24d1ee97-9b3f-4188-a4dc-d770b524956e" containerID="f212cdc449fd6952efd1d1b5e05a8f0c6e3aa7f11f791c6e2a7e18aee222f4c0" exitCode=0
Aug 04 18:12:01.556213 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.556156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9s4p" event={"ID":"24d1ee97-9b3f-4188-a4dc-d770b524956e","Type":"ContainerDied","Data":"f212cdc449fd6952efd1d1b5e05a8f0c6e3aa7f11f791c6e2a7e18aee222f4c0"}
Aug 04 18:12:01.980873 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.980839    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"]
Aug 04 18:12:01.985493 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.985462    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:01.990586 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.990561    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 04 18:12:01.990759 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:01.990623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8bp6r\""
Aug 04 18:12:02.000084 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.000058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"]
Aug 04 18:12:02.079017 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.078981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l54z\" (UniqueName: \"kubernetes.io/projected/f7153f7d-dab3-4724-8cef-6fbacfcad93c-kube-api-access-4l54z\") pod \"monitoring-plugin-6dffbbd67-t7xvf\" (UID: \"f7153f7d-dab3-4724-8cef-6fbacfcad93c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.079186 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.079039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7153f7d-dab3-4724-8cef-6fbacfcad93c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-t7xvf\" (UID: \"f7153f7d-dab3-4724-8cef-6fbacfcad93c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.179992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.179957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l54z\" (UniqueName: \"kubernetes.io/projected/f7153f7d-dab3-4724-8cef-6fbacfcad93c-kube-api-access-4l54z\") pod \"monitoring-plugin-6dffbbd67-t7xvf\" (UID: \"f7153f7d-dab3-4724-8cef-6fbacfcad93c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.180191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.180006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7153f7d-dab3-4724-8cef-6fbacfcad93c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-t7xvf\" (UID: \"f7153f7d-dab3-4724-8cef-6fbacfcad93c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.183198 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.183167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f7153f7d-dab3-4724-8cef-6fbacfcad93c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-t7xvf\" (UID: \"f7153f7d-dab3-4724-8cef-6fbacfcad93c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.197478 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.197448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l54z\" (UniqueName: \"kubernetes.io/projected/f7153f7d-dab3-4724-8cef-6fbacfcad93c-kube-api-access-4l54z\") pod \"monitoring-plugin-6dffbbd67-t7xvf\" (UID: \"f7153f7d-dab3-4724-8cef-6fbacfcad93c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.300504 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.300417    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:02.566649 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.566568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9s4p" event={"ID":"24d1ee97-9b3f-4188-a4dc-d770b524956e","Type":"ContainerStarted","Data":"199928ca006e8e651b80c73d5edec757ef750ece7cc25669b8b13f3d0e1e9605"}
Aug 04 18:12:02.566828 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.566662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9s4p" event={"ID":"24d1ee97-9b3f-4188-a4dc-d770b524956e","Type":"ContainerStarted","Data":"e2703dd92e145f29ebcffbf745c0b299828c2236f09572a98359b314ecd6036b"}
Aug 04 18:12:02.606202 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:02.606142    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t9s4p" podStartSLOduration=3.857040235 podStartE2EDuration="5.606124135s" totalImagesPullingTime="1.661837108s" totalInitContainerRuntime="87.246792ms" isStatefulPod=true podCreationTimestamp="2026-08-04 18:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:02.605166509 +0000 UTC m=+76.930269642" watchObservedRunningTime="2026-08-04 18:12:02.606124135 +0000 UTC m=+76.931227293"
Aug 04 18:12:03.465952 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.465919    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:12:03.471072 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.471043    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.476403 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.476365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 18:12:03.476582 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.476365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 18:12:03.477743 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.477628    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 18:12:03.477743 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.477680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 18:12:03.477976 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.477951    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 18:12:03.478095 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478078    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sb7jt\""
Aug 04 18:12:03.478187 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 18:12:03.478294 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478255    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 18:12:03.478436 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478421    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6e0qhdcbq88ai\""
Aug 04 18:12:03.478635 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478620    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 18:12:03.478706 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478647    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 18:12:03.478832 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478813    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 18:12:03.478921 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.478814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 18:12:03.479101 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.479085    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 18:12:03.479157 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.479090    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 18:12:03.485405 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.485375    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 18:12:03.503558 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.503315    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 18:12:03.506455 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.506420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:12:03.592585 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592585 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-294d2\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-kube-api-access-294d2\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.592894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.592792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config-out\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593198 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593198 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593198 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593198 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593198 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-web-config\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.593791 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.593454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695012 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.694897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695200 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-294d2\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-kube-api-access-294d2\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config-out\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.695518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.696025 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.696025 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.695713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.696216 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.696189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.696900 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.696777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.698192 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.697289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.698582 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.698559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699061 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699166 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699408 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699478 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699478 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-web-config\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699572 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699572 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699857 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config-out\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.699943 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.699882    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.702526 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.702500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.702710 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.702689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.703971 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.702815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.703971 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.703215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.703971 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.703782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.704342 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.704317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.704547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.704505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-web-config\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.708235 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.708206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-294d2\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-kube-api-access-294d2\") pod \"prometheus-k8s-0\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:03.786320 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:03.786233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:10.434999 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.434956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:12:10.437255 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:12:10.437216    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552a4bbe_c3f3_417c_900e_9ec96f0a496d.slice/crio-bae86f9b191f0954a5cad26f442b13d98d3b562fa7bbcb461827b7eab73744d1 WatchSource:0}: Error finding container bae86f9b191f0954a5cad26f442b13d98d3b562fa7bbcb461827b7eab73744d1: Status 404 returned error can't find the container with id bae86f9b191f0954a5cad26f442b13d98d3b562fa7bbcb461827b7eab73744d1
Aug 04 18:12:10.441281 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.441255    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"]
Aug 04 18:12:10.446443 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:12:10.446394    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7153f7d_dab3_4724_8cef_6fbacfcad93c.slice/crio-d6d8a66c24e4af053d10c2e659921a03c5a7ded8418edb904fb76884e6b61c84 WatchSource:0}: Error finding container d6d8a66c24e4af053d10c2e659921a03c5a7ded8418edb904fb76884e6b61c84: Status 404 returned error can't find the container with id d6d8a66c24e4af053d10c2e659921a03c5a7ded8418edb904fb76884e6b61c84
Aug 04 18:12:10.474013 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.473977    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6977db9676-r82zm"
Aug 04 18:12:10.606034 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.605998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"98a71d2d50b12442c893ae558f4aef03c077455903d15c33840d19579da106b0"}
Aug 04 18:12:10.606193 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.606085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"c29e8fd875f30557bc4bab5a537a03e35619ea902009516a7b6b2f49b3dc0636"}
Aug 04 18:12:10.606193 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.606127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"0c611b5df5450241b9940ac4afc0ca8155a7e13f58ddc38022e318dca8c75207"}
Aug 04 18:12:10.608290 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.608259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf" event={"ID":"f7153f7d-dab3-4724-8cef-6fbacfcad93c","Type":"ContainerStarted","Data":"d6d8a66c24e4af053d10c2e659921a03c5a7ded8418edb904fb76884e6b61c84"}
Aug 04 18:12:10.610314 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.610283    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f" exitCode=0
Aug 04 18:12:10.610429 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.610412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f"}
Aug 04 18:12:10.610496 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.610477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"bae86f9b191f0954a5cad26f442b13d98d3b562fa7bbcb461827b7eab73744d1"}
Aug 04 18:12:10.613578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.613549    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-zct58" event={"ID":"991511a5-ab50-4fc1-88ba-8eab5391ee95","Type":"ContainerStarted","Data":"80a6fe66cd926358bff10b6b016dfdf6b909f48eb1dc83f58c99a7262cbef57b"}
Aug 04 18:12:10.614108 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.614059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:12:10.621356 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.621326    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-zct58"
Aug 04 18:12:10.688218 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:10.688144    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-zct58" podStartSLOduration=1.534198019 podStartE2EDuration="22.688127171s" totalImagesPullingTime="21.153929152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:10.685857262 +0000 UTC m=+85.010960384" watchObservedRunningTime="2026-08-04 18:12:10.688127171 +0000 UTC m=+85.013230291"
Aug 04 18:12:15.647939 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.647902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"d8734989b9d47fa5d8e7be03476af1a48c4312899d581bfd0a51895d341677fd"}
Aug 04 18:12:15.648444 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.648411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"1a8c1b045642f6e7371aa7b3972ac0bfcc132c1b5f1a0e45c31b71cfa66b6684"}
Aug 04 18:12:15.651525 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.651494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf" event={"ID":"f7153f7d-dab3-4724-8cef-6fbacfcad93c","Type":"ContainerStarted","Data":"0eaa7c0a7b019f58cd9bdf4d87ead288dc428b22d25a892c3746d0117e8f238a"}
Aug 04 18:12:15.654333 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.654305    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"9f0602d2e9a8fd67ca7895b72e97d0c423d661234f67c551fc089d569c60c30e"}
Aug 04 18:12:15.654457 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.654384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"e1ad5b17b592d631a7e43d30ac8ed0fd24b833b944257541b1ac9790be0b3856"}
Aug 04 18:12:15.667612 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.665787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:15.672872 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.672806    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf"
Aug 04 18:12:15.690993 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:15.690352    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-t7xvf" podStartSLOduration=10.026674472 podStartE2EDuration="14.690328717s" totalImagesPullingTime="4.663654245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:15.689521547 +0000 UTC m=+90.014624681" watchObservedRunningTime="2026-08-04 18:12:15.690328717 +0000 UTC m=+90.015431839"
Aug 04 18:12:16.664932 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.664850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"39ac2e5ece227da72ed86d84c92c590d468627dadb7a4c20250fd5efd8d65908"}
Aug 04 18:12:16.665533 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.665508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"9a2ae20d8455273afea6e7df0ab31965c92244bc79bc73bf2c9ea782d275a50e"}
Aug 04 18:12:16.665703 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.665686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"ba26dcaab91c4b673fdd1fb6c702fbc72e4e17ff22ca1aec72bd327a1da14142"}
Aug 04 18:12:16.665929 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.665903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerStarted","Data":"e077041fe0cf9d0761391ab9cd695bb474cc68235639ecbb7fdd7a38f7179e6e"}
Aug 04 18:12:16.669013 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.668983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" event={"ID":"5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f","Type":"ContainerStarted","Data":"dcf0371586e0e59d26f83d9360f623a4c7e471dfcf5c8ce6c2c7e3c5805cf966"}
Aug 04 18:12:16.669236 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.669214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:16.674349 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.674320    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf"}
Aug 04 18:12:16.674492 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.674392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd"}
Aug 04 18:12:16.674492 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.674434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b"}
Aug 04 18:12:16.674492 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.674471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa"}
Aug 04 18:12:16.674646 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.674509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200"}
Aug 04 18:12:16.674646 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.674546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerStarted","Data":"c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced"}
Aug 04 18:12:16.676011 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.675988    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5668775658-99ppw"
Aug 04 18:12:16.710710 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.710608    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.592276557 podStartE2EDuration="18.710585676s" totalImagesPullingTime="15.098144945s" totalInitContainerRuntime="20.164174ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:11:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:16.707675628 +0000 UTC m=+91.032778751" watchObservedRunningTime="2026-08-04 18:12:16.710585676 +0000 UTC m=+91.035688796"
Aug 04 18:12:16.747908 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.747853    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.814877752 podStartE2EDuration="13.747834227s" totalImagesPullingTime="4.903346172s" totalInitContainerRuntime="29.610303ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:16.745542496 +0000 UTC m=+91.070645640" watchObservedRunningTime="2026-08-04 18:12:16.747834227 +0000 UTC m=+91.072937325"
Aug 04 18:12:16.773851 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:16.773794    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5668775658-99ppw" podStartSLOduration=2.73044141 podStartE2EDuration="16.773777092s" totalImagesPullingTime="14.043335682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:12:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:16.771987217 +0000 UTC m=+91.097090377" watchObservedRunningTime="2026-08-04 18:12:16.773777092 +0000 UTC m=+91.098880212"
Aug 04 18:12:18.787535 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:18.787500    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:12:30.549823 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:12:30.549795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-28xt9"
Aug 04 18:13:03.787093 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:03.787040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:03.808445 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:03.808419    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:03.881781 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:03.881754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:17.727453 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727415    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:13:17.727903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727768    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="alertmanager" containerID="cri-o://e1ad5b17b592d631a7e43d30ac8ed0fd24b833b944257541b1ac9790be0b3856" gracePeriod=120
Aug 04 18:13:17.727903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727810    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-metric" containerID="cri-o://9a2ae20d8455273afea6e7df0ab31965c92244bc79bc73bf2c9ea782d275a50e" gracePeriod=120
Aug 04 18:13:17.728006 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727869    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="prom-label-proxy" containerID="cri-o://39ac2e5ece227da72ed86d84c92c590d468627dadb7a4c20250fd5efd8d65908" gracePeriod=120
Aug 04 18:13:17.728006 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727885    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-web" containerID="cri-o://e077041fe0cf9d0761391ab9cd695bb474cc68235639ecbb7fdd7a38f7179e6e" gracePeriod=120
Aug 04 18:13:17.728006 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727882    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy" containerID="cri-o://ba26dcaab91c4b673fdd1fb6c702fbc72e4e17ff22ca1aec72bd327a1da14142" gracePeriod=120
Aug 04 18:13:17.728148 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.727919    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="config-reloader" containerID="cri-o://9f0602d2e9a8fd67ca7895b72e97d0c423d661234f67c551fc089d569c60c30e" gracePeriod=120
Aug 04 18:13:17.922977 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.922947    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="39ac2e5ece227da72ed86d84c92c590d468627dadb7a4c20250fd5efd8d65908" exitCode=0
Aug 04 18:13:17.922977 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.922972    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="ba26dcaab91c4b673fdd1fb6c702fbc72e4e17ff22ca1aec72bd327a1da14142" exitCode=0
Aug 04 18:13:17.922977 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.922979    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="9f0602d2e9a8fd67ca7895b72e97d0c423d661234f67c551fc089d569c60c30e" exitCode=0
Aug 04 18:13:17.922977 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.922985    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="e1ad5b17b592d631a7e43d30ac8ed0fd24b833b944257541b1ac9790be0b3856" exitCode=0
Aug 04 18:13:17.923225 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.923015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"39ac2e5ece227da72ed86d84c92c590d468627dadb7a4c20250fd5efd8d65908"}
Aug 04 18:13:17.923225 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.923081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"ba26dcaab91c4b673fdd1fb6c702fbc72e4e17ff22ca1aec72bd327a1da14142"}
Aug 04 18:13:17.923225 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.923112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"9f0602d2e9a8fd67ca7895b72e97d0c423d661234f67c551fc089d569c60c30e"}
Aug 04 18:13:17.923225 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:17.923141    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"e1ad5b17b592d631a7e43d30ac8ed0fd24b833b944257541b1ac9790be0b3856"}
Aug 04 18:13:18.930815 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:18.930785    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="9a2ae20d8455273afea6e7df0ab31965c92244bc79bc73bf2c9ea782d275a50e" exitCode=0
Aug 04 18:13:18.930815 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:18.930809    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerID="e077041fe0cf9d0761391ab9cd695bb474cc68235639ecbb7fdd7a38f7179e6e" exitCode=0
Aug 04 18:13:18.931197 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:18.930862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"9a2ae20d8455273afea6e7df0ab31965c92244bc79bc73bf2c9ea782d275a50e"}
Aug 04 18:13:18.931197 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:18.930960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"e077041fe0cf9d0761391ab9cd695bb474cc68235639ecbb7fdd7a38f7179e6e"}
Aug 04 18:13:18.977518 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:18.977493    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:19.075223 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075138    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-trusted-ca-bundle\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075223 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075180    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-cluster-tls-config\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075223 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075201    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-metrics-client-ca\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075223 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075221    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h6bh\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-kube-api-access-6h6bh\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-main-db\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-web\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075368    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-web-config\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075426    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-out\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-main-tls\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075492    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-volume\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.075554 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075527    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-tls-assets\") pod \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\" (UID: \"bb64e7da-aadb-40d9-b381-10d2ef22e40f\") "
Aug 04 18:13:19.076022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075553    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:19.076022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075596    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:19.076022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075646    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:19.076022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075848    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.076022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075871    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb64e7da-aadb-40d9-b381-10d2ef22e40f-metrics-client-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.076022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.075886    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-alertmanager-main-db\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.078919 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.078882    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.079054 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.078937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-out" (OuterVolumeSpecName: "config-out") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:19.079391 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.079357    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.079962 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.079936    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-kube-api-access-6h6bh" (OuterVolumeSpecName: "kube-api-access-6h6bh") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "kube-api-access-6h6bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:19.080062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.079949    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.080062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.079994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:19.080062 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.080015    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-volume" (OuterVolumeSpecName: "config-volume") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.080233 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.080112    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.084184 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.084151    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.091555 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.091520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-web-config" (OuterVolumeSpecName: "web-config") pod "bb64e7da-aadb-40d9-b381-10d2ef22e40f" (UID: "bb64e7da-aadb-40d9-b381-10d2ef22e40f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:19.176596 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176532    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-web-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176596 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176587    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-out\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176596 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176602    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-main-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176596 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176614    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-config-volume\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176915 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176627    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-tls-assets\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176915 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176638    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-cluster-tls-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176915 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176649    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h6bh\" (UniqueName: \"kubernetes.io/projected/bb64e7da-aadb-40d9-b381-10d2ef22e40f-kube-api-access-6h6bh\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176915 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176662    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176915 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176676    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.176915 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.176689    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb64e7da-aadb-40d9-b381-10d2ef22e40f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:19.938335 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.938311    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:19.938708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.938308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bb64e7da-aadb-40d9-b381-10d2ef22e40f","Type":"ContainerDied","Data":"b187ae486ba5845b41723a866773116b936dbf56263e50741c0ffbc8bdd90ef1"}
Aug 04 18:13:19.938708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.938456    2579 scope.go:117] "RemoveContainer" containerID="39ac2e5ece227da72ed86d84c92c590d468627dadb7a4c20250fd5efd8d65908"
Aug 04 18:13:19.947297 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.947278    2579 scope.go:117] "RemoveContainer" containerID="9a2ae20d8455273afea6e7df0ab31965c92244bc79bc73bf2c9ea782d275a50e"
Aug 04 18:13:19.954945 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.954926    2579 scope.go:117] "RemoveContainer" containerID="ba26dcaab91c4b673fdd1fb6c702fbc72e4e17ff22ca1aec72bd327a1da14142"
Aug 04 18:13:19.962124 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.962100    2579 scope.go:117] "RemoveContainer" containerID="e077041fe0cf9d0761391ab9cd695bb474cc68235639ecbb7fdd7a38f7179e6e"
Aug 04 18:13:19.965376 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.965346    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:13:19.970956 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.970935    2579 scope.go:117] "RemoveContainer" containerID="9f0602d2e9a8fd67ca7895b72e97d0c423d661234f67c551fc089d569c60c30e"
Aug 04 18:13:19.971532 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.971487    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:13:19.979150 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.979133    2579 scope.go:117] "RemoveContainer" containerID="e1ad5b17b592d631a7e43d30ac8ed0fd24b833b944257541b1ac9790be0b3856"
Aug 04 18:13:19.986801 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:19.986781    2579 scope.go:117] "RemoveContainer" containerID="44fa72a0835435f50c57acdeacbf308e4de293cc73ce49a17433e0cbc0b48cd8"
Aug 04 18:13:20.002946 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.002916    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:13:20.003208 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003196    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="init-config-reloader"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003209    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="init-config-reloader"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-metric"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003226    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-metric"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003235    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003240    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003249    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="config-reloader"
Aug 04 18:13:20.003253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003254    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="config-reloader"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003261    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="alertmanager"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003266    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="alertmanager"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003272    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-web"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003276    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-web"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003284    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="prom-label-proxy"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003289    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="prom-label-proxy"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003334    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-web"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003343    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="alertmanager"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003348    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="config-reloader"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003355    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy-metric"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003360    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="prom-label-proxy"
Aug 04 18:13:20.003452 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.003367    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" containerName="kube-rbac-proxy"
Aug 04 18:13:20.009534 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.009394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.012704 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.012683    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 18:13:20.013181 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.013162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 18:13:20.013280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.013162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 18:13:20.013280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.013165    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xth4f\""
Aug 04 18:13:20.013642 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.013620    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 18:13:20.014197 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.014175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 18:13:20.014328 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.014251    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 18:13:20.014328 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.014260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 18:13:20.014328 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.014260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 18:13:20.018635 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.018618    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 18:13:20.033252 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.033224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:13:20.083280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh42h\" (UniqueName: \"kubernetes.io/projected/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-kube-api-access-hh42h\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-config-out\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-web-config\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.083817 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.083561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.161483 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.161449    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb64e7da-aadb-40d9-b381-10d2ef22e40f" path="/var/lib/kubelet/pods/bb64e7da-aadb-40d9-b381-10d2ef22e40f/volumes"
Aug 04 18:13:20.184357 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184424 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184424 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184508 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184508 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184508 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh42h\" (UniqueName: \"kubernetes.io/projected/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-kube-api-access-hh42h\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-config-out\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-web-config\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184935 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.184935 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.185093 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.184980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.186101 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.186071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.187745 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.187454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.187745 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.187666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.187745 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.187666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.187968 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.187868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.188183 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.188107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.188416 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.188394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.188572 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.188552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.188675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.188655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-config-out\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.188972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.188951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-web-config\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.190040 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.190012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.199275 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.199247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh42h\" (UniqueName: \"kubernetes.io/projected/62bbe98f-3acb-478c-8e58-58bdebc1f7e8-kube-api-access-hh42h\") pod \"alertmanager-main-0\" (UID: \"62bbe98f-3acb-478c-8e58-58bdebc1f7e8\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.320551 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.320501    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 18:13:20.472213 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.472175    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 18:13:20.473896 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:13:20.473867    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bbe98f_3acb_478c_8e58_58bdebc1f7e8.slice/crio-fdf781a2fc43ee87a4ac8230749dc188521a10a4d9ff2a319c4aa040ee28aee4 WatchSource:0}: Error finding container fdf781a2fc43ee87a4ac8230749dc188521a10a4d9ff2a319c4aa040ee28aee4: Status 404 returned error can't find the container with id fdf781a2fc43ee87a4ac8230749dc188521a10a4d9ff2a319c4aa040ee28aee4
Aug 04 18:13:20.945067 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.945034    2579 generic.go:356] "Generic (PLEG): container finished" podID="62bbe98f-3acb-478c-8e58-58bdebc1f7e8" containerID="5fe9827545c04182fe2901fba5585909707dcd2c46fda43cc374f72ca0781eac" exitCode=0
Aug 04 18:13:20.945543 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.945079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerDied","Data":"5fe9827545c04182fe2901fba5585909707dcd2c46fda43cc374f72ca0781eac"}
Aug 04 18:13:20.945543 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:20.945144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"fdf781a2fc43ee87a4ac8230749dc188521a10a4d9ff2a319c4aa040ee28aee4"}
Aug 04 18:13:21.955189 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.955156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"a988dceef0a7ae29be86875af212c256df0a34f899370792fa8cdd3ed19b8cd3"}
Aug 04 18:13:21.955576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.955225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"292868efad8643c3a2867906ade7cda934ae1b952b51f57bf4e04965fb76d6af"}
Aug 04 18:13:21.955576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.955260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"d19463cf047af931f2e0073415823c053b20351cb9c016b039909c279546db46"}
Aug 04 18:13:21.955576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.955299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"ba935c4479bccc83e6b8ae84f9c34dd588d7ef4c89bbb918a0e5f805450aa4f4"}
Aug 04 18:13:21.955576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.955329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"2a4a59cdfe44a93ff0069da603de8b9a1c18cfaedf4f858c3b069a4a95ccacbf"}
Aug 04 18:13:21.955576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.955356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62bbe98f-3acb-478c-8e58-58bdebc1f7e8","Type":"ContainerStarted","Data":"704beeacf15bcd42f18f2b8733bfb8f33de574c5a4627f610847d655f40c041b"}
Aug 04 18:13:21.982031 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.981988    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:13:21.982380 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.982349    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="prometheus" containerID="cri-o://c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced" gracePeriod=600
Aug 04 18:13:21.982380 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.982358    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="thanos-sidecar" containerID="cri-o://a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa" gracePeriod=600
Aug 04 18:13:21.982380 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.982374    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="config-reloader" containerID="cri-o://fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200" gracePeriod=600
Aug 04 18:13:21.982617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.982389    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf" gracePeriod=600
Aug 04 18:13:21.982617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.982357    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy" containerID="cri-o://a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd" gracePeriod=600
Aug 04 18:13:21.982617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:21.982361    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-web" containerID="cri-o://c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b" gracePeriod=600
Aug 04 18:13:22.003278 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.003211    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.985726761 podStartE2EDuration="3.003189905s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.463144ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:13:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:13:22.000679404 +0000 UTC m=+156.325782547" watchObservedRunningTime="2026-08-04 18:13:22.003189905 +0000 UTC m=+156.328293025"
Aug 04 18:13:22.962391 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962350    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf" exitCode=0
Aug 04 18:13:22.962391 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962380    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd" exitCode=0
Aug 04 18:13:22.962391 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962389    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa" exitCode=0
Aug 04 18:13:22.962391 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962398    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200" exitCode=0
Aug 04 18:13:22.962998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962406    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced" exitCode=0
Aug 04 18:13:22.962998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf"}
Aug 04 18:13:22.962998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd"}
Aug 04 18:13:22.962998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa"}
Aug 04 18:13:22.962998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200"}
Aug 04 18:13:22.962998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:22.962557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced"}
Aug 04 18:13:23.226653 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.226629    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:23.310809 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.310778    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-metrics-client-certs\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.310830    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-1\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.310847    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-grpc-tls\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.310874    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-0\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.310990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-2\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311035    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-trusted-ca-bundle\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-metrics-client-ca\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311145    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-tls-assets\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311211    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-serving-certs-ca-bundle\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311245    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311241    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.311402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311270    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-thanos-prometheus-http-client-file\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-kubelet-serving-ca-bundle\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311388    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-web-config\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311408    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311417    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-db\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config-out\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311506    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-kube-rbac-proxy\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311550    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-294d2\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-kube-api-access-294d2\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.311883 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.311694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-tls\") pod \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\" (UID: \"552a4bbe-c3f3-417c-900e-9ec96f0a496d\") "
Aug 04 18:13:23.312229 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.312182    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.312229 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.312203    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.312319 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.312233    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.312879 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.312852    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.313164 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.312887    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:23.313279 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.312587    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.313375 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.313202    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.314266 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.314052    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.315802 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.315763    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.315905 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.315846    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.317025 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.316983    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:13:23.317202 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.317134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.317202 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.317180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.317519 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.317500    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config" (OuterVolumeSpecName: "config") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.317688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.317671    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.317870 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.317852    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:23.318397 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.318376    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-kube-api-access-294d2" (OuterVolumeSpecName: "kube-api-access-294d2") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "kube-api-access-294d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:13:23.318557 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.318530    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.318616 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.318540    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config-out" (OuterVolumeSpecName: "config-out") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:13:23.329496 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.329459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-web-config" (OuterVolumeSpecName: "web-config") pod "552a4bbe-c3f3-417c-900e-9ec96f0a496d" (UID: "552a4bbe-c3f3-417c-900e-9ec96f0a496d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413026    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config-out\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413061    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-kube-rbac-proxy\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413072    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413082    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-294d2\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-kube-api-access-294d2\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413091    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413100    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-metrics-client-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413108    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-grpc-tls\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413115    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413123    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413131    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413140    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-metrics-client-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413149    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552a4bbe-c3f3-417c-900e-9ec96f0a496d-tls-assets\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413157    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413167    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413176    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413184    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552a4bbe-c3f3-417c-900e-9ec96f0a496d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413192    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552a4bbe-c3f3-417c-900e-9ec96f0a496d-web-config\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.413378 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.413200    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/552a4bbe-c3f3-417c-900e-9ec96f0a496d-prometheus-k8s-db\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:13:23.969246 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.969213    2579 generic.go:356] "Generic (PLEG): container finished" podID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerID="c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b" exitCode=0
Aug 04 18:13:23.969689 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.969291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b"}
Aug 04 18:13:23.969689 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.969305    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:23.969689 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.969360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"552a4bbe-c3f3-417c-900e-9ec96f0a496d","Type":"ContainerDied","Data":"bae86f9b191f0954a5cad26f442b13d98d3b562fa7bbcb461827b7eab73744d1"}
Aug 04 18:13:23.969689 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.969395    2579 scope.go:117] "RemoveContainer" containerID="24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf"
Aug 04 18:13:23.977323 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.977157    2579 scope.go:117] "RemoveContainer" containerID="a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd"
Aug 04 18:13:23.986106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.986084    2579 scope.go:117] "RemoveContainer" containerID="c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b"
Aug 04 18:13:23.993376 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.993354    2579 scope.go:117] "RemoveContainer" containerID="a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa"
Aug 04 18:13:23.999480 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:23.999452    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:13:24.001919 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.001898    2579 scope.go:117] "RemoveContainer" containerID="fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200"
Aug 04 18:13:24.003353 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.003335    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:13:24.009417 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.009401    2579 scope.go:117] "RemoveContainer" containerID="c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced"
Aug 04 18:13:24.017108 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.017077    2579 scope.go:117] "RemoveContainer" containerID="726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f"
Aug 04 18:13:24.024514 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.024491    2579 scope.go:117] "RemoveContainer" containerID="24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf"
Aug 04 18:13:24.024826 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.024803    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf\": container with ID starting with 24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf not found: ID does not exist" containerID="24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf"
Aug 04 18:13:24.024903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.024837    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf"} err="failed to get container status \"24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf\": rpc error: code = NotFound desc = could not find container \"24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf\": container with ID starting with 24b46afd225f65f469c2c2cbcab20f5849d1ceba47c83b3e57b7066b407736cf not found: ID does not exist"
Aug 04 18:13:24.024903 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.024872    2579 scope.go:117] "RemoveContainer" containerID="a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd"
Aug 04 18:13:24.025118 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.025102    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd\": container with ID starting with a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd not found: ID does not exist" containerID="a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd"
Aug 04 18:13:24.025159 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025121    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd"} err="failed to get container status \"a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd\": rpc error: code = NotFound desc = could not find container \"a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd\": container with ID starting with a467044a83cfe4af2812c902215bef74a40b75f095582e5a3024d3b978fc68bd not found: ID does not exist"
Aug 04 18:13:24.025159 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025133    2579 scope.go:117] "RemoveContainer" containerID="c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b"
Aug 04 18:13:24.025376 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.025360    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b\": container with ID starting with c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b not found: ID does not exist" containerID="c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b"
Aug 04 18:13:24.025425 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025378    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b"} err="failed to get container status \"c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b\": rpc error: code = NotFound desc = could not find container \"c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b\": container with ID starting with c6344f0dbc255b8c059764040da318fa2ad1a827664ae5d25ab6f56d6a52222b not found: ID does not exist"
Aug 04 18:13:24.025425 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025390    2579 scope.go:117] "RemoveContainer" containerID="a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa"
Aug 04 18:13:24.025623 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.025609    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa\": container with ID starting with a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa not found: ID does not exist" containerID="a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa"
Aug 04 18:13:24.025671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025628    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa"} err="failed to get container status \"a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa\": rpc error: code = NotFound desc = could not find container \"a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa\": container with ID starting with a325dff312dc605188313dbe40679dff03830b4f8629e954a4e319b97dae01aa not found: ID does not exist"
Aug 04 18:13:24.025671 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025642    2579 scope.go:117] "RemoveContainer" containerID="fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200"
Aug 04 18:13:24.025957 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.025940    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200\": container with ID starting with fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200 not found: ID does not exist" containerID="fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200"
Aug 04 18:13:24.026005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025961    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200"} err="failed to get container status \"fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200\": rpc error: code = NotFound desc = could not find container \"fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200\": container with ID starting with fac5a8abf83690a320ec33b0f231f19f434c055674abd403f753fa737978c200 not found: ID does not exist"
Aug 04 18:13:24.026005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.025982    2579 scope.go:117] "RemoveContainer" containerID="c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced"
Aug 04 18:13:24.026206 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.026192    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced\": container with ID starting with c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced not found: ID does not exist" containerID="c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced"
Aug 04 18:13:24.026248 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.026209    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced"} err="failed to get container status \"c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced\": rpc error: code = NotFound desc = could not find container \"c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced\": container with ID starting with c3c83bd802dbe9d1618d80918d8da33fd50571bbca39f2fd9847f0dda2436ced not found: ID does not exist"
Aug 04 18:13:24.026248 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.026221    2579 scope.go:117] "RemoveContainer" containerID="726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f"
Aug 04 18:13:24.026419 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:13:24.026402    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f\": container with ID starting with 726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f not found: ID does not exist" containerID="726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f"
Aug 04 18:13:24.026455 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.026425    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f"} err="failed to get container status \"726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f\": rpc error: code = NotFound desc = could not find container \"726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f\": container with ID starting with 726fa6ab00e297e787f9c2d40c559e07a5b549555c3df5c73f441c09dcd3481f not found: ID does not exist"
Aug 04 18:13:24.057078 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057044    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:13:24.057344 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057332    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-thanos"
Aug 04 18:13:24.057383 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057346    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-thanos"
Aug 04 18:13:24.057383 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057364    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy"
Aug 04 18:13:24.057383 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057369    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy"
Aug 04 18:13:24.057383 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057376    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="config-reloader"
Aug 04 18:13:24.057383 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057381    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="config-reloader"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057390    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-web"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057395    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-web"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057402    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="init-config-reloader"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057407    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="init-config-reloader"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057415    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="prometheus"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057420    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="prometheus"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057426    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="thanos-sidecar"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057432    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="thanos-sidecar"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057498    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="config-reloader"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057506    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-web"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057511    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="thanos-sidecar"
Aug 04 18:13:24.057515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057518    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy"
Aug 04 18:13:24.057895 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057527    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="prometheus"
Aug 04 18:13:24.057895 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.057532    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" containerName="kube-rbac-proxy-thanos"
Aug 04 18:13:24.061430 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.061412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.067390 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.067317    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 18:13:24.067529 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.067400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 18:13:24.067608 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.067572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 18:13:24.068035 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.068013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 18:13:24.068150 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.068075    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 18:13:24.068633 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.068569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 18:13:24.068837 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.068816    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 18:13:24.071506 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071486    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 18:13:24.071654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071576    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 18:13:24.071654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071585    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 18:13:24.071654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6e0qhdcbq88ai\""
Aug 04 18:13:24.071892 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071790    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 18:13:24.071952 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071926    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 18:13:24.072009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.071927    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 18:13:24.072071 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.072056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sb7jt\""
Aug 04 18:13:24.074115 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.074093    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 18:13:24.079233 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.079212    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 18:13:24.091305 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.091277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:13:24.117974 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.117928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.117974 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.117975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.117994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3faaad7-5def-4bf1-9800-89748589ee9d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3faaad7-5def-4bf1-9800-89748589ee9d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx6lv\" (UniqueName: \"kubernetes.io/projected/d3faaad7-5def-4bf1-9800-89748589ee9d-kube-api-access-fx6lv\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118528 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118528 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118528 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118528 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-config\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118528 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.118666 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.118556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.161065 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.161031    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552a4bbe-c3f3-417c-900e-9ec96f0a496d" path="/var/lib/kubelet/pods/552a4bbe-c3f3-417c-900e-9ec96f0a496d/volumes"
Aug 04 18:13:24.219687 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.219656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-config\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.219850 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.219695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.219850 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.219745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.219952 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.219924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.219994 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.219979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220040 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220075 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220126 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3faaad7-5def-4bf1-9800-89748589ee9d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3faaad7-5def-4bf1-9800-89748589ee9d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx6lv\" (UniqueName: \"kubernetes.io/projected/d3faaad7-5def-4bf1-9800-89748589ee9d-kube-api-access-fx6lv\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.220848 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221427 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221427 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.220889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221427 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.221029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221427 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.221059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221427 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.221159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221779 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.221753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.221860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.221829    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.223387 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.223093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-config\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.223387 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.223093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.223387 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.223263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.223387 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.223301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.224194 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.223843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.224670 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.224624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.225089 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.225062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.225275 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.225249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3faaad7-5def-4bf1-9800-89748589ee9d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.225381 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.225321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d3faaad7-5def-4bf1-9800-89748589ee9d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.225775 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.225749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3faaad7-5def-4bf1-9800-89748589ee9d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.226068 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.226049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.226106 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.226076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.226440 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.226420    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.226690 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.226674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d3faaad7-5def-4bf1-9800-89748589ee9d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.234205 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.234179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx6lv\" (UniqueName: \"kubernetes.io/projected/d3faaad7-5def-4bf1-9800-89748589ee9d-kube-api-access-fx6lv\") pod \"prometheus-k8s-0\" (UID: \"d3faaad7-5def-4bf1-9800-89748589ee9d\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.372442 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.372353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:13:24.532162 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.532131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 18:13:24.532875 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:13:24.532853    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3faaad7_5def_4bf1_9800_89748589ee9d.slice/crio-4f271e366d8c7201c2e62338087ba3c01fc7e4b556b7f4723bc9e42e6f955986 WatchSource:0}: Error finding container 4f271e366d8c7201c2e62338087ba3c01fc7e4b556b7f4723bc9e42e6f955986: Status 404 returned error can't find the container with id 4f271e366d8c7201c2e62338087ba3c01fc7e4b556b7f4723bc9e42e6f955986
Aug 04 18:13:24.976773 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.976737    2579 generic.go:356] "Generic (PLEG): container finished" podID="d3faaad7-5def-4bf1-9800-89748589ee9d" containerID="a96ebebee1809e69c188d85f0ff1e8bfbd1d98c5521027c0bcc96b31037ad8c3" exitCode=0
Aug 04 18:13:24.977154 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.976829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerDied","Data":"a96ebebee1809e69c188d85f0ff1e8bfbd1d98c5521027c0bcc96b31037ad8c3"}
Aug 04 18:13:24.977154 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:24.976924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"4f271e366d8c7201c2e62338087ba3c01fc7e4b556b7f4723bc9e42e6f955986"}
Aug 04 18:13:25.984571 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:25.984535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"49b732f4cfee5114ab06a3205ab1912d87fb167bfe9c25e140af835b9bf21b50"}
Aug 04 18:13:25.985060 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:25.984608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"23b14bafbb6aa7e7386e62b52bcf2dd0ab89ab89fab6c4722219efa1ebb67170"}
Aug 04 18:13:25.985060 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:25.984654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"636f1b5a066502132e64005391a464e02d8fc3beac761eb8ffed810dcc804e01"}
Aug 04 18:13:25.985060 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:25.984696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"b8805215da38e8fd07e455dae4c99bfe2a288e1ac1fb5e6c9d6ec1c365b08dfb"}
Aug 04 18:13:25.985060 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:25.984762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"64716b5383c66794ff29db0647b9bc45e7739c1d066def40db2b7b67da03398d"}
Aug 04 18:13:25.985060 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:25.984801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d3faaad7-5def-4bf1-9800-89748589ee9d","Type":"ContainerStarted","Data":"b61ebba327d610105dc2cbc0f021df0a8d9388816d1630a8f5fcbff7947f9d31"}
Aug 04 18:13:26.017184 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:26.017130    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9938301200000002 podStartE2EDuration="2.017113076s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.282956ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:13:26.016495645 +0000 UTC m=+160.341598764" watchObservedRunningTime="2026-08-04 18:13:26.017113076 +0000 UTC m=+160.342216196"
Aug 04 18:13:29.373154 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:13:29.373109    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:14:24.373534 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:14:24.373498    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:14:24.389972 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:14:24.389945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:14:25.230553 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:14:25.230526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 18:15:46.073761 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:15:46.073705    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:15:46.078800 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:15:46.078777    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:15:46.079003 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:15:46.078988    2579 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 18:17:00.050058 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.049971    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"]
Aug 04 18:17:00.053742 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.053691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.058272 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.058242    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 18:17:00.058527 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.058306    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 18:17:00.058527 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.058306    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xpz5v\""
Aug 04 18:17:00.058747 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.058321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 18:17:00.058747 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.058324    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 18:17:00.058747 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.058327    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 18:17:00.064894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.064866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"]
Aug 04 18:17:00.142337 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.142300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be68e9eb-7477-4776-a9e0-ecc42e30b520-metrics-cert\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.142337 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.142336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be68e9eb-7477-4776-a9e0-ecc42e30b520-manager-config\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.142337 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.142357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtwk\" (UniqueName: \"kubernetes.io/projected/be68e9eb-7477-4776-a9e0-ecc42e30b520-kube-api-access-wrtwk\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.142593 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.142486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be68e9eb-7477-4776-a9e0-ecc42e30b520-cert\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.243234 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.243202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be68e9eb-7477-4776-a9e0-ecc42e30b520-cert\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.243428 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.243345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be68e9eb-7477-4776-a9e0-ecc42e30b520-metrics-cert\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.243428 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.243384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be68e9eb-7477-4776-a9e0-ecc42e30b520-manager-config\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.243428 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.243423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtwk\" (UniqueName: \"kubernetes.io/projected/be68e9eb-7477-4776-a9e0-ecc42e30b520-kube-api-access-wrtwk\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.244110 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.244025    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be68e9eb-7477-4776-a9e0-ecc42e30b520-manager-config\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.245889 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.245866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be68e9eb-7477-4776-a9e0-ecc42e30b520-metrics-cert\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.245978 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.245911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be68e9eb-7477-4776-a9e0-ecc42e30b520-cert\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.258151 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.258121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtwk\" (UniqueName: \"kubernetes.io/projected/be68e9eb-7477-4776-a9e0-ecc42e30b520-kube-api-access-wrtwk\") pod \"lws-controller-manager-84559d8974-k79c5\" (UID: \"be68e9eb-7477-4776-a9e0-ecc42e30b520\") " pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.366495 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.366401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:00.514901 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.514876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"]
Aug 04 18:17:00.516668 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:17:00.516643    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe68e9eb_7477_4776_a9e0_ecc42e30b520.slice/crio-3b7eedd874675308ff22a17f3ac2b59accc6791e1106f559579490ae8b6b3e63 WatchSource:0}: Error finding container 3b7eedd874675308ff22a17f3ac2b59accc6791e1106f559579490ae8b6b3e63: Status 404 returned error can't find the container with id 3b7eedd874675308ff22a17f3ac2b59accc6791e1106f559579490ae8b6b3e63
Aug 04 18:17:00.518568 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.518553    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:17:00.822024 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:00.821984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5" event={"ID":"be68e9eb-7477-4776-a9e0-ecc42e30b520","Type":"ContainerStarted","Data":"3b7eedd874675308ff22a17f3ac2b59accc6791e1106f559579490ae8b6b3e63"}
Aug 04 18:17:01.613948 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.613637    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"]
Aug 04 18:17:01.616842 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.616813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.621869 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.621838    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 18:17:01.622589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.622188    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qb6pd\""
Aug 04 18:17:01.622589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.622428    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 18:17:01.622821 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.622692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 18:17:01.623211 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.622946    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 18:17:01.633688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.633595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"]
Aug 04 18:17:01.654932 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.654892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-686t8\" (UniqueName: \"kubernetes.io/projected/da170a38-895d-4755-8a0c-81f14b242f57-kube-api-access-686t8\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.655111 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.654994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da170a38-895d-4755-8a0c-81f14b242f57-manifests\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.655111 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.655063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da170a38-895d-4755-8a0c-81f14b242f57-tmp\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.655258 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.655135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da170a38-895d-4755-8a0c-81f14b242f57-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.655258 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.655166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da170a38-895d-4755-8a0c-81f14b242f57-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.756136 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.756095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-686t8\" (UniqueName: \"kubernetes.io/projected/da170a38-895d-4755-8a0c-81f14b242f57-kube-api-access-686t8\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.756332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.756146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da170a38-895d-4755-8a0c-81f14b242f57-manifests\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.756332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.756180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da170a38-895d-4755-8a0c-81f14b242f57-tmp\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.756332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.756225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da170a38-895d-4755-8a0c-81f14b242f57-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.756520 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.756359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da170a38-895d-4755-8a0c-81f14b242f57-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.756609 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.756578    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da170a38-895d-4755-8a0c-81f14b242f57-manifests\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.758998 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.758964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da170a38-895d-4755-8a0c-81f14b242f57-tmp\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.759234 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.759205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da170a38-895d-4755-8a0c-81f14b242f57-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.759478 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.759449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da170a38-895d-4755-8a0c-81f14b242f57-webhook-cert\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.770395 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.770333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-686t8\" (UniqueName: \"kubernetes.io/projected/da170a38-895d-4755-8a0c-81f14b242f57-kube-api-access-686t8\") pod \"opendatahub-operator-controller-manager-76bbc69bc6-m9h89\" (UID: \"da170a38-895d-4755-8a0c-81f14b242f57\") " pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:01.936754 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:01.936678    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:02.115961 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:02.115874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"]
Aug 04 18:17:02.118307 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:17:02.118274    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda170a38_895d_4755_8a0c_81f14b242f57.slice/crio-83698b89c56a0872f3d387a53dcc97011d78e3d75681421cd2c5bcf7ce810366 WatchSource:0}: Error finding container 83698b89c56a0872f3d387a53dcc97011d78e3d75681421cd2c5bcf7ce810366: Status 404 returned error can't find the container with id 83698b89c56a0872f3d387a53dcc97011d78e3d75681421cd2c5bcf7ce810366
Aug 04 18:17:02.836498 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:02.836454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89" event={"ID":"da170a38-895d-4755-8a0c-81f14b242f57","Type":"ContainerStarted","Data":"83698b89c56a0872f3d387a53dcc97011d78e3d75681421cd2c5bcf7ce810366"}
Aug 04 18:17:03.845394 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:03.845352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5" event={"ID":"be68e9eb-7477-4776-a9e0-ecc42e30b520","Type":"ContainerStarted","Data":"a6ee0b648a6458b2f0d211d5e0d964eddc5c7a4b5b8d789c2ea8cf9919bce2e6"}
Aug 04 18:17:03.845929 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:03.845552    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:03.873986 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:03.873699    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5" podStartSLOduration=1.100731729 podStartE2EDuration="3.873676624s" totalImagesPullingTime="2.772944895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:17:03.870944873 +0000 UTC m=+378.196048012" watchObservedRunningTime="2026-08-04 18:17:03.873676624 +0000 UTC m=+378.198779746"
Aug 04 18:17:05.855586 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:05.855550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89" event={"ID":"da170a38-895d-4755-8a0c-81f14b242f57","Type":"ContainerStarted","Data":"5d6fa5c1d453f6719a9056b826d112ccfc556a6181a034ff31c8c1e261d43c42"}
Aug 04 18:17:07.866053 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:07.866017    2579 generic.go:356] "Generic (PLEG): container finished" podID="da170a38-895d-4755-8a0c-81f14b242f57" containerID="5d6fa5c1d453f6719a9056b826d112ccfc556a6181a034ff31c8c1e261d43c42" exitCode=0
Aug 04 18:17:07.866441 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:07.866059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89" event={"ID":"da170a38-895d-4755-8a0c-81f14b242f57","Type":"ContainerDied","Data":"5d6fa5c1d453f6719a9056b826d112ccfc556a6181a034ff31c8c1e261d43c42"}
Aug 04 18:17:08.872732 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:08.872686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89" event={"ID":"da170a38-895d-4755-8a0c-81f14b242f57","Type":"ContainerStarted","Data":"56d90480de4ace250241588bf93c237dec651011e14e25d3cbb5aea07c90e4eb"}
Aug 04 18:17:08.873121 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:08.872928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:08.901300 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:08.901248    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89" podStartSLOduration=2.908481906 podStartE2EDuration="7.901230011s" totalImagesPullingTime="3.929783625s" totalInitContainerRuntime="1.06296448s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:17:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:17:08.898796163 +0000 UTC m=+383.223899294" watchObservedRunningTime="2026-08-04 18:17:08.901230011 +0000 UTC m=+383.226333131"
Aug 04 18:17:14.852977 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:14.852941    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84559d8974-k79c5"
Aug 04 18:17:19.879567 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:19.879532    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76bbc69bc6-m9h89"
Aug 04 18:17:22.335183 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.335147    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"]
Aug 04 18:17:22.467534 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.467499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"]
Aug 04 18:17:22.467707 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.467625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.493805 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.493769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 18:17:22.493805 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.493786    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 18:17:22.494860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.494827    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 18:17:22.494991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.494835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 18:17:22.494991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.494866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-47hbm\""
Aug 04 18:17:22.543664 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.543626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-tls-certs\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.543876 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.543737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-tmp\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.543876 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.543842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc6dc\" (UniqueName: \"kubernetes.io/projected/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-kube-api-access-cc6dc\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.645317 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.645221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc6dc\" (UniqueName: \"kubernetes.io/projected/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-kube-api-access-cc6dc\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.645317 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.645303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-tls-certs\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.645547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.645377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-tmp\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.647989 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.647961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-tmp\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.648110 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.648092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-tls-certs\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.658132 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.658101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc6dc\" (UniqueName: \"kubernetes.io/projected/4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60-kube-api-access-cc6dc\") pod \"kube-auth-proxy-8489764dcd-mjxdk\" (UID: \"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60\") " pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.777159 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.777125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"
Aug 04 18:17:22.940428 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:22.940319    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk"]
Aug 04 18:17:22.943319 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:17:22.943285    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7c521f_5e4d_4e95_a81b_1e5c6fd9ad60.slice/crio-abbbd55004278396dd234f16ec8263dbf53becbcd255ba83b96a733b5b2d9734 WatchSource:0}: Error finding container abbbd55004278396dd234f16ec8263dbf53becbcd255ba83b96a733b5b2d9734: Status 404 returned error can't find the container with id abbbd55004278396dd234f16ec8263dbf53becbcd255ba83b96a733b5b2d9734
Aug 04 18:17:23.943057 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:23.943016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk" event={"ID":"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60","Type":"ContainerStarted","Data":"abbbd55004278396dd234f16ec8263dbf53becbcd255ba83b96a733b5b2d9734"}
Aug 04 18:17:26.959389 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:26.959353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk" event={"ID":"4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60","Type":"ContainerStarted","Data":"73169aa986762b358e8e25c98db99474ba105b40a24b5fa0dc87279515543365"}
Aug 04 18:17:26.979052 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:17:26.978992    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8489764dcd-mjxdk" podStartSLOduration=1.8603496769999999 podStartE2EDuration="4.978970977s" totalImagesPullingTime="3.1186213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:17:26.978792253 +0000 UTC m=+401.303895384" watchObservedRunningTime="2026-08-04 18:17:26.978970977 +0000 UTC m=+401.304074097"
Aug 04 18:18:54.191992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.191952    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"]
Aug 04 18:18:54.195265 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.195248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.198117 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.198082    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 18:18:54.199075 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.199048    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 18:18:54.199210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.199100    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 18:18:54.199210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.199110    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgpqr\""
Aug 04 18:18:54.199210 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.199047    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 18:18:54.204422 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.204402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"]
Aug 04 18:18:54.252346 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.252302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a251113c-27aa-4f42-98c7-819545699f24-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.252346 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.252345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z92s8\" (UniqueName: \"kubernetes.io/projected/a251113c-27aa-4f42-98c7-819545699f24-kube-api-access-z92s8\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.252551 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.252370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a251113c-27aa-4f42-98c7-819545699f24-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.353078 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.353045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a251113c-27aa-4f42-98c7-819545699f24-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.353500 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.353085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z92s8\" (UniqueName: \"kubernetes.io/projected/a251113c-27aa-4f42-98c7-819545699f24-kube-api-access-z92s8\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.353500 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.353134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a251113c-27aa-4f42-98c7-819545699f24-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.353708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.353688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a251113c-27aa-4f42-98c7-819545699f24-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.355758 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.355703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a251113c-27aa-4f42-98c7-819545699f24-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.363161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.363132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z92s8\" (UniqueName: \"kubernetes.io/projected/a251113c-27aa-4f42-98c7-819545699f24-kube-api-access-z92s8\") pod \"kuadrant-console-plugin-598f86468b-47lhb\" (UID: \"a251113c-27aa-4f42-98c7-819545699f24\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.504828 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.504699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"
Aug 04 18:18:54.652240 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:54.652216    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb"]
Aug 04 18:18:54.654889 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:18:54.654862    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda251113c_27aa_4f42_98c7_819545699f24.slice/crio-343b0948a94469b0daeac94e05e673f83ca3ab8ca5f3b8fb4a6a6aba6dcf13e8 WatchSource:0}: Error finding container 343b0948a94469b0daeac94e05e673f83ca3ab8ca5f3b8fb4a6a6aba6dcf13e8: Status 404 returned error can't find the container with id 343b0948a94469b0daeac94e05e673f83ca3ab8ca5f3b8fb4a6a6aba6dcf13e8
Aug 04 18:18:55.365154 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:18:55.365116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb" event={"ID":"a251113c-27aa-4f42-98c7-819545699f24","Type":"ContainerStarted","Data":"343b0948a94469b0daeac94e05e673f83ca3ab8ca5f3b8fb4a6a6aba6dcf13e8"}
Aug 04 18:19:00.393305 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:00.393264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb" event={"ID":"a251113c-27aa-4f42-98c7-819545699f24","Type":"ContainerStarted","Data":"2307c98946f533a4fc205f9f1b10c5a442b552491cdce8d67918d205d527fde4"}
Aug 04 18:19:00.416876 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:00.416809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-47lhb" podStartSLOduration=1.604232001 podStartE2EDuration="6.416792228s" totalImagesPullingTime="4.812560227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:19:00.415206525 +0000 UTC m=+494.740309644" watchObservedRunningTime="2026-08-04 18:19:00.416792228 +0000 UTC m=+494.741895345"
Aug 04 18:19:40.811675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.811591    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:19:40.814803 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.814786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:40.817437 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.817418    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 18:19:40.823849 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.823827    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:19:40.868965 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.868926    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:19:40.950730 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.950687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4d38c27-178f-407f-8fb2-37f852808da2-config-file\") pod \"limitador-limitador-85d9db4d5d-f226r\" (UID: \"f4d38c27-178f-407f-8fb2-37f852808da2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:40.950908 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:40.950812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9v2\" (UniqueName: \"kubernetes.io/projected/f4d38c27-178f-407f-8fb2-37f852808da2-kube-api-access-8z9v2\") pod \"limitador-limitador-85d9db4d5d-f226r\" (UID: \"f4d38c27-178f-407f-8fb2-37f852808da2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:41.052059 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.052023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9v2\" (UniqueName: \"kubernetes.io/projected/f4d38c27-178f-407f-8fb2-37f852808da2-kube-api-access-8z9v2\") pod \"limitador-limitador-85d9db4d5d-f226r\" (UID: \"f4d38c27-178f-407f-8fb2-37f852808da2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:41.052162 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.052114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4d38c27-178f-407f-8fb2-37f852808da2-config-file\") pod \"limitador-limitador-85d9db4d5d-f226r\" (UID: \"f4d38c27-178f-407f-8fb2-37f852808da2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:41.052663 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.052645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f4d38c27-178f-407f-8fb2-37f852808da2-config-file\") pod \"limitador-limitador-85d9db4d5d-f226r\" (UID: \"f4d38c27-178f-407f-8fb2-37f852808da2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:41.064967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.064901    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9v2\" (UniqueName: \"kubernetes.io/projected/f4d38c27-178f-407f-8fb2-37f852808da2-kube-api-access-8z9v2\") pod \"limitador-limitador-85d9db4d5d-f226r\" (UID: \"f4d38c27-178f-407f-8fb2-37f852808da2\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:41.125906 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.125871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:41.267714 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.267690    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:19:41.269401 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:19:41.269369    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d38c27_178f_407f_8fb2_37f852808da2.slice/crio-57e7c639872fda2479e0c63977d89398a8090ac7d4d54f05fd8c51f7ab1b04fa WatchSource:0}: Error finding container 57e7c639872fda2479e0c63977d89398a8090ac7d4d54f05fd8c51f7ab1b04fa: Status 404 returned error can't find the container with id 57e7c639872fda2479e0c63977d89398a8090ac7d4d54f05fd8c51f7ab1b04fa
Aug 04 18:19:41.580246 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:41.580212    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r" event={"ID":"f4d38c27-178f-407f-8fb2-37f852808da2","Type":"ContainerStarted","Data":"57e7c639872fda2479e0c63977d89398a8090ac7d4d54f05fd8c51f7ab1b04fa"}
Aug 04 18:19:44.595649 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:44.595609    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r" event={"ID":"f4d38c27-178f-407f-8fb2-37f852808da2","Type":"ContainerStarted","Data":"f16aa3ede55f3b2ec2f97b3acff931495c9a4f0bceb124c2bbe0d090e6b07e71"}
Aug 04 18:19:44.596065 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:44.595691    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:19:44.614245 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:44.614195    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r" podStartSLOduration=2.349049207 podStartE2EDuration="4.614177967s" totalImagesPullingTime="2.26512876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:19:44.6129304 +0000 UTC m=+538.938033537" watchObservedRunningTime="2026-08-04 18:19:44.614177967 +0000 UTC m=+538.939281139"
Aug 04 18:19:55.601395 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:19:55.601367    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-f226r"
Aug 04 18:20:15.357487 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.357455    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dbb6c44bc-6lt8v"]
Aug 04 18:20:15.360672 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.360655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.364277 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.364253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kn2sc\""
Aug 04 18:20:15.364438 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.364253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 18:20:15.371079 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.371052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dbb6c44bc-6lt8v"]
Aug 04 18:20:15.465639 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.465594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvx5j\" (UniqueName: \"kubernetes.io/projected/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-kube-api-access-mvx5j\") pod \"authorino-5dbb6c44bc-6lt8v\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") " pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.465840 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.465673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-tls-cert\") pod \"authorino-5dbb6c44bc-6lt8v\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") " pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.566459 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.566422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-tls-cert\") pod \"authorino-5dbb6c44bc-6lt8v\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") " pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.566633 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.566497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvx5j\" (UniqueName: \"kubernetes.io/projected/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-kube-api-access-mvx5j\") pod \"authorino-5dbb6c44bc-6lt8v\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") " pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.569070 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.569048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-tls-cert\") pod \"authorino-5dbb6c44bc-6lt8v\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") " pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.577607 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.577585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvx5j\" (UniqueName: \"kubernetes.io/projected/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-kube-api-access-mvx5j\") pod \"authorino-5dbb6c44bc-6lt8v\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") " pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.669951 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.669874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:20:15.810300 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:15.810273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dbb6c44bc-6lt8v"]
Aug 04 18:20:15.812842 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:20:15.812816    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce68c3b6_8e2e_4c85_bc9d_c706f6a057f1.slice/crio-ddda2043da51a59bdfb11aa9cea751613027e71f104d228e6c9d9bf6c825a7bd WatchSource:0}: Error finding container ddda2043da51a59bdfb11aa9cea751613027e71f104d228e6c9d9bf6c825a7bd: Status 404 returned error can't find the container with id ddda2043da51a59bdfb11aa9cea751613027e71f104d228e6c9d9bf6c825a7bd
Aug 04 18:20:16.743459 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:16.743421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v" event={"ID":"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1","Type":"ContainerStarted","Data":"ddda2043da51a59bdfb11aa9cea751613027e71f104d228e6c9d9bf6c825a7bd"}
Aug 04 18:20:18.753603 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:18.753562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v" event={"ID":"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1","Type":"ContainerStarted","Data":"ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c"}
Aug 04 18:20:18.771309 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:18.771258    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v" podStartSLOduration=1.4325643829999999 podStartE2EDuration="3.771240745s" totalImagesPullingTime="2.338676362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:20:18.770011513 +0000 UTC m=+573.095114634" watchObservedRunningTime="2026-08-04 18:20:18.771240745 +0000 UTC m=+573.096343865"
Aug 04 18:20:46.105023 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:46.104995    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:20:46.106567 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:20:46.106544    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:21:01.756579 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:21:01.756545    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:21:21.131003 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:21:21.130968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:21:35.120067 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:21:35.120037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:21:52.937489 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:21:52.937446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:22:01.137852 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:01.137810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:22:10.619271 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.619238    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"]
Aug 04 18:22:10.621678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.621660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.625242 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.625217    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 18:22:10.625242 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.625245    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 18:22:10.625439 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.625217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 04 18:22:10.625439 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.625226    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6vn8c\""
Aug 04 18:22:10.642699 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.642658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"]
Aug 04 18:22:10.799780 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.799745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.799780 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.799782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.799993 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.799809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8tql\" (UniqueName: \"kubernetes.io/projected/90f03d38-b425-431d-b442-7462c3189b13-kube-api-access-j8tql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.799993 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.799871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.799993 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.799935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.799993 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.799979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90f03d38-b425-431d-b442-7462c3189b13-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901308 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901308 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90f03d38-b425-431d-b442-7462c3189b13-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901308 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tql\" (UniqueName: \"kubernetes.io/projected/90f03d38-b425-431d-b442-7462c3189b13-kube-api-access-j8tql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901695 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901861 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.901901 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.901840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.903845 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.903825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90f03d38-b425-431d-b442-7462c3189b13-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.903947 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.903930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90f03d38-b425-431d-b442-7462c3189b13-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.911085 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.911064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tql\" (UniqueName: \"kubernetes.io/projected/90f03d38-b425-431d-b442-7462c3189b13-kube-api-access-j8tql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fdqbm\" (UID: \"90f03d38-b425-431d-b442-7462c3189b13\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:10.932094 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:10.932044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:11.084502 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:11.084368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"]
Aug 04 18:22:11.087282 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:22:11.087254    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f03d38_b425_431d_b442_7462c3189b13.slice/crio-bd54a2d0e94d77f682c8602eb00543c5cfd7197c1305406043b0cacac22ca372 WatchSource:0}: Error finding container bd54a2d0e94d77f682c8602eb00543c5cfd7197c1305406043b0cacac22ca372: Status 404 returned error can't find the container with id bd54a2d0e94d77f682c8602eb00543c5cfd7197c1305406043b0cacac22ca372
Aug 04 18:22:11.088746 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:11.088706    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:22:11.271935 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:11.271903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm" event={"ID":"90f03d38-b425-431d-b442-7462c3189b13","Type":"ContainerStarted","Data":"bd54a2d0e94d77f682c8602eb00543c5cfd7197c1305406043b0cacac22ca372"}
Aug 04 18:22:12.279032 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:12.278990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm" event={"ID":"90f03d38-b425-431d-b442-7462c3189b13","Type":"ContainerStarted","Data":"2bcb94c7c6dfd9189cd8bdd6b00e0bd643aec9ddf4facbc3eac7cf03a889378d"}
Aug 04 18:22:12.307090 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:12.307030    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm" podStartSLOduration=1.24240122 podStartE2EDuration="2.307011486s" totalImagesPullingTime="1.064610266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:22:12.305972286 +0000 UTC m=+686.631075411" watchObservedRunningTime="2026-08-04 18:22:12.307011486 +0000 UTC m=+686.632114606"
Aug 04 18:22:12.653369 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:12.653336    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:22:20.933092 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:20.933057    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:20.933507 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:20.933160    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:20.945829 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:20.945802    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:21.132703 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:21.132667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:22:21.330891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:21.330861    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fdqbm"
Aug 04 18:22:54.591611 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.591521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f9b57679d-7l554"]
Aug 04 18:22:54.594763 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.594742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.603212 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.603188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9b57679d-7l554"]
Aug 04 18:22:54.701872 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.701837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/132cae74-9081-4c11-83c5-51c0679cd2c7-tls-cert\") pod \"authorino-6f9b57679d-7l554\" (UID: \"132cae74-9081-4c11-83c5-51c0679cd2c7\") " pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.702082 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.701888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r626s\" (UniqueName: \"kubernetes.io/projected/132cae74-9081-4c11-83c5-51c0679cd2c7-kube-api-access-r626s\") pod \"authorino-6f9b57679d-7l554\" (UID: \"132cae74-9081-4c11-83c5-51c0679cd2c7\") " pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.803289 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.803252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/132cae74-9081-4c11-83c5-51c0679cd2c7-tls-cert\") pod \"authorino-6f9b57679d-7l554\" (UID: \"132cae74-9081-4c11-83c5-51c0679cd2c7\") " pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.803473 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.803303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r626s\" (UniqueName: \"kubernetes.io/projected/132cae74-9081-4c11-83c5-51c0679cd2c7-kube-api-access-r626s\") pod \"authorino-6f9b57679d-7l554\" (UID: \"132cae74-9081-4c11-83c5-51c0679cd2c7\") " pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.805944 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.805918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/132cae74-9081-4c11-83c5-51c0679cd2c7-tls-cert\") pod \"authorino-6f9b57679d-7l554\" (UID: \"132cae74-9081-4c11-83c5-51c0679cd2c7\") " pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.813922 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.813895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r626s\" (UniqueName: \"kubernetes.io/projected/132cae74-9081-4c11-83c5-51c0679cd2c7-kube-api-access-r626s\") pod \"authorino-6f9b57679d-7l554\" (UID: \"132cae74-9081-4c11-83c5-51c0679cd2c7\") " pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:54.904036 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:54.903955    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9b57679d-7l554"
Aug 04 18:22:55.042051 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:55.042026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9b57679d-7l554"]
Aug 04 18:22:55.044352 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:22:55.044316    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod132cae74_9081_4c11_83c5_51c0679cd2c7.slice/crio-2bee410f3b5e3b1e8a2ccf55a98982202562e37d591a5172f6b9340ba513baf6 WatchSource:0}: Error finding container 2bee410f3b5e3b1e8a2ccf55a98982202562e37d591a5172f6b9340ba513baf6: Status 404 returned error can't find the container with id 2bee410f3b5e3b1e8a2ccf55a98982202562e37d591a5172f6b9340ba513baf6
Aug 04 18:22:55.477411 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:55.477368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9b57679d-7l554" event={"ID":"132cae74-9081-4c11-83c5-51c0679cd2c7","Type":"ContainerStarted","Data":"2bee410f3b5e3b1e8a2ccf55a98982202562e37d591a5172f6b9340ba513baf6"}
Aug 04 18:22:56.483738 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.483678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9b57679d-7l554" event={"ID":"132cae74-9081-4c11-83c5-51c0679cd2c7","Type":"ContainerStarted","Data":"284eaef5298077607ab2a0e6ca7471065d5bfd998c1b063cc8d76a09fd8aba53"}
Aug 04 18:22:56.506920 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.506853    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f9b57679d-7l554" podStartSLOduration=1.796657541 podStartE2EDuration="2.506831188s" totalImagesPullingTime="710.173647ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:22:56.506526183 +0000 UTC m=+730.831629328" watchObservedRunningTime="2026-08-04 18:22:56.506831188 +0000 UTC m=+730.831934310"
Aug 04 18:22:56.535768 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.535713    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dbb6c44bc-6lt8v"]
Aug 04 18:22:56.535996 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.535968    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v" podUID="ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" containerName="authorino" containerID="cri-o://ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c" gracePeriod=30
Aug 04 18:22:56.803538 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.803489    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:22:56.922807 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.922771    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvx5j\" (UniqueName: \"kubernetes.io/projected/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-kube-api-access-mvx5j\") pod \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") "
Aug 04 18:22:56.922992 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.922915    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-tls-cert\") pod \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\" (UID: \"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1\") "
Aug 04 18:22:56.925193 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.925153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-kube-api-access-mvx5j" (OuterVolumeSpecName: "kube-api-access-mvx5j") pod "ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" (UID: "ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1"). InnerVolumeSpecName "kube-api-access-mvx5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:22:56.936321 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:56.936284    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" (UID: "ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:22:57.024592 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.024539    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvx5j\" (UniqueName: \"kubernetes.io/projected/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-kube-api-access-mvx5j\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:22:57.024592 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.024591    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1-tls-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:22:57.493018 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.492979    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" containerID="ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c" exitCode=0
Aug 04 18:22:57.493712 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.493687    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v"
Aug 04 18:22:57.500845 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.500792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v" event={"ID":"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1","Type":"ContainerDied","Data":"ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c"}
Aug 04 18:22:57.500845 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.500848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dbb6c44bc-6lt8v" event={"ID":"ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1","Type":"ContainerDied","Data":"ddda2043da51a59bdfb11aa9cea751613027e71f104d228e6c9d9bf6c825a7bd"}
Aug 04 18:22:57.501078 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.500870    2579 scope.go:117] "RemoveContainer" containerID="ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c"
Aug 04 18:22:57.520048 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.519390    2579 scope.go:117] "RemoveContainer" containerID="ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c"
Aug 04 18:22:57.520048 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:22:57.519805    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c\": container with ID starting with ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c not found: ID does not exist" containerID="ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c"
Aug 04 18:22:57.520048 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.519844    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c"} err="failed to get container status \"ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c\": rpc error: code = NotFound desc = could not find container \"ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c\": container with ID starting with ef1e1aeafd6aba006d537771552ae86364dc9b38b26588324040a84b0becc86c not found: ID does not exist"
Aug 04 18:22:57.546244 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.546204    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dbb6c44bc-6lt8v"]
Aug 04 18:22:57.555562 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:57.555521    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dbb6c44bc-6lt8v"]
Aug 04 18:22:58.163332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:22:58.163289    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" path="/var/lib/kubelet/pods/ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1/volumes"
Aug 04 18:23:28.434262 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:23:28.434222    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:23:38.126607 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:23:38.126572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:23:51.628756 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:23:51.628703    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:25:29.748687 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:25:29.748637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:25:39.127306 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:25:39.127213    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:25:46.137385 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:25:46.137355    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:25:46.137996 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:25:46.137454    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:26:03.382299 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:26:03.382263    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:26:10.042827 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:26:10.042789    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:26:45.045936 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:26:45.045904    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:26:52.350265 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:26:52.350229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:07.743119 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:07.743037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:14.637239 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:14.637202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:23.136799 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:23.136762    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:31.681304 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:31.681265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:43.974447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:43.974414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:48.851269 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:48.851228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:27:57.925333 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:27:57.925299    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:28:06.925253 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:28:06.925210    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:28:19.238069 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:28:19.238035    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:28:30.121553 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:28:30.121515    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:28:54.017860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:28:54.017758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:04.630929 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:04.630895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:10.432424 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:10.432392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:18.134204 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:18.134170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:25.828292 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:25.828259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:31.033941 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:31.033907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:36.851139 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:36.851095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:43.133651 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:43.133610    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:48.343064 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:48.343022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:29:55.930978 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:29:55.930940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:30:00.162091 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.162059    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"]
Aug 04 18:30:00.162465 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.162406    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" containerName="authorino"
Aug 04 18:30:00.162465 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.162417    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" containerName="authorino"
Aug 04 18:30:00.162543 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.162482    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce68c3b6-8e2e-4c85-bc9d-c706f6a057f1" containerName="authorino"
Aug 04 18:30:00.165606 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.165590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"
Aug 04 18:30:00.168380 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.168357    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:30:00.174973 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.174956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"
Aug 04 18:30:00.185643 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.185615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"]
Aug 04 18:30:00.321470 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.321442    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"]
Aug 04 18:30:00.324094 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:30:00.324067    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86738e81_0d8e_4612_9c83_b58bd3920fc1.slice/crio-b73b2c84d98bdbade6e5939bc5cc891f75592391dbe38afdb1bab7866f008821 WatchSource:0}: Error finding container b73b2c84d98bdbade6e5939bc5cc891f75592391dbe38afdb1bab7866f008821: Status 404 returned error can't find the container with id b73b2c84d98bdbade6e5939bc5cc891f75592391dbe38afdb1bab7866f008821
Aug 04 18:30:00.326019 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.326003    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 18:30:00.488368 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:00.488332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5" event={"ID":"86738e81-0d8e-4612-9c83-b58bd3920fc1","Type":"ContainerStarted","Data":"b73b2c84d98bdbade6e5939bc5cc891f75592391dbe38afdb1bab7866f008821"}
Aug 04 18:30:03.504361 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:03.504328    2579 generic.go:356] "Generic (PLEG): container finished" podID="86738e81-0d8e-4612-9c83-b58bd3920fc1" containerID="b1e1c57672b78de9d85983b5ca99bfaa9d167a0eeb654824e1596e6a5d117144" exitCode=0
Aug 04 18:30:03.504788 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:03.504381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5" event={"ID":"86738e81-0d8e-4612-9c83-b58bd3920fc1","Type":"ContainerDied","Data":"b1e1c57672b78de9d85983b5ca99bfaa9d167a0eeb654824e1596e6a5d117144"}
Aug 04 18:30:04.645191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:04.645160    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"
Aug 04 18:30:05.514403 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:05.514371    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5"
Aug 04 18:30:05.514589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:05.514368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764470-5x8p5" event={"ID":"86738e81-0d8e-4612-9c83-b58bd3920fc1","Type":"ContainerDied","Data":"b73b2c84d98bdbade6e5939bc5cc891f75592391dbe38afdb1bab7866f008821"}
Aug 04 18:30:05.514589 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:05.514508    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b73b2c84d98bdbade6e5939bc5cc891f75592391dbe38afdb1bab7866f008821"
Aug 04 18:30:09.736853 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:09.736758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:30:14.924082 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:14.924047    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:30:25.523509 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:25.523473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:30:36.535630 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:36.535596    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:30:41.547631 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:41.547596    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:30:46.176299 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:46.176271    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:30:46.177326 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:46.177308    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:30:52.464839 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:30:52.464805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:33:07.837947 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:33:07.837864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:33:12.831316 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:33:12.831281    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:33:38.135412 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:33:38.135377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:33:49.143320 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:33:49.143288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:33:56.751600 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:33:56.751555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:04.256697 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:04.256661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:10.026453 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:10.026415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:19.951362 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:19.951331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:26.142700 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:26.142664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:35.252896 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:35.252844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:41.145506 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:41.145413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:50.639190 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:50.639153    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:34:57.244617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:34:57.244572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:35:06.829739 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:06.829679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:35:31.630111 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:31.630073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:35:37.098736 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:37.098700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:35:41.027639 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.027597    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"]
Aug 04 18:35:41.028070 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.027977    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86738e81-0d8e-4612-9c83-b58bd3920fc1" containerName="cleanup"
Aug 04 18:35:41.028070 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.027988    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86738e81-0d8e-4612-9c83-b58bd3920fc1" containerName="cleanup"
Aug 04 18:35:41.028070 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.028043    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86738e81-0d8e-4612-9c83-b58bd3920fc1" containerName="cleanup"
Aug 04 18:35:41.031159 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.031144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.033938 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.033921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-7ac033f5-kserve-self-signed-certs\""
Aug 04 18:35:41.097963 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.097927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"]
Aug 04 18:35:41.121693 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.121663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-model-cache\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.121894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.121703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxw2x\" (UniqueName: \"kubernetes.io/projected/1ecde8f0-0d40-455e-a423-62589a694e3b-kube-api-access-fxw2x\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.121894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.121815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-home\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.121894 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.121880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-dshm\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.122028 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.121923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-tmp-dir\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.122028 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.121960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ecde8f0-0d40-455e-a423-62589a694e3b-tls-certs\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223267 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ecde8f0-0d40-455e-a423-62589a694e3b-tls-certs\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223267 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-model-cache\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223512 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxw2x\" (UniqueName: \"kubernetes.io/projected/1ecde8f0-0d40-455e-a423-62589a694e3b-kube-api-access-fxw2x\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223512 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-home\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223512 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-dshm\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223512 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-tmp-dir\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223772 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-model-cache\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223833 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223801    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-tmp-dir\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.223833 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.223820    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-home\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.225932 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.225910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-dshm\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.226098 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.226080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ecde8f0-0d40-455e-a423-62589a694e3b-tls-certs\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.234912 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.234884    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxw2x\" (UniqueName: \"kubernetes.io/projected/1ecde8f0-0d40-455e-a423-62589a694e3b-kube-api-access-fxw2x\") pod \"e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") " pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.340256 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.340168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:41.487471 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:41.487445    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"]
Aug 04 18:35:41.489958 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:35:41.489927    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ecde8f0_0d40_455e_a423_62589a694e3b.slice/crio-d92f393b5af4c739bd5d1d1adcbca5896c5ebaae8fdccaa6a63e9fd54c4f548e WatchSource:0}: Error finding container d92f393b5af4c739bd5d1d1adcbca5896c5ebaae8fdccaa6a63e9fd54c4f548e: Status 404 returned error can't find the container with id d92f393b5af4c739bd5d1d1adcbca5896c5ebaae8fdccaa6a63e9fd54c4f548e
Aug 04 18:35:42.124221 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:42.124178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2" event={"ID":"1ecde8f0-0d40-455e-a423-62589a694e3b","Type":"ContainerStarted","Data":"62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507"}
Aug 04 18:35:42.124221 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:42.124224    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2" event={"ID":"1ecde8f0-0d40-455e-a423-62589a694e3b","Type":"ContainerStarted","Data":"d92f393b5af4c739bd5d1d1adcbca5896c5ebaae8fdccaa6a63e9fd54c4f548e"}
Aug 04 18:35:42.183835 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:42.183760    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2" podStartSLOduration=2.183741043 podStartE2EDuration="2.183741043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:42.17002127 +0000 UTC m=+1496.495124405" watchObservedRunningTime="2026-08-04 18:35:42.183741043 +0000 UTC m=+1496.508844153"
Aug 04 18:35:43.240636 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:43.240591    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:35:43.915874 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:43.915842    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"]
Aug 04 18:35:43.919116 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:43.919100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:43.922182 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:43.922161    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-7ac033f5-kserve-self-signed-certs\""
Aug 04 18:35:43.931741 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:43.931694    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"]
Aug 04 18:35:44.049469 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.049426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhf9\" (UniqueName: \"kubernetes.io/projected/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-kube-api-access-9jhf9\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.049652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.049481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tls-certs\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.049652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.049567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-dshm\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.049652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.049603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tmp-dir\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.049652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.049648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-model-cache\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.049853 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.049671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-home\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.150959 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.150922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-model-cache\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.150959 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.150961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-home\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhf9\" (UniqueName: \"kubernetes.io/projected/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-kube-api-access-9jhf9\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tls-certs\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-dshm\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tmp-dir\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151398 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-model-cache\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151453 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151413    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-home\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.151489 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.151471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tmp-dir\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.153503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.153481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-dshm\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.153757 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.153738    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tls-certs\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.167387 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.167327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhf9\" (UniqueName: \"kubernetes.io/projected/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-kube-api-access-9jhf9\") pod \"e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") " pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.229668 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.229631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:44.419736 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:44.419687    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"]
Aug 04 18:35:44.420708 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:35:44.420674    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ae1586b_63ff_4a11_ad92_f4cf6df85fb7.slice/crio-c469e37c4327f9c7e6f01fcd644207a42e88a507437ae050654ef208e26f36fc WatchSource:0}: Error finding container c469e37c4327f9c7e6f01fcd644207a42e88a507437ae050654ef208e26f36fc: Status 404 returned error can't find the container with id c469e37c4327f9c7e6f01fcd644207a42e88a507437ae050654ef208e26f36fc
Aug 04 18:35:45.145884 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:45.145834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c" event={"ID":"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7","Type":"ContainerStarted","Data":"99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52"}
Aug 04 18:35:45.146026 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:45.145893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c" event={"ID":"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7","Type":"ContainerStarted","Data":"c469e37c4327f9c7e6f01fcd644207a42e88a507437ae050654ef208e26f36fc"}
Aug 04 18:35:45.169470 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:45.169405    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c" podStartSLOduration=2.169385674 podStartE2EDuration="2.169385674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:35:45.168417231 +0000 UTC m=+1499.493520363" watchObservedRunningTime="2026-08-04 18:35:45.169385674 +0000 UTC m=+1499.494488772"
Aug 04 18:35:46.205804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:46.205776    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:35:46.208214 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:46.208192    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:35:51.340831 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:51.340795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:51.341293 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:51.340877    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:51.353454 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:51.353426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:52.193222 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:52.193191    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:35:54.229951 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:54.229925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:54.230323 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:54.229970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:54.242604 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:54.242579    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:35:54.539967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:54.539881    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:35:55.207507 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:35:55.207475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:36:23.340562 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:23.340471    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"]
Aug 04 18:36:24.882921 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:24.882887    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"]
Aug 04 18:36:25.328738 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:25.328686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:36:38.136218 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.136184    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:36:38.360328 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.360284    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2" podUID="1ecde8f0-0d40-455e-a423-62589a694e3b" containerName="main" containerID="cri-o://62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507" gracePeriod=45
Aug 04 18:36:38.608556 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.608528    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:36:38.657692 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.657660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxw2x\" (UniqueName: \"kubernetes.io/projected/1ecde8f0-0d40-455e-a423-62589a694e3b-kube-api-access-fxw2x\") pod \"1ecde8f0-0d40-455e-a423-62589a694e3b\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") "
Aug 04 18:36:38.657692 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.657704    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-home\") pod \"1ecde8f0-0d40-455e-a423-62589a694e3b\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") "
Aug 04 18:36:38.657967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.657783    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-model-cache\") pod \"1ecde8f0-0d40-455e-a423-62589a694e3b\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") "
Aug 04 18:36:38.657967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.657801    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ecde8f0-0d40-455e-a423-62589a694e3b-tls-certs\") pod \"1ecde8f0-0d40-455e-a423-62589a694e3b\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") "
Aug 04 18:36:38.657967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.657842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-dshm\") pod \"1ecde8f0-0d40-455e-a423-62589a694e3b\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") "
Aug 04 18:36:38.657967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.657869    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-tmp-dir\") pod \"1ecde8f0-0d40-455e-a423-62589a694e3b\" (UID: \"1ecde8f0-0d40-455e-a423-62589a694e3b\") "
Aug 04 18:36:38.658186 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.658061    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ecde8f0-0d40-455e-a423-62589a694e3b" (UID: "1ecde8f0-0d40-455e-a423-62589a694e3b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:38.658186 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.658090    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-home" (OuterVolumeSpecName: "home") pod "1ecde8f0-0d40-455e-a423-62589a694e3b" (UID: "1ecde8f0-0d40-455e-a423-62589a694e3b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:38.658292 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.658225    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:38.658292 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.658239    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:38.658292 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.658244    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ecde8f0-0d40-455e-a423-62589a694e3b" (UID: "1ecde8f0-0d40-455e-a423-62589a694e3b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:38.660219 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.660193    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecde8f0-0d40-455e-a423-62589a694e3b-kube-api-access-fxw2x" (OuterVolumeSpecName: "kube-api-access-fxw2x") pod "1ecde8f0-0d40-455e-a423-62589a694e3b" (UID: "1ecde8f0-0d40-455e-a423-62589a694e3b"). InnerVolumeSpecName "kube-api-access-fxw2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:36:38.660335 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.660231    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ecde8f0-0d40-455e-a423-62589a694e3b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ecde8f0-0d40-455e-a423-62589a694e3b" (UID: "1ecde8f0-0d40-455e-a423-62589a694e3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:36:38.660335 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.660247    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-dshm" (OuterVolumeSpecName: "dshm") pod "1ecde8f0-0d40-455e-a423-62589a694e3b" (UID: "1ecde8f0-0d40-455e-a423-62589a694e3b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:38.759115 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.759025    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxw2x\" (UniqueName: \"kubernetes.io/projected/1ecde8f0-0d40-455e-a423-62589a694e3b-kube-api-access-fxw2x\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:38.759115 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.759058    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ecde8f0-0d40-455e-a423-62589a694e3b-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:38.759115 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.759069    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:38.759115 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:38.759077    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecde8f0-0d40-455e-a423-62589a694e3b-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:39.410399 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.410370    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ecde8f0-0d40-455e-a423-62589a694e3b" containerID="62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507" exitCode=0
Aug 04 18:36:39.410843 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.410410    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"
Aug 04 18:36:39.410843 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.410461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2" event={"ID":"1ecde8f0-0d40-455e-a423-62589a694e3b","Type":"ContainerDied","Data":"62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507"}
Aug 04 18:36:39.410843 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.410500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2" event={"ID":"1ecde8f0-0d40-455e-a423-62589a694e3b","Type":"ContainerDied","Data":"d92f393b5af4c739bd5d1d1adcbca5896c5ebaae8fdccaa6a63e9fd54c4f548e"}
Aug 04 18:36:39.410843 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.410517    2579 scope.go:117] "RemoveContainer" containerID="62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507"
Aug 04 18:36:39.419622 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.419602    2579 scope.go:117] "RemoveContainer" containerID="62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507"
Aug 04 18:36:39.419891 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:36:39.419872    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507\": container with ID starting with 62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507 not found: ID does not exist" containerID="62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507"
Aug 04 18:36:39.419945 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.419899    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507"} err="failed to get container status \"62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507\": rpc error: code = NotFound desc = could not find container \"62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507\": container with ID starting with 62439742afd896234c3b9373e31697daeb015eb39865ee217a9fa9df37125507 not found: ID does not exist"
Aug 04 18:36:39.433821 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.433792    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"]
Aug 04 18:36:39.447358 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.447324    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-7ac033f5-kserve-6c7748fd75-vlfd2"]
Aug 04 18:36:39.902558 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:39.902518    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c" podUID="9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" containerName="main" containerID="cri-o://99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52" gracePeriod=45
Aug 04 18:36:40.154661 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.154594    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:36:40.162302 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.162274    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ecde8f0-0d40-455e-a423-62589a694e3b" path="/var/lib/kubelet/pods/1ecde8f0-0d40-455e-a423-62589a694e3b/volumes"
Aug 04 18:36:40.271556 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tls-certs\") pod \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") "
Aug 04 18:36:40.271793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271575    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-dshm\") pod \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") "
Aug 04 18:36:40.271793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271597    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tmp-dir\") pod \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") "
Aug 04 18:36:40.271793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-model-cache\") pod \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") "
Aug 04 18:36:40.271793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271742    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jhf9\" (UniqueName: \"kubernetes.io/projected/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-kube-api-access-9jhf9\") pod \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") "
Aug 04 18:36:40.271793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271777    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-home\") pod \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\" (UID: \"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7\") "
Aug 04 18:36:40.272080 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.271972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" (UID: "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:40.272142 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.272116    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:40.272414 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.272365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-home" (OuterVolumeSpecName: "home") pod "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" (UID: "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:40.272491 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.272407    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" (UID: "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:40.274074 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.274050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" (UID: "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:36:40.274206 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.274183    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-dshm" (OuterVolumeSpecName: "dshm") pod "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" (UID: "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:36:40.274370 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.274342    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-kube-api-access-9jhf9" (OuterVolumeSpecName: "kube-api-access-9jhf9") pod "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" (UID: "9ae1586b-63ff-4a11-ad92-f4cf6df85fb7"). InnerVolumeSpecName "kube-api-access-9jhf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:36:40.372837 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.372806    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:40.372837 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.372834    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:40.372837 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.372843    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:40.373081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.372852    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jhf9\" (UniqueName: \"kubernetes.io/projected/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-kube-api-access-9jhf9\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:40.373081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.372860    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:36:40.416882 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.416793    2579 generic.go:356] "Generic (PLEG): container finished" podID="9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" containerID="99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52" exitCode=0
Aug 04 18:36:40.416882 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.416840    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"
Aug 04 18:36:40.417338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.416877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c" event={"ID":"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7","Type":"ContainerDied","Data":"99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52"}
Aug 04 18:36:40.417338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.416923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c" event={"ID":"9ae1586b-63ff-4a11-ad92-f4cf6df85fb7","Type":"ContainerDied","Data":"c469e37c4327f9c7e6f01fcd644207a42e88a507437ae050654ef208e26f36fc"}
Aug 04 18:36:40.417338 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.416946    2579 scope.go:117] "RemoveContainer" containerID="99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52"
Aug 04 18:36:40.426334 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.426316    2579 scope.go:117] "RemoveContainer" containerID="99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52"
Aug 04 18:36:40.426590 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:36:40.426568    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52\": container with ID starting with 99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52 not found: ID does not exist" containerID="99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52"
Aug 04 18:36:40.426646 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.426604    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52"} err="failed to get container status \"99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52\": rpc error: code = NotFound desc = could not find container \"99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52\": container with ID starting with 99da30b5dce5f2873c62f3aef4acaf7be9ed161264d64506af572484d507ad52 not found: ID does not exist"
Aug 04 18:36:40.440521 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.440494    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"]
Aug 04 18:36:40.446408 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:40.446386    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-7ac033f5-kserve-75d677986c-gcq8c"]
Aug 04 18:36:42.162187 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:42.162144    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" path="/var/lib/kubelet/pods/9ae1586b-63ff-4a11-ad92-f4cf6df85fb7/volumes"
Aug 04 18:36:43.031479 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:43.031432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:36:49.626762 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:49.626711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:36:59.646648 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:36:59.646610    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:37:06.841406 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:37:06.841370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:37:17.079315 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:37:17.079272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:37:24.022808 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:37:24.022766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:37:36.531007 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:37:36.530919    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:37:41.651652 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:37:41.651609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:37:59.535526 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:37:59.535489    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:04.623678 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:04.623642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:18.128270 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:18.128222    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:24.023328 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:24.023293    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:30.319641 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:30.319602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:34.429168 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:34.429126    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:40.639607 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:40.639568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:49.232809 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:49.232769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:38:58.749167 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:38:58.749121    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:39:17.049712 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:39:17.049630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:39:24.269143 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:39:24.269092    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:39:34.341055 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:39:34.341021    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:39:49.628159 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:39:49.628108    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:39:55.732515 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:39:55.732481    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:40:02.236800 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:02.236764    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:40:13.751150 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:13.751110    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:40:23.334350 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:23.334317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:40:32.944762 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:32.944709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:40:44.255032 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:44.254992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:40:46.233651 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:46.233624    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:40:46.237926 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:40:46.237905    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:41:05.449300 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449263    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"]
Aug 04 18:41:05.449804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449618    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" containerName="main"
Aug 04 18:41:05.449804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449630    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" containerName="main"
Aug 04 18:41:05.449804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449647    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ecde8f0-0d40-455e-a423-62589a694e3b" containerName="main"
Aug 04 18:41:05.449804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449652    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ecde8f0-0d40-455e-a423-62589a694e3b" containerName="main"
Aug 04 18:41:05.449804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449705    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ecde8f0-0d40-455e-a423-62589a694e3b" containerName="main"
Aug 04 18:41:05.449804 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.449712    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae1586b-63ff-4a11-ad92-f4cf6df85fb7" containerName="main"
Aug 04 18:41:05.452844 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.452829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:05.456178 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.456158    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:41:05.456408 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.456393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:41:05.462029 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.462005    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"]
Aug 04 18:41:05.565319 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.565281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03d77da-43fb-4ab7-b46b-cc2a21e4926a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl\" (UID: \"f03d77da-43fb-4ab7-b46b-cc2a21e4926a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:05.666943 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.666909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03d77da-43fb-4ab7-b46b-cc2a21e4926a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl\" (UID: \"f03d77da-43fb-4ab7-b46b-cc2a21e4926a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:05.667542 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.667513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03d77da-43fb-4ab7-b46b-cc2a21e4926a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl\" (UID: \"f03d77da-43fb-4ab7-b46b-cc2a21e4926a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:05.764255 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.764172    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:05.906308 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:05.906279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"]
Aug 04 18:41:05.910359 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:41:05.910312    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03d77da_43fb_4ab7_b46b_cc2a21e4926a.slice/crio-4ef1199978c46e7d1f394079881c46419d5b63c1e8fada4a8c18155f8008d1cd WatchSource:0}: Error finding container 4ef1199978c46e7d1f394079881c46419d5b63c1e8fada4a8c18155f8008d1cd: Status 404 returned error can't find the container with id 4ef1199978c46e7d1f394079881c46419d5b63c1e8fada4a8c18155f8008d1cd
Aug 04 18:41:06.678092 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:06.678059    2579 generic.go:356] "Generic (PLEG): container finished" podID="f03d77da-43fb-4ab7-b46b-cc2a21e4926a" containerID="db2c11854da91b29579d0998955566665c4a932b7f35e966eb041832b88c718a" exitCode=0
Aug 04 18:41:06.678458 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:06.678126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl" event={"ID":"f03d77da-43fb-4ab7-b46b-cc2a21e4926a","Type":"ContainerDied","Data":"db2c11854da91b29579d0998955566665c4a932b7f35e966eb041832b88c718a"}
Aug 04 18:41:06.678458 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:06.678165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl" event={"ID":"f03d77da-43fb-4ab7-b46b-cc2a21e4926a","Type":"ContainerStarted","Data":"4ef1199978c46e7d1f394079881c46419d5b63c1e8fada4a8c18155f8008d1cd"}
Aug 04 18:41:07.818209 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:07.818177    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:07.883991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:07.883953    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03d77da-43fb-4ab7-b46b-cc2a21e4926a-maas-api-service-ca\") pod \"f03d77da-43fb-4ab7-b46b-cc2a21e4926a\" (UID: \"f03d77da-43fb-4ab7-b46b-cc2a21e4926a\") "
Aug 04 18:41:07.884351 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:07.884328    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03d77da-43fb-4ab7-b46b-cc2a21e4926a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f03d77da-43fb-4ab7-b46b-cc2a21e4926a" (UID: "f03d77da-43fb-4ab7-b46b-cc2a21e4926a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:41:07.985115 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:07.985080    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03d77da-43fb-4ab7-b46b-cc2a21e4926a-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:41:08.689058 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:08.689029    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"
Aug 04 18:41:08.689223 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:08.689060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl" event={"ID":"f03d77da-43fb-4ab7-b46b-cc2a21e4926a","Type":"ContainerDied","Data":"4ef1199978c46e7d1f394079881c46419d5b63c1e8fada4a8c18155f8008d1cd"}
Aug 04 18:41:08.689223 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:08.689110    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ef1199978c46e7d1f394079881c46419d5b63c1e8fada4a8c18155f8008d1cd"
Aug 04 18:41:12.058296 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:12.058262    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"]
Aug 04 18:41:12.061493 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:12.061460    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9756c1e3-p7djl"]
Aug 04 18:41:12.162825 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:12.162793    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03d77da-43fb-4ab7-b46b-cc2a21e4926a" path="/var/lib/kubelet/pods/f03d77da-43fb-4ab7-b46b-cc2a21e4926a/volumes"
Aug 04 18:41:15.062166 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:15.062129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:41:24.352703 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:24.352670    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:41:42.123548 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.123512    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"]
Aug 04 18:41:42.124056 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.123936    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03d77da-43fb-4ab7-b46b-cc2a21e4926a" containerName="revoke-keys"
Aug 04 18:41:42.124056 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.123951    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03d77da-43fb-4ab7-b46b-cc2a21e4926a" containerName="revoke-keys"
Aug 04 18:41:42.124131 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.124057    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03d77da-43fb-4ab7-b46b-cc2a21e4926a" containerName="revoke-keys"
Aug 04 18:41:42.127191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.127176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:42.129888 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.129861    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:41:42.130180 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.130163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:41:42.136556 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.136531    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"]
Aug 04 18:41:42.198847 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.198811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3036fb-a2c5-4328-8e11-2d549fc171f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk\" (UID: \"1f3036fb-a2c5-4328-8e11-2d549fc171f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:42.299371 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.299328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3036fb-a2c5-4328-8e11-2d549fc171f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk\" (UID: \"1f3036fb-a2c5-4328-8e11-2d549fc171f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:42.300309 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.300291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3036fb-a2c5-4328-8e11-2d549fc171f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk\" (UID: \"1f3036fb-a2c5-4328-8e11-2d549fc171f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:42.439139 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.439101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:42.580945 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.580920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"]
Aug 04 18:41:42.583219 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:41:42.583193    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3036fb_a2c5_4328_8e11_2d549fc171f0.slice/crio-9d3f803b53d55ebca4cbd364f6287aeeb3bcda907c5b2ca188f0e0c1fb56f1f6 WatchSource:0}: Error finding container 9d3f803b53d55ebca4cbd364f6287aeeb3bcda907c5b2ca188f0e0c1fb56f1f6: Status 404 returned error can't find the container with id 9d3f803b53d55ebca4cbd364f6287aeeb3bcda907c5b2ca188f0e0c1fb56f1f6
Aug 04 18:41:42.860476 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:42.860440    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk" event={"ID":"1f3036fb-a2c5-4328-8e11-2d549fc171f0","Type":"ContainerStarted","Data":"9d3f803b53d55ebca4cbd364f6287aeeb3bcda907c5b2ca188f0e0c1fb56f1f6"}
Aug 04 18:41:43.866908 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:43.866878    2579 generic.go:356] "Generic (PLEG): container finished" podID="1f3036fb-a2c5-4328-8e11-2d549fc171f0" containerID="68f70b2d8985a371267fd2a4b79db0d2707ceb12ef06d63e2fa12bbe1dea1a7f" exitCode=0
Aug 04 18:41:43.867296 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:43.866972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk" event={"ID":"1f3036fb-a2c5-4328-8e11-2d549fc171f0","Type":"ContainerDied","Data":"68f70b2d8985a371267fd2a4b79db0d2707ceb12ef06d63e2fa12bbe1dea1a7f"}
Aug 04 18:41:45.003123 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.003100    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:45.124789 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.124699    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3036fb-a2c5-4328-8e11-2d549fc171f0-maas-api-service-ca\") pod \"1f3036fb-a2c5-4328-8e11-2d549fc171f0\" (UID: \"1f3036fb-a2c5-4328-8e11-2d549fc171f0\") "
Aug 04 18:41:45.125072 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.125045    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3036fb-a2c5-4328-8e11-2d549fc171f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f3036fb-a2c5-4328-8e11-2d549fc171f0" (UID: "1f3036fb-a2c5-4328-8e11-2d549fc171f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:41:45.225404 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.225374    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3036fb-a2c5-4328-8e11-2d549fc171f0-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:41:45.883667 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.883639    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"
Aug 04 18:41:45.883879 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.883677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk" event={"ID":"1f3036fb-a2c5-4328-8e11-2d549fc171f0","Type":"ContainerDied","Data":"9d3f803b53d55ebca4cbd364f6287aeeb3bcda907c5b2ca188f0e0c1fb56f1f6"}
Aug 04 18:41:45.883879 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:45.883778    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d3f803b53d55ebca4cbd364f6287aeeb3bcda907c5b2ca188f0e0c1fb56f1f6"
Aug 04 18:41:49.056103 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:49.056061    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"]
Aug 04 18:41:49.060961 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:49.060929    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-cf4512d1-f2jgk"]
Aug 04 18:41:50.162485 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:50.162446    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3036fb-a2c5-4328-8e11-2d549fc171f0" path="/var/lib/kubelet/pods/1f3036fb-a2c5-4328-8e11-2d549fc171f0/volumes"
Aug 04 18:41:51.755076 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:41:51.755040    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:42:00.148975 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:00.148936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:42:23.179211 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.179167    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"]
Aug 04 18:42:23.179708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.179576    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3036fb-a2c5-4328-8e11-2d549fc171f0" containerName="revoke-keys"
Aug 04 18:42:23.179708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.179587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3036fb-a2c5-4328-8e11-2d549fc171f0" containerName="revoke-keys"
Aug 04 18:42:23.179708 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.179642    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3036fb-a2c5-4328-8e11-2d549fc171f0" containerName="revoke-keys"
Aug 04 18:42:23.182563 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.182544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:23.185055 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.185025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:42:23.185172 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.185070    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:42:23.191833 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.191813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"]
Aug 04 18:42:23.269912 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.269876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr\" (UID: \"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:23.370910 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.370870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr\" (UID: \"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:23.371522 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.371501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr\" (UID: \"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:23.493913 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.493875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:23.631590 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:23.631474    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"]
Aug 04 18:42:23.634770 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:42:23.634736    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a52f97f_dc6e_4a05_bee4_ecebabcc21f4.slice/crio-071d1a48f99d6bf003da883e313e410b7cf6772f84538ee9ce91ed34fbe7d9fd WatchSource:0}: Error finding container 071d1a48f99d6bf003da883e313e410b7cf6772f84538ee9ce91ed34fbe7d9fd: Status 404 returned error can't find the container with id 071d1a48f99d6bf003da883e313e410b7cf6772f84538ee9ce91ed34fbe7d9fd
Aug 04 18:42:24.063178 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:24.063000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr" event={"ID":"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4","Type":"ContainerStarted","Data":"fa13b1356da92d24140ded3baee515e0438223eb113b186fc216ec5ba9dec430"}
Aug 04 18:42:24.063178 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:24.063060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr" event={"ID":"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4","Type":"ContainerStarted","Data":"071d1a48f99d6bf003da883e313e410b7cf6772f84538ee9ce91ed34fbe7d9fd"}
Aug 04 18:42:24.082101 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:24.082046    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr" podStartSLOduration=1.082028184 podStartE2EDuration="1.082028184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:42:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:42:24.081135777 +0000 UTC m=+1898.406238916" watchObservedRunningTime="2026-08-04 18:42:24.082028184 +0000 UTC m=+1898.407131303"
Aug 04 18:42:25.069615 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:25.069580    2579 generic.go:356] "Generic (PLEG): container finished" podID="0a52f97f-dc6e-4a05-bee4-ecebabcc21f4" containerID="fa13b1356da92d24140ded3baee515e0438223eb113b186fc216ec5ba9dec430" exitCode=0
Aug 04 18:42:25.070047 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:25.069662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr" event={"ID":"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4","Type":"ContainerDied","Data":"fa13b1356da92d24140ded3baee515e0438223eb113b186fc216ec5ba9dec430"}
Aug 04 18:42:26.208550 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:26.208525    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:26.300339 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:26.300299    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4-maas-api-service-ca\") pod \"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4\" (UID: \"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4\") "
Aug 04 18:42:26.300672 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:26.300649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0a52f97f-dc6e-4a05-bee4-ecebabcc21f4" (UID: "0a52f97f-dc6e-4a05-bee4-ecebabcc21f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:42:26.401252 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:26.401148    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:42:27.081138 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:27.081105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr" event={"ID":"0a52f97f-dc6e-4a05-bee4-ecebabcc21f4","Type":"ContainerDied","Data":"071d1a48f99d6bf003da883e313e410b7cf6772f84538ee9ce91ed34fbe7d9fd"}
Aug 04 18:42:27.081138 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:27.081130    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"
Aug 04 18:42:27.081358 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:27.081154    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="071d1a48f99d6bf003da883e313e410b7cf6772f84538ee9ce91ed34fbe7d9fd"
Aug 04 18:42:34.413780 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:34.413744    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"]
Aug 04 18:42:34.420426 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:34.420400    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3f6c154b-6kwmr"]
Aug 04 18:42:36.161576 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:36.161543    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a52f97f-dc6e-4a05-bee4-ecebabcc21f4" path="/var/lib/kubelet/pods/0a52f97f-dc6e-4a05-bee4-ecebabcc21f4/volumes"
Aug 04 18:42:37.243393 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:37.243349    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:42:43.424189 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:42:43.424154    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:43:04.229854 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.229818    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"]
Aug 04 18:43:04.230321 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.230188    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a52f97f-dc6e-4a05-bee4-ecebabcc21f4" containerName="revoke-keys"
Aug 04 18:43:04.230321 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.230198    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a52f97f-dc6e-4a05-bee4-ecebabcc21f4" containerName="revoke-keys"
Aug 04 18:43:04.230321 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.230268    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a52f97f-dc6e-4a05-bee4-ecebabcc21f4" containerName="revoke-keys"
Aug 04 18:43:04.233472 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.233456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:04.236157 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.236129    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:43:04.236285 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.236177    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:43:04.242125 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.242094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"]
Aug 04 18:43:04.345476 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.345428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4909d006-a595-4cd4-99b0-998ebed60959-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-16e32844-nhdk2\" (UID: \"4909d006-a595-4cd4-99b0-998ebed60959\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:04.446067 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.446026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4909d006-a595-4cd4-99b0-998ebed60959-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-16e32844-nhdk2\" (UID: \"4909d006-a595-4cd4-99b0-998ebed60959\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:04.446648 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.446627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4909d006-a595-4cd4-99b0-998ebed60959-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-16e32844-nhdk2\" (UID: \"4909d006-a595-4cd4-99b0-998ebed60959\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:04.545162 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.545068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:04.687299 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:04.687264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"]
Aug 04 18:43:04.690414 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:43:04.690390    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4909d006_a595_4cd4_99b0_998ebed60959.slice/crio-2511b5ff00ccf8f39483e032ae29238c81548e33ccd36e23153b5c91ca798342 WatchSource:0}: Error finding container 2511b5ff00ccf8f39483e032ae29238c81548e33ccd36e23153b5c91ca798342: Status 404 returned error can't find the container with id 2511b5ff00ccf8f39483e032ae29238c81548e33ccd36e23153b5c91ca798342
Aug 04 18:43:05.261370 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:05.261334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2" event={"ID":"4909d006-a595-4cd4-99b0-998ebed60959","Type":"ContainerStarted","Data":"750dd6b5d4d38b7cbb13249988ce79ad6537bff2bea035e883285b733deac028"}
Aug 04 18:43:05.261799 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:05.261393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2" event={"ID":"4909d006-a595-4cd4-99b0-998ebed60959","Type":"ContainerStarted","Data":"2511b5ff00ccf8f39483e032ae29238c81548e33ccd36e23153b5c91ca798342"}
Aug 04 18:43:05.279313 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:05.279259    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2" podStartSLOduration=1.2792421059999999 podStartE2EDuration="1.279242106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:43:05.278857117 +0000 UTC m=+1939.603960240" watchObservedRunningTime="2026-08-04 18:43:05.279242106 +0000 UTC m=+1939.604345225"
Aug 04 18:43:06.268031 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:06.268000    2579 generic.go:356] "Generic (PLEG): container finished" podID="4909d006-a595-4cd4-99b0-998ebed60959" containerID="750dd6b5d4d38b7cbb13249988ce79ad6537bff2bea035e883285b733deac028" exitCode=0
Aug 04 18:43:06.268432 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:06.268074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2" event={"ID":"4909d006-a595-4cd4-99b0-998ebed60959","Type":"ContainerDied","Data":"750dd6b5d4d38b7cbb13249988ce79ad6537bff2bea035e883285b733deac028"}
Aug 04 18:43:07.409874 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:07.409845    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:07.473983 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:07.473943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4909d006-a595-4cd4-99b0-998ebed60959-maas-api-service-ca\") pod \"4909d006-a595-4cd4-99b0-998ebed60959\" (UID: \"4909d006-a595-4cd4-99b0-998ebed60959\") "
Aug 04 18:43:07.474317 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:07.474294    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4909d006-a595-4cd4-99b0-998ebed60959-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4909d006-a595-4cd4-99b0-998ebed60959" (UID: "4909d006-a595-4cd4-99b0-998ebed60959"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:43:07.575636 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:07.575558    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4909d006-a595-4cd4-99b0-998ebed60959-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:43:08.278991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:08.278956    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"
Aug 04 18:43:08.278991 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:08.278987    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2" event={"ID":"4909d006-a595-4cd4-99b0-998ebed60959","Type":"ContainerDied","Data":"2511b5ff00ccf8f39483e032ae29238c81548e33ccd36e23153b5c91ca798342"}
Aug 04 18:43:08.279252 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:08.279034    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2511b5ff00ccf8f39483e032ae29238c81548e33ccd36e23153b5c91ca798342"
Aug 04 18:43:11.467860 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:11.467823    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"]
Aug 04 18:43:11.471174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:11.471138    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-16e32844-nhdk2"]
Aug 04 18:43:12.162243 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:12.162208    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4909d006-a595-4cd4-99b0-998ebed60959" path="/var/lib/kubelet/pods/4909d006-a595-4cd4-99b0-998ebed60959/volumes"
Aug 04 18:43:14.131189 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:14.131158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:43:27.127118 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:43:27.127083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:45:00.149276 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.149239    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"]
Aug 04 18:45:00.149812 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.149617    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4909d006-a595-4cd4-99b0-998ebed60959" containerName="revoke-keys"
Aug 04 18:45:00.149812 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.149628    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4909d006-a595-4cd4-99b0-998ebed60959" containerName="revoke-keys"
Aug 04 18:45:00.149812 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.149705    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4909d006-a595-4cd4-99b0-998ebed60959" containerName="revoke-keys"
Aug 04 18:45:00.152670 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.152654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"
Aug 04 18:45:00.156831 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.156806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:45:00.162762 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.162742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"
Aug 04 18:45:00.210858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.210820    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"]
Aug 04 18:45:00.320283 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.320257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"]
Aug 04 18:45:00.323074 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:45:00.323043    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1937e65_cf4a_47e4_a049_86c7519a9806.slice/crio-0a125a580bbc47b2a99001ea8400a1b974d2d269ef0840a20bd4e8fa4c7dd401 WatchSource:0}: Error finding container 0a125a580bbc47b2a99001ea8400a1b974d2d269ef0840a20bd4e8fa4c7dd401: Status 404 returned error can't find the container with id 0a125a580bbc47b2a99001ea8400a1b974d2d269ef0840a20bd4e8fa4c7dd401
Aug 04 18:45:00.859902 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.859812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr" event={"ID":"b1937e65-cf4a-47e4-a049-86c7519a9806","Type":"ContainerStarted","Data":"b1d48f8adda4bee39e2a0dbf0f3da76a6baa476956098902517c1090ae944a41"}
Aug 04 18:45:00.859902 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.859869    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr" event={"ID":"b1937e65-cf4a-47e4-a049-86c7519a9806","Type":"ContainerStarted","Data":"0a125a580bbc47b2a99001ea8400a1b974d2d269ef0840a20bd4e8fa4c7dd401"}
Aug 04 18:45:00.881699 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:00.881634    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr" podStartSLOduration=0.881615052 podStartE2EDuration="881.615052ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:45:00.881014002 +0000 UTC m=+2055.206117140" watchObservedRunningTime="2026-08-04 18:45:00.881615052 +0000 UTC m=+2055.206718174"
Aug 04 18:45:01.640908 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:01.640817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:45:01.866305 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:01.866264    2579 generic.go:356] "Generic (PLEG): container finished" podID="b1937e65-cf4a-47e4-a049-86c7519a9806" containerID="b1d48f8adda4bee39e2a0dbf0f3da76a6baa476956098902517c1090ae944a41" exitCode=0
Aug 04 18:45:01.866482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:01.866359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr" event={"ID":"b1937e65-cf4a-47e4-a049-86c7519a9806","Type":"ContainerDied","Data":"b1d48f8adda4bee39e2a0dbf0f3da76a6baa476956098902517c1090ae944a41"}
Aug 04 18:45:03.010332 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:03.010301    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"
Aug 04 18:45:03.876961 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:03.876927    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr"
Aug 04 18:45:03.877141 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:03.876965    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764485-rfbdr" event={"ID":"b1937e65-cf4a-47e4-a049-86c7519a9806","Type":"ContainerDied","Data":"0a125a580bbc47b2a99001ea8400a1b974d2d269ef0840a20bd4e8fa4c7dd401"}
Aug 04 18:45:03.877141 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:03.877037    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a125a580bbc47b2a99001ea8400a1b974d2d269ef0840a20bd4e8fa4c7dd401"
Aug 04 18:45:12.331574 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:12.331539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:45:25.038307 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:25.038264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:45:46.265534 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:46.265510    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:45:46.269808 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:46.269785    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:45:59.218908 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.218873    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"]
Aug 04 18:45:59.219297 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.219230    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1937e65-cf4a-47e4-a049-86c7519a9806" containerName="cleanup"
Aug 04 18:45:59.219297 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.219241    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1937e65-cf4a-47e4-a049-86c7519a9806" containerName="cleanup"
Aug 04 18:45:59.219385 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.219304    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1937e65-cf4a-47e4-a049-86c7519a9806" containerName="cleanup"
Aug 04 18:45:59.222303 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.222287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:45:59.225217 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.225198    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:45:59.225331 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.225198    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:45:59.237326 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.237300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"]
Aug 04 18:45:59.302835 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.302797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cdccfb-2806-4b84-af73-c0bb60c9f85d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b\" (UID: \"d2cdccfb-2806-4b84-af73-c0bb60c9f85d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:45:59.403859 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.403823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cdccfb-2806-4b84-af73-c0bb60c9f85d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b\" (UID: \"d2cdccfb-2806-4b84-af73-c0bb60c9f85d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:45:59.404417 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.404397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cdccfb-2806-4b84-af73-c0bb60c9f85d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b\" (UID: \"d2cdccfb-2806-4b84-af73-c0bb60c9f85d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:45:59.532714 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.532608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:45:59.684101 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:45:59.684073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"]
Aug 04 18:45:59.686375 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:45:59.686340    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cdccfb_2806_4b84_af73_c0bb60c9f85d.slice/crio-1ae1602e0b6a0b919c4116efdcc5ddcbcacca314390cd8a47f3ba03e10212530 WatchSource:0}: Error finding container 1ae1602e0b6a0b919c4116efdcc5ddcbcacca314390cd8a47f3ba03e10212530: Status 404 returned error can't find the container with id 1ae1602e0b6a0b919c4116efdcc5ddcbcacca314390cd8a47f3ba03e10212530
Aug 04 18:46:00.167014 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:00.166921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b" event={"ID":"d2cdccfb-2806-4b84-af73-c0bb60c9f85d","Type":"ContainerStarted","Data":"d2c7c747697ae95969b23cce1c08409564643b11432f6cf83d9d472b2af0bcb6"}
Aug 04 18:46:00.167014 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:00.166981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b" event={"ID":"d2cdccfb-2806-4b84-af73-c0bb60c9f85d","Type":"ContainerStarted","Data":"1ae1602e0b6a0b919c4116efdcc5ddcbcacca314390cd8a47f3ba03e10212530"}
Aug 04 18:46:00.184356 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:00.184307    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b" podStartSLOduration=1.184269765 podStartE2EDuration="1.184269765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:46:00.183838213 +0000 UTC m=+2114.508941335" watchObservedRunningTime="2026-08-04 18:46:00.184269765 +0000 UTC m=+2114.509372885"
Aug 04 18:46:01.173649 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:01.173617    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2cdccfb-2806-4b84-af73-c0bb60c9f85d" containerID="d2c7c747697ae95969b23cce1c08409564643b11432f6cf83d9d472b2af0bcb6" exitCode=0
Aug 04 18:46:01.174063 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:01.173704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b" event={"ID":"d2cdccfb-2806-4b84-af73-c0bb60c9f85d","Type":"ContainerDied","Data":"d2c7c747697ae95969b23cce1c08409564643b11432f6cf83d9d472b2af0bcb6"}
Aug 04 18:46:02.316666 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:02.316636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:46:02.328776 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:02.328713    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cdccfb-2806-4b84-af73-c0bb60c9f85d-maas-api-service-ca\") pod \"d2cdccfb-2806-4b84-af73-c0bb60c9f85d\" (UID: \"d2cdccfb-2806-4b84-af73-c0bb60c9f85d\") "
Aug 04 18:46:02.329072 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:02.329049    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cdccfb-2806-4b84-af73-c0bb60c9f85d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2cdccfb-2806-4b84-af73-c0bb60c9f85d" (UID: "d2cdccfb-2806-4b84-af73-c0bb60c9f85d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:46:02.429519 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:02.429433    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cdccfb-2806-4b84-af73-c0bb60c9f85d-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:46:03.185344 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:03.185311    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"
Aug 04 18:46:03.185519 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:03.185346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b" event={"ID":"d2cdccfb-2806-4b84-af73-c0bb60c9f85d","Type":"ContainerDied","Data":"1ae1602e0b6a0b919c4116efdcc5ddcbcacca314390cd8a47f3ba03e10212530"}
Aug 04 18:46:03.185519 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:03.185391    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ae1602e0b6a0b919c4116efdcc5ddcbcacca314390cd8a47f3ba03e10212530"
Aug 04 18:46:10.092068 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:10.092031    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"]
Aug 04 18:46:10.098161 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:10.098136    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f11a0dab-gr45b"]
Aug 04 18:46:10.162438 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:10.162405    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2cdccfb-2806-4b84-af73-c0bb60c9f85d" path="/var/lib/kubelet/pods/d2cdccfb-2806-4b84-af73-c0bb60c9f85d/volumes"
Aug 04 18:46:11.956196 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:46:11.956151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:47:12.284847 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:47:12.284794    2579 controller.go:195] "Failed to update lease" err="Put \"https://aeb9e022d670540fdaf7590f6abafc97-f9f04794ff9f3669.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-137-226.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Aug 04 18:47:13.654429 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:47:13.654376    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-08-04T18:47:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-08-04T18:47:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-08-04T18:47:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-08-04T18:47:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"}]}}\" for node \"ip-10-0-137-226.ec2.internal\": Patch \"https://aeb9e022d670540fdaf7590f6abafc97-f9f04794ff9f3669.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-137-226.ec2.internal/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Aug 04 18:47:46.323815 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:47:46.323782    2579 scope.go:117] "RemoveContainer" containerID="68f70b2d8985a371267fd2a4b79db0d2707ceb12ef06d63e2fa12bbe1dea1a7f"
Aug 04 18:47:46.332624 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:47:46.332596    2579 scope.go:117] "RemoveContainer" containerID="db2c11854da91b29579d0998955566665c4a932b7f35e966eb041832b88c718a"
Aug 04 18:48:06.486757 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:48:06.486639    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:48:46.357539 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:48:46.357502    2579 scope.go:117] "RemoveContainer" containerID="fa13b1356da92d24140ded3baee515e0438223eb113b186fc216ec5ba9dec430"
Aug 04 18:49:46.378433 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:49:46.378353    2579 scope.go:117] "RemoveContainer" containerID="750dd6b5d4d38b7cbb13249988ce79ad6537bff2bea035e883285b733deac028"
Aug 04 18:49:51.929090 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:49:51.929050    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:50:00.837170 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:00.837132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:50:33.826354 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.826320    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"]
Aug 04 18:50:33.826858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.826746    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cdccfb-2806-4b84-af73-c0bb60c9f85d" containerName="revoke-keys"
Aug 04 18:50:33.826858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.826759    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cdccfb-2806-4b84-af73-c0bb60c9f85d" containerName="revoke-keys"
Aug 04 18:50:33.826858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.826830    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cdccfb-2806-4b84-af73-c0bb60c9f85d" containerName="revoke-keys"
Aug 04 18:50:33.829792 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.829775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:33.833879 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.833851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fee88ca8\"/\"kube-root-ca.crt\""
Aug 04 18:50:33.834045 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.833855    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fee88ca8\"/\"default-dockercfg-lkfxn\""
Aug 04 18:50:33.834045 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.833856    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-fee88ca8\"/\"openshift-service-ca.crt\""
Aug 04 18:50:33.834045 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.833855    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-fee88ca8\"/\"e2e-lifecycle-model-fee88ca8-kserve-self-signed-certs\""
Aug 04 18:50:33.843094 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.843066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"]
Aug 04 18:50:33.966777 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.966692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5rt\" (UniqueName: \"kubernetes.io/projected/3c8079a4-1d82-45de-be4d-5bac2b1153f0-kube-api-access-kr5rt\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:33.967015 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.966808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-model-cache\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:33.967015 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.966863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tmp-dir\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:33.967015 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.966894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-home\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:33.967015 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.966934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tls-certs\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:33.967015 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:33.967007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-dshm\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.067965 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.067920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-model-cache\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.067965 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.067969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tmp-dir\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068199 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-home\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068199 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tls-certs\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068199 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068113    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-dshm\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068199 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5rt\" (UniqueName: \"kubernetes.io/projected/3c8079a4-1d82-45de-be4d-5bac2b1153f0-kube-api-access-kr5rt\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068425 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-model-cache\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068426    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-home\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.068482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.068463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tmp-dir\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.070650 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.070631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-dshm\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.070843 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.070825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tls-certs\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.080662 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.080598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5rt\" (UniqueName: \"kubernetes.io/projected/3c8079a4-1d82-45de-be4d-5bac2b1153f0-kube-api-access-kr5rt\") pod \"e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") " pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.139166 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.139128    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:34.285812 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.285782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"]
Aug 04 18:50:34.287595 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:50:34.287566    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c8079a4_1d82_45de_be4d_5bac2b1153f0.slice/crio-f0bd8a5fd8520181f8d628da9b5d76b663d8e872963786312f290b69bf742715 WatchSource:0}: Error finding container f0bd8a5fd8520181f8d628da9b5d76b663d8e872963786312f290b69bf742715: Status 404 returned error can't find the container with id f0bd8a5fd8520181f8d628da9b5d76b663d8e872963786312f290b69bf742715
Aug 04 18:50:34.506131 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.506090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6" event={"ID":"3c8079a4-1d82-45de-be4d-5bac2b1153f0","Type":"ContainerStarted","Data":"7b57df230926135a414c675dd23ee29101ee0887231e9a6f6990482d919eb47a"}
Aug 04 18:50:34.506131 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.506139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6" event={"ID":"3c8079a4-1d82-45de-be4d-5bac2b1153f0","Type":"ContainerStarted","Data":"f0bd8a5fd8520181f8d628da9b5d76b663d8e872963786312f290b69bf742715"}
Aug 04 18:50:34.526828 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:34.526783    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6" podStartSLOduration=1.5267656440000001 podStartE2EDuration="1.526765644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:50:34.526185192 +0000 UTC m=+2388.851288311" watchObservedRunningTime="2026-08-04 18:50:34.526765644 +0000 UTC m=+2388.851868764"
Aug 04 18:50:36.241170 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:36.241136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:50:44.140148 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:44.140092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:44.140148 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:44.140161    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:44.153027 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:44.153000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:44.563809 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:44.563778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:50:46.295771 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:46.295701    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:50:46.302891 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:46.302868    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:50:51.653098 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:50:51.653062    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:51:02.413226 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.413186    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"]
Aug 04 18:51:02.416689 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.416670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:02.420616 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.420593    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:51:02.420896 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.420881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:51:02.433095 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.433063    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"]
Aug 04 18:51:02.525150 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.525111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc88e7e4-675b-495c-af15-0662e3e8e848-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h\" (UID: \"dc88e7e4-675b-495c-af15-0662e3e8e848\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:02.625677 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.625643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc88e7e4-675b-495c-af15-0662e3e8e848-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h\" (UID: \"dc88e7e4-675b-495c-af15-0662e3e8e848\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:02.626297 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.626272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc88e7e4-675b-495c-af15-0662e3e8e848-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h\" (UID: \"dc88e7e4-675b-495c-af15-0662e3e8e848\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:02.726816 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.726779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:02.875409 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:02.875381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"]
Aug 04 18:51:02.877834 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:51:02.877805    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc88e7e4_675b_495c_af15_0662e3e8e848.slice/crio-f70b6177997636c6c7ec5c38b8ee277751a5a4ac0ae3a7d5b2c1790e62b02c40 WatchSource:0}: Error finding container f70b6177997636c6c7ec5c38b8ee277751a5a4ac0ae3a7d5b2c1790e62b02c40: Status 404 returned error can't find the container with id f70b6177997636c6c7ec5c38b8ee277751a5a4ac0ae3a7d5b2c1790e62b02c40
Aug 04 18:51:03.650261 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:03.650231    2579 generic.go:356] "Generic (PLEG): container finished" podID="dc88e7e4-675b-495c-af15-0662e3e8e848" containerID="53fb048d8650a56c7fd19a18ab5bff1e6b9e6fb290658da1a20f0149292c380a" exitCode=0
Aug 04 18:51:03.650657 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:03.650317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h" event={"ID":"dc88e7e4-675b-495c-af15-0662e3e8e848","Type":"ContainerDied","Data":"53fb048d8650a56c7fd19a18ab5bff1e6b9e6fb290658da1a20f0149292c380a"}
Aug 04 18:51:03.650657 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:03.650368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h" event={"ID":"dc88e7e4-675b-495c-af15-0662e3e8e848","Type":"ContainerStarted","Data":"f70b6177997636c6c7ec5c38b8ee277751a5a4ac0ae3a7d5b2c1790e62b02c40"}
Aug 04 18:51:04.792156 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:04.792129    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:04.946990 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:04.946950    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc88e7e4-675b-495c-af15-0662e3e8e848-maas-api-service-ca\") pod \"dc88e7e4-675b-495c-af15-0662e3e8e848\" (UID: \"dc88e7e4-675b-495c-af15-0662e3e8e848\") "
Aug 04 18:51:04.947349 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:04.947326    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc88e7e4-675b-495c-af15-0662e3e8e848-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc88e7e4-675b-495c-af15-0662e3e8e848" (UID: "dc88e7e4-675b-495c-af15-0662e3e8e848"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:51:05.047639 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:05.047607    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc88e7e4-675b-495c-af15-0662e3e8e848-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:05.661138 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:05.661112    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"
Aug 04 18:51:05.661319 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:05.661137    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h" event={"ID":"dc88e7e4-675b-495c-af15-0662e3e8e848","Type":"ContainerDied","Data":"f70b6177997636c6c7ec5c38b8ee277751a5a4ac0ae3a7d5b2c1790e62b02c40"}
Aug 04 18:51:05.661319 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:05.661178    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f70b6177997636c6c7ec5c38b8ee277751a5a4ac0ae3a7d5b2c1790e62b02c40"
Aug 04 18:51:14.530182 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:14.530144    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:51:18.283343 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:18.283304    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"]
Aug 04 18:51:18.287705 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:18.287675    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fee88ca8-2kc5h"]
Aug 04 18:51:20.162039 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:20.162002    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc88e7e4-675b-495c-af15-0662e3e8e848" path="/var/lib/kubelet/pods/dc88e7e4-675b-495c-af15-0662e3e8e848/volumes"
Aug 04 18:51:20.430987 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:20.430906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:51:26.687532 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:26.687493    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"]
Aug 04 18:51:41.707215 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:41.707153    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6" podUID="3c8079a4-1d82-45de-be4d-5bac2b1153f0" containerName="main" containerID="cri-o://7b57df230926135a414c675dd23ee29101ee0887231e9a6f6990482d919eb47a" gracePeriod=45
Aug 04 18:51:41.849910 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:41.849875    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c8079a4-1d82-45de-be4d-5bac2b1153f0" containerID="7b57df230926135a414c675dd23ee29101ee0887231e9a6f6990482d919eb47a" exitCode=0
Aug 04 18:51:41.850108 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:41.849944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6" event={"ID":"3c8079a4-1d82-45de-be4d-5bac2b1153f0","Type":"ContainerDied","Data":"7b57df230926135a414c675dd23ee29101ee0887231e9a6f6990482d919eb47a"}
Aug 04 18:51:41.958268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:41.958202    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:51:42.100463 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100431    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tmp-dir\") pod \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") "
Aug 04 18:51:42.100647 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100497    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tls-certs\") pod \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") "
Aug 04 18:51:42.100647 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100528    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-dshm\") pod \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") "
Aug 04 18:51:42.100647 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-model-cache\") pod \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") "
Aug 04 18:51:42.100647 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100586    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-home\") pod \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") "
Aug 04 18:51:42.100647 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr5rt\" (UniqueName: \"kubernetes.io/projected/3c8079a4-1d82-45de-be4d-5bac2b1153f0-kube-api-access-kr5rt\") pod \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\" (UID: \"3c8079a4-1d82-45de-be4d-5bac2b1153f0\") "
Aug 04 18:51:42.100950 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100792    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c8079a4-1d82-45de-be4d-5bac2b1153f0" (UID: "3c8079a4-1d82-45de-be4d-5bac2b1153f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:51:42.100950 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-home" (OuterVolumeSpecName: "home") pod "3c8079a4-1d82-45de-be4d-5bac2b1153f0" (UID: "3c8079a4-1d82-45de-be4d-5bac2b1153f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:51:42.100950 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100905    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c8079a4-1d82-45de-be4d-5bac2b1153f0" (UID: "3c8079a4-1d82-45de-be4d-5bac2b1153f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:51:42.101053 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.100960    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:42.103022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.102987    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-dshm" (OuterVolumeSpecName: "dshm") pod "3c8079a4-1d82-45de-be4d-5bac2b1153f0" (UID: "3c8079a4-1d82-45de-be4d-5bac2b1153f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:51:42.103022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.103006    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c8079a4-1d82-45de-be4d-5bac2b1153f0" (UID: "3c8079a4-1d82-45de-be4d-5bac2b1153f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:51:42.103022 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.103014    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c8079a4-1d82-45de-be4d-5bac2b1153f0-kube-api-access-kr5rt" (OuterVolumeSpecName: "kube-api-access-kr5rt") pod "3c8079a4-1d82-45de-be4d-5bac2b1153f0" (UID: "3c8079a4-1d82-45de-be4d-5bac2b1153f0"). InnerVolumeSpecName "kube-api-access-kr5rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:51:42.201688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.201650    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8079a4-1d82-45de-be4d-5bac2b1153f0-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:42.201688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.201679    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:42.201688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.201689    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:42.201688 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.201697    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8079a4-1d82-45de-be4d-5bac2b1153f0-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:42.201990 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.201705    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr5rt\" (UniqueName: \"kubernetes.io/projected/3c8079a4-1d82-45de-be4d-5bac2b1153f0-kube-api-access-kr5rt\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:51:42.856421 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.856397    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"
Aug 04 18:51:42.856421 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.856418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6" event={"ID":"3c8079a4-1d82-45de-be4d-5bac2b1153f0","Type":"ContainerDied","Data":"f0bd8a5fd8520181f8d628da9b5d76b663d8e872963786312f290b69bf742715"}
Aug 04 18:51:42.856947 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.856463    2579 scope.go:117] "RemoveContainer" containerID="7b57df230926135a414c675dd23ee29101ee0887231e9a6f6990482d919eb47a"
Aug 04 18:51:42.875234 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.875191    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"]
Aug 04 18:51:42.879923 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:42.879894    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-fee88ca8/e2e-lifecycle-model-fee88ca8-kserve-8685c7f547-fskn6"]
Aug 04 18:51:44.161525 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:51:44.161490    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c8079a4-1d82-45de-be4d-5bac2b1153f0" path="/var/lib/kubelet/pods/3c8079a4-1d82-45de-be4d-5bac2b1153f0/volumes"
Aug 04 18:52:12.625393 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:52:12.625350    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:52:24.281269 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:52:24.281227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:52:30.726294 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:52:30.726257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:52:38.937514 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:52:38.937477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:52:46.417446 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:52:46.417340    2579 scope.go:117] "RemoveContainer" containerID="d2c7c747697ae95969b23cce1c08409564643b11432f6cf83d9d472b2af0bcb6"
Aug 04 18:53:26.841928 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:53:26.841886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:54:01.259600 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:01.259561    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:54:36.217994 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.217960    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"]
Aug 04 18:54:36.218466 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.218317    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c8079a4-1d82-45de-be4d-5bac2b1153f0" containerName="main"
Aug 04 18:54:36.218466 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.218328    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c8079a4-1d82-45de-be4d-5bac2b1153f0" containerName="main"
Aug 04 18:54:36.218466 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.218349    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc88e7e4-675b-495c-af15-0662e3e8e848" containerName="revoke-keys"
Aug 04 18:54:36.218466 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.218356    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc88e7e4-675b-495c-af15-0662e3e8e848" containerName="revoke-keys"
Aug 04 18:54:36.218466 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.218416    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c8079a4-1d82-45de-be4d-5bac2b1153f0" containerName="main"
Aug 04 18:54:36.218466 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.218425    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc88e7e4-675b-495c-af15-0662e3e8e848" containerName="revoke-keys"
Aug 04 18:54:36.226617 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.226586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.229377 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.229349    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-890d1a\"/\"kube-root-ca.crt\""
Aug 04 18:54:36.229520 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.229348    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-890d1a\"/\"openshift-service-ca.crt\""
Aug 04 18:54:36.230444 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.230417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-890d1a\"/\"default-dockercfg-rv8b7\""
Aug 04 18:54:36.230572 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.230536    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-890d1a\"/\"test-model-890d1a-kserve-self-signed-certs\""
Aug 04 18:54:36.235156 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.235129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"]
Aug 04 18:54:36.278675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.278637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvm84\" (UniqueName: \"kubernetes.io/projected/88a560f2-c83d-4948-bb0c-eaf040a85661-kube-api-access-lvm84\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.278675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.278684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-home\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.278973 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.278703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-tmp-dir\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.278973 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.278821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-model-cache\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.278973 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.278852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a560f2-c83d-4948-bb0c-eaf040a85661-tls-certs\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.278973 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.278879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-dshm\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.379511 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.379477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-dshm\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.379698 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.379549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvm84\" (UniqueName: \"kubernetes.io/projected/88a560f2-c83d-4948-bb0c-eaf040a85661-kube-api-access-lvm84\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.379698 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.379582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-home\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.379698 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.379601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-tmp-dir\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.379698 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.379631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-model-cache\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.379698 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.379650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a560f2-c83d-4948-bb0c-eaf040a85661-tls-certs\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.380055 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.380032    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-home\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.380108 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.380088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-tmp-dir\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.380150 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.380101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-model-cache\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.382061 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.382019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-dshm\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.382236 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.382219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a560f2-c83d-4948-bb0c-eaf040a85661-tls-certs\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.389361 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.389332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvm84\" (UniqueName: \"kubernetes.io/projected/88a560f2-c83d-4948-bb0c-eaf040a85661-kube-api-access-lvm84\") pod \"test-model-890d1a-kserve-65f7d545f5-ttlrt\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") " pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.537541 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.537444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:36.682404 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.682375    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"]
Aug 04 18:54:36.684443 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:54:36.684399    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88a560f2_c83d_4948_bb0c_eaf040a85661.slice/crio-89a0ee54384c82a1d3c89e2fc2f7631ae8452cdfe28115205bb5b0a1d04d8568 WatchSource:0}: Error finding container 89a0ee54384c82a1d3c89e2fc2f7631ae8452cdfe28115205bb5b0a1d04d8568: Status 404 returned error can't find the container with id 89a0ee54384c82a1d3c89e2fc2f7631ae8452cdfe28115205bb5b0a1d04d8568
Aug 04 18:54:36.703472 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:36.703442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt" event={"ID":"88a560f2-c83d-4948-bb0c-eaf040a85661","Type":"ContainerStarted","Data":"89a0ee54384c82a1d3c89e2fc2f7631ae8452cdfe28115205bb5b0a1d04d8568"}
Aug 04 18:54:37.709310 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:37.709274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt" event={"ID":"88a560f2-c83d-4948-bb0c-eaf040a85661","Type":"ContainerStarted","Data":"63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c"}
Aug 04 18:54:37.730983 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:37.730930    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt" podStartSLOduration=1.730915032 podStartE2EDuration="1.730915032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:54:37.729397413 +0000 UTC m=+2632.054500534" watchObservedRunningTime="2026-08-04 18:54:37.730915032 +0000 UTC m=+2632.056018152"
Aug 04 18:54:40.061086 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:40.061045    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:54:46.537830 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:46.537785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:46.537830 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:46.537839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:46.550757 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:46.550706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:54:46.763958 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:54:46.763927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:55:00.826645 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.826607    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"]
Aug 04 18:55:00.830107 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.830085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:00.833107 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.833076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-716d7c\"/\"openshift-service-ca.crt\""
Aug 04 18:55:00.834201 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.834177    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-716d7c\"/\"default-dockercfg-4wzzh\""
Aug 04 18:55:00.834345 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.834257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-716d7c\"/\"test-model-716d7c-kserve-self-signed-certs\""
Aug 04 18:55:00.834345 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.834298    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-716d7c\"/\"kube-root-ca.crt\""
Aug 04 18:55:00.850506 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.850471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"]
Aug 04 18:55:00.900005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.899963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tls-certs\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:00.900005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.900009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg88n\" (UniqueName: \"kubernetes.io/projected/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-kube-api-access-hg88n\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:00.900250 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.900041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tmp-dir\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:00.900250 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.900146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-model-cache\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:00.900250 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.900190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-dshm\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:00.900362 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:00.900268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-home\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.000967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-model-cache\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001009 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-dshm\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-home\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tls-certs\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg88n\" (UniqueName: \"kubernetes.io/projected/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-kube-api-access-hg88n\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tmp-dir\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001497 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-model-cache\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001550 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tmp-dir\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.001550 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.001467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-home\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.003593 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.003574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-dshm\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.003910 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.003895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tls-certs\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.012163 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.012140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg88n\" (UniqueName: \"kubernetes.io/projected/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-kube-api-access-hg88n\") pod \"test-model-716d7c-kserve-85bd5cc8b5-v4g6s\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") " pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.139907 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.139813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:01.285745 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.285693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"]
Aug 04 18:55:01.287873 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:55:01.287846    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb699ee59_2c65_4dfd_bbb0_3b277c0b719e.slice/crio-d4f994c69e3fd4ad8c95fdc8ad8816695ad5c332021514700b636b7e180a7df2 WatchSource:0}: Error finding container d4f994c69e3fd4ad8c95fdc8ad8816695ad5c332021514700b636b7e180a7df2: Status 404 returned error can't find the container with id d4f994c69e3fd4ad8c95fdc8ad8816695ad5c332021514700b636b7e180a7df2
Aug 04 18:55:01.825158 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.825114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s" event={"ID":"b699ee59-2c65-4dfd-bbb0-3b277c0b719e","Type":"ContainerStarted","Data":"4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38"}
Aug 04 18:55:01.825345 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.825168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s" event={"ID":"b699ee59-2c65-4dfd-bbb0-3b277c0b719e","Type":"ContainerStarted","Data":"d4f994c69e3fd4ad8c95fdc8ad8816695ad5c332021514700b636b7e180a7df2"}
Aug 04 18:55:01.848964 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:01.848909    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s" podStartSLOduration=1.848892467 podStartE2EDuration="1.848892467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:55:01.846938337 +0000 UTC m=+2656.172041483" watchObservedRunningTime="2026-08-04 18:55:01.848892467 +0000 UTC m=+2656.173995587"
Aug 04 18:55:03.635919 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:03.635880    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:55:11.140935 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:11.140892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:11.141486 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:11.140953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:11.153716 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:11.153685    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:11.888743 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:11.888686    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:11.942025 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:11.941990    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:55:41.767249 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:41.767164    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"]
Aug 04 18:55:42.690465 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.690427    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"]
Aug 04 18:55:42.842400 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.842359    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"]
Aug 04 18:55:42.847018 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.846989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:42.850348 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.850322    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:55:42.850509 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.850355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:55:42.856523 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.856493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"]
Aug 04 18:55:42.878268 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.878235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc786a4-f32f-47b7-b701-7016bc66b916-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz\" (UID: \"fcc786a4-f32f-47b7-b701-7016bc66b916\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:42.979657 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.979568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc786a4-f32f-47b7-b701-7016bc66b916-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz\" (UID: \"fcc786a4-f32f-47b7-b701-7016bc66b916\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:42.980267 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:42.980247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc786a4-f32f-47b7-b701-7016bc66b916-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz\" (UID: \"fcc786a4-f32f-47b7-b701-7016bc66b916\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:43.159599 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:43.159564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:43.309410 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:43.309380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"]
Aug 04 18:55:43.311322 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:55:43.311286    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc786a4_f32f_47b7_b701_7016bc66b916.slice/crio-f5eb668fc518ebb9a8b96160987adceb789233b610b88cec59bd1693a69c84e1 WatchSource:0}: Error finding container f5eb668fc518ebb9a8b96160987adceb789233b610b88cec59bd1693a69c84e1: Status 404 returned error can't find the container with id f5eb668fc518ebb9a8b96160987adceb789233b610b88cec59bd1693a69c84e1
Aug 04 18:55:44.033789 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:44.033751    2579 generic.go:356] "Generic (PLEG): container finished" podID="fcc786a4-f32f-47b7-b701-7016bc66b916" containerID="6b071aecfcae72756aca65383b208c84044e48cf226a72d2226d9ac4c1276247" exitCode=0
Aug 04 18:55:44.034163 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:44.033802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz" event={"ID":"fcc786a4-f32f-47b7-b701-7016bc66b916","Type":"ContainerDied","Data":"6b071aecfcae72756aca65383b208c84044e48cf226a72d2226d9ac4c1276247"}
Aug 04 18:55:44.034163 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:44.033841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz" event={"ID":"fcc786a4-f32f-47b7-b701-7016bc66b916","Type":"ContainerStarted","Data":"f5eb668fc518ebb9a8b96160987adceb789233b610b88cec59bd1693a69c84e1"}
Aug 04 18:55:45.170483 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:45.170453    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:45.200888 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:45.200859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc786a4-f32f-47b7-b701-7016bc66b916-maas-api-service-ca\") pod \"fcc786a4-f32f-47b7-b701-7016bc66b916\" (UID: \"fcc786a4-f32f-47b7-b701-7016bc66b916\") "
Aug 04 18:55:45.201246 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:45.201225    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcc786a4-f32f-47b7-b701-7016bc66b916-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fcc786a4-f32f-47b7-b701-7016bc66b916" (UID: "fcc786a4-f32f-47b7-b701-7016bc66b916"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:55:45.301858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:45.301765    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc786a4-f32f-47b7-b701-7016bc66b916-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:45.634579 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:45.634472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:55:46.045027 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:46.044993    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"
Aug 04 18:55:46.045201 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:46.045023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz" event={"ID":"fcc786a4-f32f-47b7-b701-7016bc66b916","Type":"ContainerDied","Data":"f5eb668fc518ebb9a8b96160987adceb789233b610b88cec59bd1693a69c84e1"}
Aug 04 18:55:46.045201 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:46.045076    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5eb668fc518ebb9a8b96160987adceb789233b610b88cec59bd1693a69c84e1"
Aug 04 18:55:46.333282 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:46.333200    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:55:46.339980 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:46.339953    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 18:55:47.554313 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:47.554275    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"]
Aug 04 18:55:47.559500 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:47.559470    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-890d1a-x5hbz"]
Aug 04 18:55:48.162756 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:48.162706    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcc786a4-f32f-47b7-b701-7016bc66b916" path="/var/lib/kubelet/pods/fcc786a4-f32f-47b7-b701-7016bc66b916/volumes"
Aug 04 18:55:53.132631 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:53.132583    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:55:56.787414 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:56.787372    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt" podUID="88a560f2-c83d-4948-bb0c-eaf040a85661" containerName="main" containerID="cri-o://63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c" gracePeriod=45
Aug 04 18:55:57.042303 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.042237    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:55:57.098612 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.098579    2579 generic.go:356] "Generic (PLEG): container finished" podID="88a560f2-c83d-4948-bb0c-eaf040a85661" containerID="63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c" exitCode=0
Aug 04 18:55:57.098797 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.098626    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"
Aug 04 18:55:57.098797 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.098662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt" event={"ID":"88a560f2-c83d-4948-bb0c-eaf040a85661","Type":"ContainerDied","Data":"63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c"}
Aug 04 18:55:57.098797 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.098705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt" event={"ID":"88a560f2-c83d-4948-bb0c-eaf040a85661","Type":"ContainerDied","Data":"89a0ee54384c82a1d3c89e2fc2f7631ae8452cdfe28115205bb5b0a1d04d8568"}
Aug 04 18:55:57.098797 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.098742    2579 scope.go:117] "RemoveContainer" containerID="63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c"
Aug 04 18:55:57.109226 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.109187    2579 scope.go:117] "RemoveContainer" containerID="63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c"
Aug 04 18:55:57.109740 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:55:57.109691    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c\": container with ID starting with 63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c not found: ID does not exist" containerID="63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c"
Aug 04 18:55:57.109858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.109830    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c"} err="failed to get container status \"63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c\": rpc error: code = NotFound desc = could not find container \"63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c\": container with ID starting with 63d3aafbfe796e9d4fde3329a43bd23d77c3670dc601ceafffb357ad68294d9c not found: ID does not exist"
Aug 04 18:55:57.118071 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvm84\" (UniqueName: \"kubernetes.io/projected/88a560f2-c83d-4948-bb0c-eaf040a85661-kube-api-access-lvm84\") pod \"88a560f2-c83d-4948-bb0c-eaf040a85661\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") "
Aug 04 18:55:57.118174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118087    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-model-cache\") pod \"88a560f2-c83d-4948-bb0c-eaf040a85661\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") "
Aug 04 18:55:57.118174 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-home\") pod \"88a560f2-c83d-4948-bb0c-eaf040a85661\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") "
Aug 04 18:55:57.118282 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118176    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a560f2-c83d-4948-bb0c-eaf040a85661-tls-certs\") pod \"88a560f2-c83d-4948-bb0c-eaf040a85661\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") "
Aug 04 18:55:57.118282 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118214    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-dshm\") pod \"88a560f2-c83d-4948-bb0c-eaf040a85661\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") "
Aug 04 18:55:57.118282 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118247    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-tmp-dir\") pod \"88a560f2-c83d-4948-bb0c-eaf040a85661\" (UID: \"88a560f2-c83d-4948-bb0c-eaf040a85661\") "
Aug 04 18:55:57.118448 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118424    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-home" (OuterVolumeSpecName: "home") pod "88a560f2-c83d-4948-bb0c-eaf040a85661" (UID: "88a560f2-c83d-4948-bb0c-eaf040a85661"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:57.118510 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118441    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-model-cache" (OuterVolumeSpecName: "model-cache") pod "88a560f2-c83d-4948-bb0c-eaf040a85661" (UID: "88a560f2-c83d-4948-bb0c-eaf040a85661"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:57.118629 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118609    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:57.118706 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118640    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:57.118706 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.118609    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88a560f2-c83d-4948-bb0c-eaf040a85661" (UID: "88a560f2-c83d-4948-bb0c-eaf040a85661"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:57.120581 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.120559    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88a560f2-c83d-4948-bb0c-eaf040a85661-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88a560f2-c83d-4948-bb0c-eaf040a85661" (UID: "88a560f2-c83d-4948-bb0c-eaf040a85661"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:55:57.120984 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.120965    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-dshm" (OuterVolumeSpecName: "dshm") pod "88a560f2-c83d-4948-bb0c-eaf040a85661" (UID: "88a560f2-c83d-4948-bb0c-eaf040a85661"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:57.120984 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.120972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88a560f2-c83d-4948-bb0c-eaf040a85661-kube-api-access-lvm84" (OuterVolumeSpecName: "kube-api-access-lvm84") pod "88a560f2-c83d-4948-bb0c-eaf040a85661" (UID: "88a560f2-c83d-4948-bb0c-eaf040a85661"). InnerVolumeSpecName "kube-api-access-lvm84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:55:57.220081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.220041    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvm84\" (UniqueName: \"kubernetes.io/projected/88a560f2-c83d-4948-bb0c-eaf040a85661-kube-api-access-lvm84\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:57.220081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.220073    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88a560f2-c83d-4948-bb0c-eaf040a85661-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:57.220081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.220082    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:57.220081 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.220091    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88a560f2-c83d-4948-bb0c-eaf040a85661-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:57.426953 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.426918    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"]
Aug 04 18:55:57.431454 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.431421    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-890d1a/test-model-890d1a-kserve-65f7d545f5-ttlrt"]
Aug 04 18:55:57.710419 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.710373    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s" podUID="b699ee59-2c65-4dfd-bbb0-3b277c0b719e" containerName="main" containerID="cri-o://4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38" gracePeriod=45
Aug 04 18:55:57.953215 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:57.953188    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:58.026429 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026325    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-home\") pod \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") "
Aug 04 18:55:58.026429 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026425    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-dshm\") pod \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") "
Aug 04 18:55:58.026675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026453    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-model-cache\") pod \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") "
Aug 04 18:55:58.026675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tls-certs\") pod \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") "
Aug 04 18:55:58.026675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026523    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tmp-dir\") pod \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") "
Aug 04 18:55:58.026675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg88n\" (UniqueName: \"kubernetes.io/projected/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-kube-api-access-hg88n\") pod \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\" (UID: \"b699ee59-2c65-4dfd-bbb0-3b277c0b719e\") "
Aug 04 18:55:58.026675 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026590    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-home" (OuterVolumeSpecName: "home") pod "b699ee59-2c65-4dfd-bbb0-3b277c0b719e" (UID: "b699ee59-2c65-4dfd-bbb0-3b277c0b719e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:58.026961 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026767    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b699ee59-2c65-4dfd-bbb0-3b277c0b719e" (UID: "b699ee59-2c65-4dfd-bbb0-3b277c0b719e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:58.026961 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026826    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:58.026961 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.026889    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b699ee59-2c65-4dfd-bbb0-3b277c0b719e" (UID: "b699ee59-2c65-4dfd-bbb0-3b277c0b719e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:58.028999 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.028968    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-dshm" (OuterVolumeSpecName: "dshm") pod "b699ee59-2c65-4dfd-bbb0-3b277c0b719e" (UID: "b699ee59-2c65-4dfd-bbb0-3b277c0b719e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 18:55:58.029127 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.029011    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b699ee59-2c65-4dfd-bbb0-3b277c0b719e" (UID: "b699ee59-2c65-4dfd-bbb0-3b277c0b719e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 18:55:58.029127 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.029064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-kube-api-access-hg88n" (OuterVolumeSpecName: "kube-api-access-hg88n") pod "b699ee59-2c65-4dfd-bbb0-3b277c0b719e" (UID: "b699ee59-2c65-4dfd-bbb0-3b277c0b719e"). InnerVolumeSpecName "kube-api-access-hg88n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 18:55:58.106608 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.106569    2579 generic.go:356] "Generic (PLEG): container finished" podID="b699ee59-2c65-4dfd-bbb0-3b277c0b719e" containerID="4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38" exitCode=0
Aug 04 18:55:58.106806 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.106614    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"
Aug 04 18:55:58.106806 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.106615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s" event={"ID":"b699ee59-2c65-4dfd-bbb0-3b277c0b719e","Type":"ContainerDied","Data":"4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38"}
Aug 04 18:55:58.106806 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.106744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s" event={"ID":"b699ee59-2c65-4dfd-bbb0-3b277c0b719e","Type":"ContainerDied","Data":"d4f994c69e3fd4ad8c95fdc8ad8816695ad5c332021514700b636b7e180a7df2"}
Aug 04 18:55:58.106806 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.106770    2579 scope.go:117] "RemoveContainer" containerID="4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38"
Aug 04 18:55:58.116434 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.116411    2579 scope.go:117] "RemoveContainer" containerID="4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38"
Aug 04 18:55:58.116695 ip-10-0-137-226 kubenswrapper[2579]: E0804 18:55:58.116672    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38\": container with ID starting with 4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38 not found: ID does not exist" containerID="4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38"
Aug 04 18:55:58.116806 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.116704    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38"} err="failed to get container status \"4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38\": rpc error: code = NotFound desc = could not find container \"4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38\": container with ID starting with 4ec9222be3cbb10495e09b0d02133195de20bad64d3b67a7dda7e8c7f4dd2d38 not found: ID does not exist"
Aug 04 18:55:58.128004 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.127971    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:58.128191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.128005    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:58.128191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.128030    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:58.128191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.128070    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:58.128191 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.128084    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg88n\" (UniqueName: \"kubernetes.io/projected/b699ee59-2c65-4dfd-bbb0-3b277c0b719e-kube-api-access-hg88n\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:55:58.130292 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.130264    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"]
Aug 04 18:55:58.132350 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.132325    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-716d7c/test-model-716d7c-kserve-85bd5cc8b5-v4g6s"]
Aug 04 18:55:58.162321 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.162281    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88a560f2-c83d-4948-bb0c-eaf040a85661" path="/var/lib/kubelet/pods/88a560f2-c83d-4948-bb0c-eaf040a85661/volumes"
Aug 04 18:55:58.162687 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:55:58.162673    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b699ee59-2c65-4dfd-bbb0-3b277c0b719e" path="/var/lib/kubelet/pods/b699ee59-2c65-4dfd-bbb0-3b277c0b719e/volumes"
Aug 04 18:56:00.508524 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.508482    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"]
Aug 04 18:56:00.509032 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509009    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b699ee59-2c65-4dfd-bbb0-3b277c0b719e" containerName="main"
Aug 04 18:56:00.509032 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509028    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b699ee59-2c65-4dfd-bbb0-3b277c0b719e" containerName="main"
Aug 04 18:56:00.509175 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509072    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a560f2-c83d-4948-bb0c-eaf040a85661" containerName="main"
Aug 04 18:56:00.509175 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509083    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a560f2-c83d-4948-bb0c-eaf040a85661" containerName="main"
Aug 04 18:56:00.509175 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509097    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc786a4-f32f-47b7-b701-7016bc66b916" containerName="revoke-keys"
Aug 04 18:56:00.509175 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509105    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc786a4-f32f-47b7-b701-7016bc66b916" containerName="revoke-keys"
Aug 04 18:56:00.509367 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509202    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcc786a4-f32f-47b7-b701-7016bc66b916" containerName="revoke-keys"
Aug 04 18:56:00.509367 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509214    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b699ee59-2c65-4dfd-bbb0-3b277c0b719e" containerName="main"
Aug 04 18:56:00.509367 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.509224    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a560f2-c83d-4948-bb0c-eaf040a85661" containerName="main"
Aug 04 18:56:00.513482 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.513459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:00.516203 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.516180    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:56:00.516346 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.516264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:56:00.522865 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.522836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"]
Aug 04 18:56:00.652156 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.652114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a129cd7-fdb5-4231-a54c-fa5cde34e71a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-716d7c-np66n\" (UID: \"4a129cd7-fdb5-4231-a54c-fa5cde34e71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:00.753745 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.753680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a129cd7-fdb5-4231-a54c-fa5cde34e71a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-716d7c-np66n\" (UID: \"4a129cd7-fdb5-4231-a54c-fa5cde34e71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:00.754379 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.754355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a129cd7-fdb5-4231-a54c-fa5cde34e71a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-716d7c-np66n\" (UID: \"4a129cd7-fdb5-4231-a54c-fa5cde34e71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:00.824863 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.824786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:00.974046 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:00.973966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"]
Aug 04 18:56:00.976377 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:56:00.976350    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a129cd7_fdb5_4231_a54c_fa5cde34e71a.slice/crio-fc601b84d8d47793a69fd06eda220bf1a9d1b8c22f59241306824e148d6eb17c WatchSource:0}: Error finding container fc601b84d8d47793a69fd06eda220bf1a9d1b8c22f59241306824e148d6eb17c: Status 404 returned error can't find the container with id fc601b84d8d47793a69fd06eda220bf1a9d1b8c22f59241306824e148d6eb17c
Aug 04 18:56:01.124854 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:01.124759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n" event={"ID":"4a129cd7-fdb5-4231-a54c-fa5cde34e71a","Type":"ContainerStarted","Data":"fc601b84d8d47793a69fd06eda220bf1a9d1b8c22f59241306824e148d6eb17c"}
Aug 04 18:56:02.131571 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:02.131535    2579 generic.go:356] "Generic (PLEG): container finished" podID="4a129cd7-fdb5-4231-a54c-fa5cde34e71a" containerID="b1583bb5646bc0e6323d0d544fe51dedec72b93c52067fa2b4412f3768d720c1" exitCode=0
Aug 04 18:56:02.131984 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:02.131596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n" event={"ID":"4a129cd7-fdb5-4231-a54c-fa5cde34e71a","Type":"ContainerDied","Data":"b1583bb5646bc0e6323d0d544fe51dedec72b93c52067fa2b4412f3768d720c1"}
Aug 04 18:56:03.267743 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:03.267706    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:03.379058 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:03.379011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a129cd7-fdb5-4231-a54c-fa5cde34e71a-maas-api-service-ca\") pod \"4a129cd7-fdb5-4231-a54c-fa5cde34e71a\" (UID: \"4a129cd7-fdb5-4231-a54c-fa5cde34e71a\") "
Aug 04 18:56:03.379416 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:03.379392    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a129cd7-fdb5-4231-a54c-fa5cde34e71a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a129cd7-fdb5-4231-a54c-fa5cde34e71a" (UID: "4a129cd7-fdb5-4231-a54c-fa5cde34e71a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:56:03.480225 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:03.480190    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a129cd7-fdb5-4231-a54c-fa5cde34e71a-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:56:04.143074 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:04.143045    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"
Aug 04 18:56:04.143242 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:04.143044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n" event={"ID":"4a129cd7-fdb5-4231-a54c-fa5cde34e71a","Type":"ContainerDied","Data":"fc601b84d8d47793a69fd06eda220bf1a9d1b8c22f59241306824e148d6eb17c"}
Aug 04 18:56:04.143242 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:04.143181    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc601b84d8d47793a69fd06eda220bf1a9d1b8c22f59241306824e148d6eb17c"
Aug 04 18:56:11.411307 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:11.411262    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"]
Aug 04 18:56:11.415105 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:11.415074    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-716d7c-np66n"]
Aug 04 18:56:12.162099 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:12.162062    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a129cd7-fdb5-4231-a54c-fa5cde34e71a" path="/var/lib/kubelet/pods/4a129cd7-fdb5-4231-a54c-fa5cde34e71a/volumes"
Aug 04 18:56:13.540547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:13.540514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:56:26.926583 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:26.926549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:56:55.734337 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:56:55.734297    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:57:20.655246 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.655205    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"]
Aug 04 18:57:20.655821 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.655574    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a129cd7-fdb5-4231-a54c-fa5cde34e71a" containerName="revoke-keys"
Aug 04 18:57:20.655821 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.655586    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a129cd7-fdb5-4231-a54c-fa5cde34e71a" containerName="revoke-keys"
Aug 04 18:57:20.655821 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.655664    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a129cd7-fdb5-4231-a54c-fa5cde34e71a" containerName="revoke-keys"
Aug 04 18:57:20.658855 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.658839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:20.661651 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.661613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:57:20.661800 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.661745    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:57:20.669229 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.669202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"]
Aug 04 18:57:20.751899 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.751851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-95504a-sszfv\" (UID: \"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:20.852950 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.852908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-95504a-sszfv\" (UID: \"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:20.853558 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.853538    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-95504a-sszfv\" (UID: \"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:20.969692 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:20.969654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:21.117780 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:57:21.117749    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4d766c_ec93_4ed7_9a1b_9c57cc4ea6bb.slice/crio-53a7a37b3325720276cfd038b644a09cf1efae3b92feb545a103c4ac13a69c14 WatchSource:0}: Error finding container 53a7a37b3325720276cfd038b644a09cf1efae3b92feb545a103c4ac13a69c14: Status 404 returned error can't find the container with id 53a7a37b3325720276cfd038b644a09cf1efae3b92feb545a103c4ac13a69c14
Aug 04 18:57:21.119304 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:21.119276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"]
Aug 04 18:57:21.530029 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:21.529939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv" event={"ID":"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb","Type":"ContainerStarted","Data":"ced64f15d49cf5a271e0b04b7769f287e0f6bbe57c7f6a7f13e00f45487296a2"}
Aug 04 18:57:21.530029 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:21.529991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv" event={"ID":"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb","Type":"ContainerStarted","Data":"53a7a37b3325720276cfd038b644a09cf1efae3b92feb545a103c4ac13a69c14"}
Aug 04 18:57:21.551197 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:21.551146    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv" podStartSLOduration=1.551125823 podStartE2EDuration="1.551125823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:57:21.549534235 +0000 UTC m=+2795.874637366" watchObservedRunningTime="2026-08-04 18:57:21.551125823 +0000 UTC m=+2795.876228940"
Aug 04 18:57:22.542222 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:22.542184    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb" containerID="ced64f15d49cf5a271e0b04b7769f287e0f6bbe57c7f6a7f13e00f45487296a2" exitCode=0
Aug 04 18:57:22.542630 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:22.542274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv" event={"ID":"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb","Type":"ContainerDied","Data":"ced64f15d49cf5a271e0b04b7769f287e0f6bbe57c7f6a7f13e00f45487296a2"}
Aug 04 18:57:23.681314 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:23.681286    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:23.781432 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:23.781392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb-maas-api-service-ca\") pod \"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb\" (UID: \"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb\") "
Aug 04 18:57:23.781792 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:23.781768    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb" (UID: "6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:57:23.882440 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:23.882336    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:57:24.553593 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:24.553563    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"
Aug 04 18:57:24.553792 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:24.553597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv" event={"ID":"6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb","Type":"ContainerDied","Data":"53a7a37b3325720276cfd038b644a09cf1efae3b92feb545a103c4ac13a69c14"}
Aug 04 18:57:24.553792 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:24.553645    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53a7a37b3325720276cfd038b644a09cf1efae3b92feb545a103c4ac13a69c14"
Aug 04 18:57:36.524117 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:36.524076    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"]
Aug 04 18:57:36.528502 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:36.528468    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-95504a-sszfv"]
Aug 04 18:57:38.162428 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:38.162394    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb" path="/var/lib/kubelet/pods/6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb/volumes"
Aug 04 18:57:38.934419 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:38.934385    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:57:44.172714 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.172677    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"]
Aug 04 18:57:44.173232 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.173200    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb" containerName="revoke-keys"
Aug 04 18:57:44.173232 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.173220    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb" containerName="revoke-keys"
Aug 04 18:57:44.173360 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.173348    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4d766c-ec93-4ed7-9a1b-9c57cc4ea6bb" containerName="revoke-keys"
Aug 04 18:57:44.176793 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.176771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:44.179348 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.179317    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 18:57:44.179348 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.179338    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 18:57:44.186242 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.186213    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"]
Aug 04 18:57:44.255870 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.255831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd\" (UID: \"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:44.356858 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.356811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd\" (UID: \"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:44.357395 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.357377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd\" (UID: \"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:44.488578 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.488543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:44.633369 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.633344    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"]
Aug 04 18:57:44.636050 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:57:44.636020    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eaac6c_8d1d_4b4e_83d1_6918604f3d0f.slice/crio-80d5dfe1331a789880ae2b843f34d8978a37b16cfe4d319c369bcfb5e6921c1a WatchSource:0}: Error finding container 80d5dfe1331a789880ae2b843f34d8978a37b16cfe4d319c369bcfb5e6921c1a: Status 404 returned error can't find the container with id 80d5dfe1331a789880ae2b843f34d8978a37b16cfe4d319c369bcfb5e6921c1a
Aug 04 18:57:44.652233 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:44.652199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd" event={"ID":"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f","Type":"ContainerStarted","Data":"80d5dfe1331a789880ae2b843f34d8978a37b16cfe4d319c369bcfb5e6921c1a"}
Aug 04 18:57:45.659767 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:45.659670    2579 generic.go:356] "Generic (PLEG): container finished" podID="70eaac6c-8d1d-4b4e-83d1-6918604f3d0f" containerID="9341bbb04d24eaac399f556b80434953ce5da3115b2c133b3dd5ec11bf0e19ad" exitCode=0
Aug 04 18:57:45.659767 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:45.659710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd" event={"ID":"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f","Type":"ContainerDied","Data":"9341bbb04d24eaac399f556b80434953ce5da3115b2c133b3dd5ec11bf0e19ad"}
Aug 04 18:57:46.487503 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:46.487463    2579 scope.go:117] "RemoveContainer" containerID="53fb048d8650a56c7fd19a18ab5bff1e6b9e6fb290658da1a20f0149292c380a"
Aug 04 18:57:46.802631 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:46.802604    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:46.878757 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:46.878707    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f-maas-api-service-ca\") pod \"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f\" (UID: \"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f\") "
Aug 04 18:57:46.879074 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:46.879050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70eaac6c-8d1d-4b4e-83d1-6918604f3d0f" (UID: "70eaac6c-8d1d-4b4e-83d1-6918604f3d0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 18:57:46.980280 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:46.980228    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 18:57:47.671109 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:47.671072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd" event={"ID":"70eaac6c-8d1d-4b4e-83d1-6918604f3d0f","Type":"ContainerDied","Data":"80d5dfe1331a789880ae2b843f34d8978a37b16cfe4d319c369bcfb5e6921c1a"}
Aug 04 18:57:47.671287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:47.671122    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80d5dfe1331a789880ae2b843f34d8978a37b16cfe4d319c369bcfb5e6921c1a"
Aug 04 18:57:47.671287 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:47.671083    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"
Aug 04 18:57:53.981048 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:53.981011    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"]
Aug 04 18:57:53.987122 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:53.987091    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0de7a2-6d6bd"]
Aug 04 18:57:54.162377 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:54.162328    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70eaac6c-8d1d-4b4e-83d1-6918604f3d0f" path="/var/lib/kubelet/pods/70eaac6c-8d1d-4b4e-83d1-6918604f3d0f/volumes"
Aug 04 18:57:56.128839 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:57:56.128798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:58:09.435959 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:58:09.435919    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:58:42.731247 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:58:42.731158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:59:07.607183 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.607142    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"]
Aug 04 18:59:07.607704 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.607507    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70eaac6c-8d1d-4b4e-83d1-6918604f3d0f" containerName="revoke-keys"
Aug 04 18:59:07.607704 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.607519    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="70eaac6c-8d1d-4b4e-83d1-6918604f3d0f" containerName="revoke-keys"
Aug 04 18:59:07.607704 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.607596    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="70eaac6c-8d1d-4b4e-83d1-6918604f3d0f" containerName="revoke-keys"
Aug 04 18:59:07.610525 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.610504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.613207 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.613181    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"openshift-service-ca.crt\""
Aug 04 18:59:07.614285 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.614260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"default-dockercfg-dqtfl\""
Aug 04 18:59:07.614402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.614284    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"auth-test-model-219d48-kserve-self-signed-certs\""
Aug 04 18:59:07.614402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.614308    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"kube-root-ca.crt\""
Aug 04 18:59:07.622920 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.622893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"]
Aug 04 18:59:07.702772 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.702710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7skrq\" (UniqueName: \"kubernetes.io/projected/fbcad529-9948-491b-8e9f-053af0b5c6d8-kube-api-access-7skrq\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.702954 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.702782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-model-cache\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.702954 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.702811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-tmp-dir\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.702954 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.702839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-dshm\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.703067 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.702951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcad529-9948-491b-8e9f-053af0b5c6d8-tls-certs\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.703067 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.702999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-home\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.804455 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-dshm\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.804633 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcad529-9948-491b-8e9f-053af0b5c6d8-tls-certs\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.804633 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-home\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.804633 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7skrq\" (UniqueName: \"kubernetes.io/projected/fbcad529-9948-491b-8e9f-053af0b5c6d8-kube-api-access-7skrq\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.804633 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-model-cache\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.804884 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-tmp-dir\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.805005 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-home\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.805141 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.804985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-model-cache\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.805141 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.805046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-tmp-dir\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.806954 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.806928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-dshm\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.807195 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.807176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcad529-9948-491b-8e9f-053af0b5c6d8-tls-certs\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.813932 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.813907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7skrq\" (UniqueName: \"kubernetes.io/projected/fbcad529-9948-491b-8e9f-053af0b5c6d8-kube-api-access-7skrq\") pod \"auth-test-model-219d48-kserve-6f79755bc9-c4h46\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") " pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:07.920220 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:07.920123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:08.063169 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:08.063139    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"]
Aug 04 18:59:08.064836 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:59:08.064807    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbcad529_9948_491b_8e9f_053af0b5c6d8.slice/crio-6a6bea16b5671c43630c48161965b8fb857e9c9612a99c1a1c784baa746be2ba WatchSource:0}: Error finding container 6a6bea16b5671c43630c48161965b8fb857e9c9612a99c1a1c784baa746be2ba: Status 404 returned error can't find the container with id 6a6bea16b5671c43630c48161965b8fb857e9c9612a99c1a1c784baa746be2ba
Aug 04 18:59:09.074341 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:09.074302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46" event={"ID":"fbcad529-9948-491b-8e9f-053af0b5c6d8","Type":"ContainerStarted","Data":"7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5"}
Aug 04 18:59:09.074764 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:09.074349    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46" event={"ID":"fbcad529-9948-491b-8e9f-053af0b5c6d8","Type":"ContainerStarted","Data":"6a6bea16b5671c43630c48161965b8fb857e9c9612a99c1a1c784baa746be2ba"}
Aug 04 18:59:09.095104 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:09.095050    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46" podStartSLOduration=2.09503111 podStartE2EDuration="2.09503111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:09.094623245 +0000 UTC m=+2903.419726377" watchObservedRunningTime="2026-08-04 18:59:09.09503111 +0000 UTC m=+2903.420134227"
Aug 04 18:59:10.031476 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:10.031442    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:59:17.920579 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:17.920536    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:17.921320 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:17.920600    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:17.933317 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:17.933287    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:18.132798 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:18.132764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 18:59:39.511686 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.511650    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"]
Aug 04 18:59:39.515313 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.515297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.517967 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.517938    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"kube-root-ca.crt\""
Aug 04 18:59:39.518778 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.518751    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"default-dockercfg-nnbkw\""
Aug 04 18:59:39.518907 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.518763    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"openshift-service-ca.crt\""
Aug 04 18:59:39.518907 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.518887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"auth-test-model-de2394-kserve-self-signed-certs\""
Aug 04 18:59:39.527402 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.527372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"]
Aug 04 18:59:39.598008 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.597967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-home\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.598008 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.598006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-tmp-dir\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.598330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.598028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fab5fd8-87ea-4467-9a83-875f4a26b958-tls-certs\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.598330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.598147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-dshm\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.598330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.598224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-model-cache\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.598330 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.598271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bvwv\" (UniqueName: \"kubernetes.io/projected/2fab5fd8-87ea-4467-9a83-875f4a26b958-kube-api-access-9bvwv\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699065 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-dshm\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699247 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-model-cache\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699247 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvwv\" (UniqueName: \"kubernetes.io/projected/2fab5fd8-87ea-4467-9a83-875f4a26b958-kube-api-access-9bvwv\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699247 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-home\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699247 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-tmp-dir\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699479 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fab5fd8-87ea-4467-9a83-875f4a26b958-tls-certs\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699583 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-tmp-dir\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699654 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-model-cache\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.699700 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.699637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-home\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.701457 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.701433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-dshm\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.701874 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.701856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fab5fd8-87ea-4467-9a83-875f4a26b958-tls-certs\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.708547 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.708527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvwv\" (UniqueName: \"kubernetes.io/projected/2fab5fd8-87ea-4467-9a83-875f4a26b958-kube-api-access-9bvwv\") pod \"auth-test-model-de2394-kserve-6fb55b4499-n5w6h\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") " pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.825138 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.825034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:39.964960 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:39.964924    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"]
Aug 04 18:59:39.967633 ip-10-0-137-226 kubenswrapper[2579]: W0804 18:59:39.967601    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fab5fd8_87ea_4467_9a83_875f4a26b958.slice/crio-98cb65d1daefe0b1dfe5fbf01e54f0c10e6595feb7224039bc2202d9caf2c452 WatchSource:0}: Error finding container 98cb65d1daefe0b1dfe5fbf01e54f0c10e6595feb7224039bc2202d9caf2c452: Status 404 returned error can't find the container with id 98cb65d1daefe0b1dfe5fbf01e54f0c10e6595feb7224039bc2202d9caf2c452
Aug 04 18:59:40.247120 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:40.247078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h" event={"ID":"2fab5fd8-87ea-4467-9a83-875f4a26b958","Type":"ContainerStarted","Data":"2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf"}
Aug 04 18:59:40.247355 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:40.247136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h" event={"ID":"2fab5fd8-87ea-4467-9a83-875f4a26b958","Type":"ContainerStarted","Data":"98cb65d1daefe0b1dfe5fbf01e54f0c10e6595feb7224039bc2202d9caf2c452"}
Aug 04 18:59:40.268870 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:40.268809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h" podStartSLOduration=1.268793521 podStartE2EDuration="1.268793521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:59:40.267914116 +0000 UTC m=+2934.593017247" watchObservedRunningTime="2026-08-04 18:59:40.268793521 +0000 UTC m=+2934.593896641"
Aug 04 18:59:42.321447 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:42.321404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 18:59:49.826092 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:49.826048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:49.826639 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:49.826111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:49.838933 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:49.838903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 18:59:50.308190 ip-10-0-137-226 kubenswrapper[2579]: I0804 18:59:50.308157    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 19:00:00.150047 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.150009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"]
Aug 04 19:00:00.153580 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.153554    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"]
Aug 04 19:00:00.153758 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.153659    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"
Aug 04 19:00:00.156967 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.156948    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"]
Aug 04 19:00:00.157107 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.157073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"
Aug 04 19:00:00.157808 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.157784    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 19:00:00.160142 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.160124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"
Aug 04 19:00:00.169299 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.168981    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"
Aug 04 19:00:00.173504 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.173476    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"]
Aug 04 19:00:00.185271 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.185244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"
Aug 04 19:00:00.185905 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.185824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"]
Aug 04 19:00:00.190086 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.190058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"]
Aug 04 19:00:00.220711 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.220675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"
Aug 04 19:00:00.353750 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.353191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"]
Aug 04 19:00:00.356146 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:00:00.356110    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7645c9_a20c_4cba_9de0_d96848d79460.slice/crio-9d9f908aa4c06596b86d23d183588244c5987d17a66c9c8c7e00b67f5baa77d8 WatchSource:0}: Error finding container 9d9f908aa4c06596b86d23d183588244c5987d17a66c9c8c7e00b67f5baa77d8: Status 404 returned error can't find the container with id 9d9f908aa4c06596b86d23d183588244c5987d17a66c9c8c7e00b67f5baa77d8
Aug 04 19:00:00.391363 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.391335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"]
Aug 04 19:00:00.393430 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:00:00.393352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12792e28_ee2f_4317_a8a4_72e57b8f43be.slice/crio-320ccb8e52db6d034af25b8de8eb46208a078e515309bb7ee9c400609875f53e WatchSource:0}: Error finding container 320ccb8e52db6d034af25b8de8eb46208a078e515309bb7ee9c400609875f53e: Status 404 returned error can't find the container with id 320ccb8e52db6d034af25b8de8eb46208a078e515309bb7ee9c400609875f53e
Aug 04 19:00:00.410795 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:00.410770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"]
Aug 04 19:00:00.412917 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:00:00.412883    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae57be1_dc4e_410d_ab5c_cea5684ba332.slice/crio-4f900c77786c6acea4c7f07e32bcf22afae29d3ddd31f965081cac97cdf64d1c WatchSource:0}: Error finding container 4f900c77786c6acea4c7f07e32bcf22afae29d3ddd31f965081cac97cdf64d1c: Status 404 returned error can't find the container with id 4f900c77786c6acea4c7f07e32bcf22afae29d3ddd31f965081cac97cdf64d1c
Aug 04 19:00:01.354790 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.354751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x" event={"ID":"12792e28-ee2f-4317-a8a4-72e57b8f43be","Type":"ContainerStarted","Data":"40d083a5fcf06c0605235b763e30b05530f996a0963bbee0edc6dccb10fcc577"}
Aug 04 19:00:01.355230 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.354819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x" event={"ID":"12792e28-ee2f-4317-a8a4-72e57b8f43be","Type":"ContainerStarted","Data":"320ccb8e52db6d034af25b8de8eb46208a078e515309bb7ee9c400609875f53e"}
Aug 04 19:00:01.356400 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.356374    2579 generic.go:356] "Generic (PLEG): container finished" podID="cc7645c9-a20c-4cba-9de0-d96848d79460" containerID="e8e9d0f1fbca5bb87d628ec9260dd01e1b412d5ca08584f8486d1b5645ba07fc" exitCode=0
Aug 04 19:00:01.356518 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.356459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj" event={"ID":"cc7645c9-a20c-4cba-9de0-d96848d79460","Type":"ContainerDied","Data":"e8e9d0f1fbca5bb87d628ec9260dd01e1b412d5ca08584f8486d1b5645ba07fc"}
Aug 04 19:00:01.356518 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.356504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj" event={"ID":"cc7645c9-a20c-4cba-9de0-d96848d79460","Type":"ContainerStarted","Data":"9d9f908aa4c06596b86d23d183588244c5987d17a66c9c8c7e00b67f5baa77d8"}
Aug 04 19:00:01.357955 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.357933    2579 generic.go:356] "Generic (PLEG): container finished" podID="eae57be1-dc4e-410d-ab5c-cea5684ba332" containerID="5abcc7335997cff7019e6a9ca6df0a342a5f6906bfaef7c3c622b029df19310b" exitCode=0
Aug 04 19:00:01.358047 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.357963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4" event={"ID":"eae57be1-dc4e-410d-ab5c-cea5684ba332","Type":"ContainerDied","Data":"5abcc7335997cff7019e6a9ca6df0a342a5f6906bfaef7c3c622b029df19310b"}
Aug 04 19:00:01.358047 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.357993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4" event={"ID":"eae57be1-dc4e-410d-ab5c-cea5684ba332","Type":"ContainerStarted","Data":"4f900c77786c6acea4c7f07e32bcf22afae29d3ddd31f965081cac97cdf64d1c"}
Aug 04 19:00:01.373588 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:01.373532    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x" podStartSLOduration=1.3735145389999999 podStartE2EDuration="1.373514539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:00:01.371426297 +0000 UTC m=+2955.696529425" watchObservedRunningTime="2026-08-04 19:00:01.373514539 +0000 UTC m=+2955.698617659"
Aug 04 19:00:02.364440 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:02.364403    2579 generic.go:356] "Generic (PLEG): container finished" podID="12792e28-ee2f-4317-a8a4-72e57b8f43be" containerID="40d083a5fcf06c0605235b763e30b05530f996a0963bbee0edc6dccb10fcc577" exitCode=0
Aug 04 19:00:02.364931 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:02.364474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x" event={"ID":"12792e28-ee2f-4317-a8a4-72e57b8f43be","Type":"ContainerDied","Data":"40d083a5fcf06c0605235b763e30b05530f996a0963bbee0edc6dccb10fcc577"}
Aug 04 19:00:02.511690 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:02.511657    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"
Aug 04 19:00:02.542972 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:02.542939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"
Aug 04 19:00:03.372299 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.372272    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"
Aug 04 19:00:03.372753 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.372309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4" event={"ID":"eae57be1-dc4e-410d-ab5c-cea5684ba332","Type":"ContainerDied","Data":"4f900c77786c6acea4c7f07e32bcf22afae29d3ddd31f965081cac97cdf64d1c"}
Aug 04 19:00:03.372753 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.372356    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f900c77786c6acea4c7f07e32bcf22afae29d3ddd31f965081cac97cdf64d1c"
Aug 04 19:00:03.373650 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.373623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj" event={"ID":"cc7645c9-a20c-4cba-9de0-d96848d79460","Type":"ContainerDied","Data":"9d9f908aa4c06596b86d23d183588244c5987d17a66c9c8c7e00b67f5baa77d8"}
Aug 04 19:00:03.373805 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.373650    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"
Aug 04 19:00:03.373805 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.373662    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d9f908aa4c06596b86d23d183588244c5987d17a66c9c8c7e00b67f5baa77d8"
Aug 04 19:00:03.517152 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:03.517127    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"
Aug 04 19:00:04.382767 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:04.382712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x" event={"ID":"12792e28-ee2f-4317-a8a4-72e57b8f43be","Type":"ContainerDied","Data":"320ccb8e52db6d034af25b8de8eb46208a078e515309bb7ee9c400609875f53e"}
Aug 04 19:00:04.382767 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:04.382759    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764500-plp9x"
Aug 04 19:00:04.383237 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:04.382793    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="320ccb8e52db6d034af25b8de8eb46208a078e515309bb7ee9c400609875f53e"
Aug 04 19:00:14.925970 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:14.925928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:00:28.419708 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:28.419663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:00:38.830328 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:38.830285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:00:46.364320 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:46.364292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 19:00:46.371418 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:46.371393    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 19:00:54.828774 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:00:54.828737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:01:08.734035 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:01:08.733998    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:01:19.833961 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:01:19.833921    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:01:35.323260 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:01:35.323224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:01:45.827153 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:01:45.827067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:01:46.531492 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:01:46.531454    2579 scope.go:117] "RemoveContainer" containerID="6b071aecfcae72756aca65383b208c84044e48cf226a72d2226d9ac4c1276247"
Aug 04 19:02:01.532838 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:02:01.532793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:02:17.184816 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:02:17.184771    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:02:27.832270 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:02:27.832226    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:02:43.838028 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:02:43.837987    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:02:46.563880 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:02:46.563767    2579 scope.go:117] "RemoveContainer" containerID="b1583bb5646bc0e6323d0d544fe51dedec72b93c52067fa2b4412f3768d720c1"
Aug 04 19:02:59.446909 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:02:59.446862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:03:07.451102 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:07.451011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:03:16.146404 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:16.146356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:03:26.536463 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:26.536420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:03:30.782090 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:30.782054    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"]
Aug 04 19:03:31.619770 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:31.619711    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"]
Aug 04 19:03:37.934603 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:37.934562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:03:45.801851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:45.801781    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46" podUID="fbcad529-9948-491b-8e9f-053af0b5c6d8" containerName="main" containerID="cri-o://7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5" gracePeriod=45
Aug 04 19:03:46.056517 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.056441    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 19:03:46.164150 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164122    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-dshm\") pod \"fbcad529-9948-491b-8e9f-053af0b5c6d8\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") "
Aug 04 19:03:46.164150 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164155    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7skrq\" (UniqueName: \"kubernetes.io/projected/fbcad529-9948-491b-8e9f-053af0b5c6d8-kube-api-access-7skrq\") pod \"fbcad529-9948-491b-8e9f-053af0b5c6d8\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") "
Aug 04 19:03:46.164389 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-home\") pod \"fbcad529-9948-491b-8e9f-053af0b5c6d8\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") "
Aug 04 19:03:46.164389 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-model-cache\") pod \"fbcad529-9948-491b-8e9f-053af0b5c6d8\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") "
Aug 04 19:03:46.164389 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164271    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-tmp-dir\") pod \"fbcad529-9948-491b-8e9f-053af0b5c6d8\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") "
Aug 04 19:03:46.164389 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164292    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcad529-9948-491b-8e9f-053af0b5c6d8-tls-certs\") pod \"fbcad529-9948-491b-8e9f-053af0b5c6d8\" (UID: \"fbcad529-9948-491b-8e9f-053af0b5c6d8\") "
Aug 04 19:03:46.164614 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164504    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbcad529-9948-491b-8e9f-053af0b5c6d8" (UID: "fbcad529-9948-491b-8e9f-053af0b5c6d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:46.164614 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164525    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-home" (OuterVolumeSpecName: "home") pod "fbcad529-9948-491b-8e9f-053af0b5c6d8" (UID: "fbcad529-9948-491b-8e9f-053af0b5c6d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:46.164614 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.164520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbcad529-9948-491b-8e9f-053af0b5c6d8" (UID: "fbcad529-9948-491b-8e9f-053af0b5c6d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:46.166493 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.166462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbcad529-9948-491b-8e9f-053af0b5c6d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbcad529-9948-491b-8e9f-053af0b5c6d8" (UID: "fbcad529-9948-491b-8e9f-053af0b5c6d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:03:46.166590 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.166533    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbcad529-9948-491b-8e9f-053af0b5c6d8-kube-api-access-7skrq" (OuterVolumeSpecName: "kube-api-access-7skrq") pod "fbcad529-9948-491b-8e9f-053af0b5c6d8" (UID: "fbcad529-9948-491b-8e9f-053af0b5c6d8"). InnerVolumeSpecName "kube-api-access-7skrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:03:46.166590 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.166541    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-dshm" (OuterVolumeSpecName: "dshm") pod "fbcad529-9948-491b-8e9f-053af0b5c6d8" (UID: "fbcad529-9948-491b-8e9f-053af0b5c6d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:46.265662 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.265622    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:46.265662 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.265659    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:46.265897 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.265673    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbcad529-9948-491b-8e9f-053af0b5c6d8-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:46.265897 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.265685    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:46.265897 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.265696    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7skrq\" (UniqueName: \"kubernetes.io/projected/fbcad529-9948-491b-8e9f-053af0b5c6d8-kube-api-access-7skrq\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:46.265897 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.265710    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbcad529-9948-491b-8e9f-053af0b5c6d8-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:46.531505 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.531466    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbcad529-9948-491b-8e9f-053af0b5c6d8" containerID="7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5" exitCode=0
Aug 04 19:03:46.531712 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.531523    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"
Aug 04 19:03:46.531712 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.531551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46" event={"ID":"fbcad529-9948-491b-8e9f-053af0b5c6d8","Type":"ContainerDied","Data":"7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5"}
Aug 04 19:03:46.531712 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.531594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46" event={"ID":"fbcad529-9948-491b-8e9f-053af0b5c6d8","Type":"ContainerDied","Data":"6a6bea16b5671c43630c48161965b8fb857e9c9612a99c1a1c784baa746be2ba"}
Aug 04 19:03:46.531712 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.531617    2579 scope.go:117] "RemoveContainer" containerID="7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5"
Aug 04 19:03:46.541446 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.541424    2579 scope.go:117] "RemoveContainer" containerID="7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5"
Aug 04 19:03:46.541789 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:03:46.541766    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5\": container with ID starting with 7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5 not found: ID does not exist" containerID="7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5"
Aug 04 19:03:46.541867 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.541802    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5"} err="failed to get container status \"7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5\": rpc error: code = NotFound desc = could not find container \"7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5\": container with ID starting with 7b4a196da1a2ff1f5176268c9870e0c529594ebfe739c2d1b7fa689d84d894a5 not found: ID does not exist"
Aug 04 19:03:46.559294 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.559266    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"]
Aug 04 19:03:46.562334 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.562308    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/auth-test-model-219d48-kserve-6f79755bc9-c4h46"]
Aug 04 19:03:46.583737 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.583694    2579 scope.go:117] "RemoveContainer" containerID="9341bbb04d24eaac399f556b80434953ce5da3115b2c133b3dd5ec11bf0e19ad"
Aug 04 19:03:46.592192 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.592169    2579 scope.go:117] "RemoveContainer" containerID="ced64f15d49cf5a271e0b04b7769f287e0f6bbe57c7f6a7f13e00f45487296a2"
Aug 04 19:03:46.639701 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.639663    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h" podUID="2fab5fd8-87ea-4467-9a83-875f4a26b958" containerName="main" containerID="cri-o://2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf" gracePeriod=45
Aug 04 19:03:46.890736 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:46.890695    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 19:03:47.072277 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072180    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fab5fd8-87ea-4467-9a83-875f4a26b958-tls-certs\") pod \"2fab5fd8-87ea-4467-9a83-875f4a26b958\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") "
Aug 04 19:03:47.072277 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-dshm\") pod \"2fab5fd8-87ea-4467-9a83-875f4a26b958\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") "
Aug 04 19:03:47.072277 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-home\") pod \"2fab5fd8-87ea-4467-9a83-875f4a26b958\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") "
Aug 04 19:03:47.072567 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bvwv\" (UniqueName: \"kubernetes.io/projected/2fab5fd8-87ea-4467-9a83-875f4a26b958-kube-api-access-9bvwv\") pod \"2fab5fd8-87ea-4467-9a83-875f4a26b958\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") "
Aug 04 19:03:47.072567 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072376    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-tmp-dir\") pod \"2fab5fd8-87ea-4467-9a83-875f4a26b958\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") "
Aug 04 19:03:47.072675 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072555    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-model-cache\") pod \"2fab5fd8-87ea-4467-9a83-875f4a26b958\" (UID: \"2fab5fd8-87ea-4467-9a83-875f4a26b958\") "
Aug 04 19:03:47.072675 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-home" (OuterVolumeSpecName: "home") pod "2fab5fd8-87ea-4467-9a83-875f4a26b958" (UID: "2fab5fd8-87ea-4467-9a83-875f4a26b958"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:47.072675 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072656    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2fab5fd8-87ea-4467-9a83-875f4a26b958" (UID: "2fab5fd8-87ea-4467-9a83-875f4a26b958"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:47.072880 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072818    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-model-cache" (OuterVolumeSpecName: "model-cache") pod "2fab5fd8-87ea-4467-9a83-875f4a26b958" (UID: "2fab5fd8-87ea-4467-9a83-875f4a26b958"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:47.072941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072902    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:47.072941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072919    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:47.072941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.072929    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:47.074654 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.074631    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-dshm" (OuterVolumeSpecName: "dshm") pod "2fab5fd8-87ea-4467-9a83-875f4a26b958" (UID: "2fab5fd8-87ea-4467-9a83-875f4a26b958"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:03:47.074785 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.074692    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fab5fd8-87ea-4467-9a83-875f4a26b958-kube-api-access-9bvwv" (OuterVolumeSpecName: "kube-api-access-9bvwv") pod "2fab5fd8-87ea-4467-9a83-875f4a26b958" (UID: "2fab5fd8-87ea-4467-9a83-875f4a26b958"). InnerVolumeSpecName "kube-api-access-9bvwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:03:47.074785 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.074689    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fab5fd8-87ea-4467-9a83-875f4a26b958-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2fab5fd8-87ea-4467-9a83-875f4a26b958" (UID: "2fab5fd8-87ea-4467-9a83-875f4a26b958"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:03:47.174178 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.174138    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fab5fd8-87ea-4467-9a83-875f4a26b958-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:47.174178 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.174171    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bvwv\" (UniqueName: \"kubernetes.io/projected/2fab5fd8-87ea-4467-9a83-875f4a26b958-kube-api-access-9bvwv\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:47.174178 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.174181    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fab5fd8-87ea-4467-9a83-875f4a26b958-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:03:47.537614 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.537578    2579 generic.go:356] "Generic (PLEG): container finished" podID="2fab5fd8-87ea-4467-9a83-875f4a26b958" containerID="2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf" exitCode=0
Aug 04 19:03:47.537851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.537652    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"
Aug 04 19:03:47.537851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.537682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h" event={"ID":"2fab5fd8-87ea-4467-9a83-875f4a26b958","Type":"ContainerDied","Data":"2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf"}
Aug 04 19:03:47.537851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.537746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h" event={"ID":"2fab5fd8-87ea-4467-9a83-875f4a26b958","Type":"ContainerDied","Data":"98cb65d1daefe0b1dfe5fbf01e54f0c10e6595feb7224039bc2202d9caf2c452"}
Aug 04 19:03:47.537851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.537773    2579 scope.go:117] "RemoveContainer" containerID="2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf"
Aug 04 19:03:47.546889 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.546864    2579 scope.go:117] "RemoveContainer" containerID="2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf"
Aug 04 19:03:47.547181 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:03:47.547163    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf\": container with ID starting with 2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf not found: ID does not exist" containerID="2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf"
Aug 04 19:03:47.547250 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.547188    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf"} err="failed to get container status \"2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf\": rpc error: code = NotFound desc = could not find container \"2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf\": container with ID starting with 2cceecce5cb75c43b729f6441406f9eabb4af44d143d3cbc3eabc235fb1dfcaf not found: ID does not exist"
Aug 04 19:03:47.567162 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.567131    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"]
Aug 04 19:03:47.570914 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:47.570880    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/auth-test-model-de2394-kserve-6fb55b4499-n5w6h"]
Aug 04 19:03:48.162978 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:48.162946    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fab5fd8-87ea-4467-9a83-875f4a26b958" path="/var/lib/kubelet/pods/2fab5fd8-87ea-4467-9a83-875f4a26b958/volumes"
Aug 04 19:03:48.163415 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:48.163327    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbcad529-9948-491b-8e9f-053af0b5c6d8" path="/var/lib/kubelet/pods/fbcad529-9948-491b-8e9f-053af0b5c6d8/volumes"
Aug 04 19:03:54.607683 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.607647    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"]
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608029    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12792e28-ee2f-4317-a8a4-72e57b8f43be" containerName="cleanup"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608041    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12792e28-ee2f-4317-a8a4-72e57b8f43be" containerName="cleanup"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608059    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fab5fd8-87ea-4467-9a83-875f4a26b958" containerName="main"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608065    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fab5fd8-87ea-4467-9a83-875f4a26b958" containerName="main"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608070    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7645c9-a20c-4cba-9de0-d96848d79460" containerName="cleanup"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608075    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7645c9-a20c-4cba-9de0-d96848d79460" containerName="cleanup"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608088    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae57be1-dc4e-410d-ab5c-cea5684ba332" containerName="cleanup"
Aug 04 19:03:54.608092 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608095    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae57be1-dc4e-410d-ab5c-cea5684ba332" containerName="cleanup"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608101    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbcad529-9948-491b-8e9f-053af0b5c6d8" containerName="main"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608106    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbcad529-9948-491b-8e9f-053af0b5c6d8" containerName="main"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608174    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fab5fd8-87ea-4467-9a83-875f4a26b958" containerName="main"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608181    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7645c9-a20c-4cba-9de0-d96848d79460" containerName="cleanup"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608186    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="12792e28-ee2f-4317-a8a4-72e57b8f43be" containerName="cleanup"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608198    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbcad529-9948-491b-8e9f-053af0b5c6d8" containerName="main"
Aug 04 19:03:54.608350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.608204    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae57be1-dc4e-410d-ab5c-cea5684ba332" containerName="cleanup"
Aug 04 19:03:54.612829 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.612805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.616087 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.616062    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"openshift-service-ca.crt\""
Aug 04 19:03:54.616242 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.616223    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"sub-test-model-219d48-kserve-self-signed-certs\""
Aug 04 19:03:54.617314 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.617287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"default-dockercfg-dqtfl\""
Aug 04 19:03:54.617429 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.617321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"kube-root-ca.crt\""
Aug 04 19:03:54.628391 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.628356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-model-cache\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.628609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.628430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-home\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.628609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.628471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tls-certs\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.628609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.628495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf8zf\" (UniqueName: \"kubernetes.io/projected/b698c0a0-827d-4014-ac7b-2ac638c3a48f-kube-api-access-lf8zf\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.628609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.628566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-dshm\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.628850 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.628613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tmp-dir\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.631176 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.631144    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"]
Aug 04 19:03:54.729182 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-home\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729182 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tls-certs\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729460 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf8zf\" (UniqueName: \"kubernetes.io/projected/b698c0a0-827d-4014-ac7b-2ac638c3a48f-kube-api-access-lf8zf\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729460 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-dshm\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729460 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tmp-dir\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729460 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-model-cache\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729642 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-home\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729706 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tmp-dir\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.729804 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.729766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-model-cache\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.731691 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.731665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-dshm\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.732036 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.732017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tls-certs\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.739695 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.739664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf8zf\" (UniqueName: \"kubernetes.io/projected/b698c0a0-827d-4014-ac7b-2ac638c3a48f-kube-api-access-lf8zf\") pod \"sub-test-model-219d48-kserve-758456fb75-q52g9\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") " pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:54.921895 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:54.921801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:03:55.073710 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:55.073627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"]
Aug 04 19:03:55.076252 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:03:55.076215    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb698c0a0_827d_4014_ac7b_2ac638c3a48f.slice/crio-94c8073e218b1bab07e7cde0f1e6b6639b8e13a2f1f868ddab4a563b4ed90fa8 WatchSource:0}: Error finding container 94c8073e218b1bab07e7cde0f1e6b6639b8e13a2f1f868ddab4a563b4ed90fa8: Status 404 returned error can't find the container with id 94c8073e218b1bab07e7cde0f1e6b6639b8e13a2f1f868ddab4a563b4ed90fa8
Aug 04 19:03:55.582920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:55.582883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9" event={"ID":"b698c0a0-827d-4014-ac7b-2ac638c3a48f","Type":"ContainerStarted","Data":"91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8"}
Aug 04 19:03:55.582920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:55.582926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9" event={"ID":"b698c0a0-827d-4014-ac7b-2ac638c3a48f","Type":"ContainerStarted","Data":"94c8073e218b1bab07e7cde0f1e6b6639b8e13a2f1f868ddab4a563b4ed90fa8"}
Aug 04 19:03:55.606814 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:55.606763    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9" podStartSLOduration=1.606746695 podStartE2EDuration="1.606746695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:03:55.604116438 +0000 UTC m=+3189.929219559" watchObservedRunningTime="2026-08-04 19:03:55.606746695 +0000 UTC m=+3189.931849806"
Aug 04 19:03:56.356629 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:03:56.356583    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:04:04.922671 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:04.922629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:04:04.923202 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:04.922791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:04:04.935524 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:04.935494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:04:05.643638 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:05.643607    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:04:11.505688 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.505654    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"]
Aug 04 19:04:11.509205 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.509188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.514704 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.514683    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"default-dockercfg-nnbkw\""
Aug 04 19:04:11.517504 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.517482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"openshift-service-ca.crt\""
Aug 04 19:04:11.517633 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.517509    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"sub-test-model-de2394-kserve-self-signed-certs\""
Aug 04 19:04:11.517633 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.517548    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"kube-root-ca.crt\""
Aug 04 19:04:11.521574 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.521551    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"]
Aug 04 19:04:11.578871 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.578828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-model-cache\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.578871 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.578868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tmp-dir\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.579087 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.578923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-dshm\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.579087 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.578942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tls-certs\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.579087 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.578958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-home\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.579087 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.578999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79rg7\" (UniqueName: \"kubernetes.io/projected/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-kube-api-access-79rg7\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.679767 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.679688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-model-cache\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.679767 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.679768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tmp-dir\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680051 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.679806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-dshm\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680051 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.679824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tls-certs\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680051 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.679843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-home\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680051 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.679898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79rg7\" (UniqueName: \"kubernetes.io/projected/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-kube-api-access-79rg7\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680256 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.680177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-model-cache\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680298 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.680256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-home\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.680372 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.680349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tmp-dir\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.682348 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.682327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-dshm\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.682605 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.682586    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tls-certs\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.690151 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.690120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79rg7\" (UniqueName: \"kubernetes.io/projected/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-kube-api-access-79rg7\") pod \"sub-test-model-de2394-kserve-5c87bb555c-jt45g\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") " pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.818757 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.818628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:11.966302 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:11.966275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"]
Aug 04 19:04:11.968845 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:04:11.968810    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b49128c_62fd_4068_b9d4_11e31e7f6cf7.slice/crio-d8da5f258304b800fe5fdbe8b111397ea650753b7f93ed2d34d323dd81911c5d WatchSource:0}: Error finding container d8da5f258304b800fe5fdbe8b111397ea650753b7f93ed2d34d323dd81911c5d: Status 404 returned error can't find the container with id d8da5f258304b800fe5fdbe8b111397ea650753b7f93ed2d34d323dd81911c5d
Aug 04 19:04:12.668310 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:12.668271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g" event={"ID":"0b49128c-62fd-4068-b9d4-11e31e7f6cf7","Type":"ContainerStarted","Data":"0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b"}
Aug 04 19:04:12.668792 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:12.668322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g" event={"ID":"0b49128c-62fd-4068-b9d4-11e31e7f6cf7","Type":"ContainerStarted","Data":"d8da5f258304b800fe5fdbe8b111397ea650753b7f93ed2d34d323dd81911c5d"}
Aug 04 19:04:12.690979 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:12.690927    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g" podStartSLOduration=1.6909066190000002 podStartE2EDuration="1.690906619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:04:12.689342624 +0000 UTC m=+3207.014445743" watchObservedRunningTime="2026-08-04 19:04:12.690906619 +0000 UTC m=+3207.016009738"
Aug 04 19:04:14.136704 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:14.136662    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:04:21.819894 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:21.819846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:21.819894 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:21.819896    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:21.832820 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:21.832788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:22.729884 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:22.729854    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:04:49.232169 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:04:49.232129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:05:02.441965 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:02.441923    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:05:13.846166 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:13.846121    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:05:18.529367 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:18.529331    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"]
Aug 04 19:05:19.436949 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:19.436913    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"]
Aug 04 19:05:24.536909 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:24.536866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:05:30.720493 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.720451    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"]
Aug 04 19:05:30.724111 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.724088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.727000 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.726980    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-219d48\"/\"rate-test-model-219d48-kserve-self-signed-certs\""
Aug 04 19:05:30.733936 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.733911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"]
Aug 04 19:05:30.805176 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.805146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-model-cache\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.805363 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.805186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d4871a-7d04-447e-acde-0376711d893d-tls-certs\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.805363 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.805220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-dshm\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.805363 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.805295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-tmp-dir\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.805363 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.805336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdc8k\" (UniqueName: \"kubernetes.io/projected/c9d4871a-7d04-447e-acde-0376711d893d-kube-api-access-gdc8k\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.805496 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.805372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-home\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.906847 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.906807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d4871a-7d04-447e-acde-0376711d893d-tls-certs\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907040 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.906860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-dshm\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907040 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.906894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-tmp-dir\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907040 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.906918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdc8k\" (UniqueName: \"kubernetes.io/projected/c9d4871a-7d04-447e-acde-0376711d893d-kube-api-access-gdc8k\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907040 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.906947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-home\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907040 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.906985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-model-cache\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907423 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.907393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-model-cache\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907423 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.907414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-home\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.907569 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.907440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-tmp-dir\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.909400 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.909380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-dshm\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.909654 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.909637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d4871a-7d04-447e-acde-0376711d893d-tls-certs\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:30.916325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:30.916301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdc8k\" (UniqueName: \"kubernetes.io/projected/c9d4871a-7d04-447e-acde-0376711d893d-kube-api-access-gdc8k\") pod \"rate-test-model-219d48-kserve-568cf4584c-dl8w5\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") " pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:31.033981 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:31.033885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:31.205302 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:31.205273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"]
Aug 04 19:05:31.207487 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:05:31.207454    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9d4871a_7d04_447e_acde_0376711d893d.slice/crio-82c0ae6ddd53c1f4211927f66842136574f679122ed526b1161ad7058f1e73c5 WatchSource:0}: Error finding container 82c0ae6ddd53c1f4211927f66842136574f679122ed526b1161ad7058f1e73c5: Status 404 returned error can't find the container with id 82c0ae6ddd53c1f4211927f66842136574f679122ed526b1161ad7058f1e73c5
Aug 04 19:05:32.072049 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:32.072011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5" event={"ID":"c9d4871a-7d04-447e-acde-0376711d893d","Type":"ContainerStarted","Data":"c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d"}
Aug 04 19:05:32.072515 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:32.072059    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5" event={"ID":"c9d4871a-7d04-447e-acde-0376711d893d","Type":"ContainerStarted","Data":"82c0ae6ddd53c1f4211927f66842136574f679122ed526b1161ad7058f1e73c5"}
Aug 04 19:05:32.096205 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:32.096145    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5" podStartSLOduration=2.096127911 podStartE2EDuration="2.096127911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:05:32.093545393 +0000 UTC m=+3286.418648512" watchObservedRunningTime="2026-08-04 19:05:32.096127911 +0000 UTC m=+3286.421231031"
Aug 04 19:05:33.031207 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.031173    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:05:33.548982 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.548936    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9" podUID="b698c0a0-827d-4014-ac7b-2ac638c3a48f" containerName="main" containerID="cri-o://91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8" gracePeriod=45
Aug 04 19:05:33.818063 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.818026    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:05:33.836036 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836008    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-dshm\") pod \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") "
Aug 04 19:05:33.836235 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836051    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf8zf\" (UniqueName: \"kubernetes.io/projected/b698c0a0-827d-4014-ac7b-2ac638c3a48f-kube-api-access-lf8zf\") pod \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") "
Aug 04 19:05:33.836235 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836073    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tls-certs\") pod \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") "
Aug 04 19:05:33.836235 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tmp-dir\") pod \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") "
Aug 04 19:05:33.836404 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836259    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-home\") pod \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") "
Aug 04 19:05:33.836404 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836345    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-model-cache\") pod \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\" (UID: \"b698c0a0-827d-4014-ac7b-2ac638c3a48f\") "
Aug 04 19:05:33.836518 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836490    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b698c0a0-827d-4014-ac7b-2ac638c3a48f" (UID: "b698c0a0-827d-4014-ac7b-2ac638c3a48f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:33.836598 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836566    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-home" (OuterVolumeSpecName: "home") pod "b698c0a0-827d-4014-ac7b-2ac638c3a48f" (UID: "b698c0a0-827d-4014-ac7b-2ac638c3a48f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:33.836704 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836670    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:33.836963 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836710    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:33.836963 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.836756    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-model-cache" (OuterVolumeSpecName: "model-cache") pod "b698c0a0-827d-4014-ac7b-2ac638c3a48f" (UID: "b698c0a0-827d-4014-ac7b-2ac638c3a48f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:33.838926 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.838869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b698c0a0-827d-4014-ac7b-2ac638c3a48f" (UID: "b698c0a0-827d-4014-ac7b-2ac638c3a48f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:05:33.838926 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.838877    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-dshm" (OuterVolumeSpecName: "dshm") pod "b698c0a0-827d-4014-ac7b-2ac638c3a48f" (UID: "b698c0a0-827d-4014-ac7b-2ac638c3a48f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:33.838926 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.838895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b698c0a0-827d-4014-ac7b-2ac638c3a48f-kube-api-access-lf8zf" (OuterVolumeSpecName: "kube-api-access-lf8zf") pod "b698c0a0-827d-4014-ac7b-2ac638c3a48f" (UID: "b698c0a0-827d-4014-ac7b-2ac638c3a48f"). InnerVolumeSpecName "kube-api-access-lf8zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:05:33.937942 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.937904    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:33.937942 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.937935    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b698c0a0-827d-4014-ac7b-2ac638c3a48f-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:33.937942 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.937944    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf8zf\" (UniqueName: \"kubernetes.io/projected/b698c0a0-827d-4014-ac7b-2ac638c3a48f-kube-api-access-lf8zf\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:33.937942 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:33.937954    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b698c0a0-827d-4014-ac7b-2ac638c3a48f-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:34.084282 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.084195    2579 generic.go:356] "Generic (PLEG): container finished" podID="b698c0a0-827d-4014-ac7b-2ac638c3a48f" containerID="91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8" exitCode=0
Aug 04 19:05:34.084282 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.084234    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"
Aug 04 19:05:34.084493 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.084280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9" event={"ID":"b698c0a0-827d-4014-ac7b-2ac638c3a48f","Type":"ContainerDied","Data":"91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8"}
Aug 04 19:05:34.084493 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.084328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9" event={"ID":"b698c0a0-827d-4014-ac7b-2ac638c3a48f","Type":"ContainerDied","Data":"94c8073e218b1bab07e7cde0f1e6b6639b8e13a2f1f868ddab4a563b4ed90fa8"}
Aug 04 19:05:34.084493 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.084347    2579 scope.go:117] "RemoveContainer" containerID="91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8"
Aug 04 19:05:34.095647 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.095617    2579 scope.go:117] "RemoveContainer" containerID="91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8"
Aug 04 19:05:34.096209 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:05:34.096176    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8\": container with ID starting with 91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8 not found: ID does not exist" containerID="91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8"
Aug 04 19:05:34.096388 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.096361    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8"} err="failed to get container status \"91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8\": rpc error: code = NotFound desc = could not find container \"91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8\": container with ID starting with 91ff6a948747ae9a521ccbdc898c27100da2f8272ffd8bc1986f89a8e5ea6eb8 not found: ID does not exist"
Aug 04 19:05:34.115841 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.115803    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"]
Aug 04 19:05:34.122408 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.122375    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/sub-test-model-219d48-kserve-758456fb75-q52g9"]
Aug 04 19:05:34.162673 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.162628    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b698c0a0-827d-4014-ac7b-2ac638c3a48f" path="/var/lib/kubelet/pods/b698c0a0-827d-4014-ac7b-2ac638c3a48f/volumes"
Aug 04 19:05:34.456709 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.456664    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g" podUID="0b49128c-62fd-4068-b9d4-11e31e7f6cf7" containerName="main" containerID="cri-o://0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b" gracePeriod=45
Aug 04 19:05:34.707168 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.707106    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:05:34.745362 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tls-certs\") pod \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") "
Aug 04 19:05:34.745547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-model-cache\") pod \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") "
Aug 04 19:05:34.745547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745402    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-home\") pod \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") "
Aug 04 19:05:34.745547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745422    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tmp-dir\") pod \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") "
Aug 04 19:05:34.745547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79rg7\" (UniqueName: \"kubernetes.io/projected/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-kube-api-access-79rg7\") pod \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") "
Aug 04 19:05:34.745547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-dshm\") pod \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\" (UID: \"0b49128c-62fd-4068-b9d4-11e31e7f6cf7\") "
Aug 04 19:05:34.745854 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745700    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b49128c-62fd-4068-b9d4-11e31e7f6cf7" (UID: "0b49128c-62fd-4068-b9d4-11e31e7f6cf7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:34.745854 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745757    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-home" (OuterVolumeSpecName: "home") pod "0b49128c-62fd-4068-b9d4-11e31e7f6cf7" (UID: "0b49128c-62fd-4068-b9d4-11e31e7f6cf7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:34.746028 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745889    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:34.746028 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.745908    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:34.746109 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.746020    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b49128c-62fd-4068-b9d4-11e31e7f6cf7" (UID: "0b49128c-62fd-4068-b9d4-11e31e7f6cf7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:34.747840 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.747812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-kube-api-access-79rg7" (OuterVolumeSpecName: "kube-api-access-79rg7") pod "0b49128c-62fd-4068-b9d4-11e31e7f6cf7" (UID: "0b49128c-62fd-4068-b9d4-11e31e7f6cf7"). InnerVolumeSpecName "kube-api-access-79rg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:05:34.748316 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.748295    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-dshm" (OuterVolumeSpecName: "dshm") pod "0b49128c-62fd-4068-b9d4-11e31e7f6cf7" (UID: "0b49128c-62fd-4068-b9d4-11e31e7f6cf7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:05:34.748379 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.748299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b49128c-62fd-4068-b9d4-11e31e7f6cf7" (UID: "0b49128c-62fd-4068-b9d4-11e31e7f6cf7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:05:34.846954 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.846911    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:34.846954 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.846945    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:34.846954 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.846960    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79rg7\" (UniqueName: \"kubernetes.io/projected/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-kube-api-access-79rg7\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:34.847190 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:34.846975    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b49128c-62fd-4068-b9d4-11e31e7f6cf7-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:05:35.094740 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.094640    2579 generic.go:356] "Generic (PLEG): container finished" podID="0b49128c-62fd-4068-b9d4-11e31e7f6cf7" containerID="0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b" exitCode=0
Aug 04 19:05:35.094740 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.094684    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"
Aug 04 19:05:35.094740 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.094690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g" event={"ID":"0b49128c-62fd-4068-b9d4-11e31e7f6cf7","Type":"ContainerDied","Data":"0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b"}
Aug 04 19:05:35.094970 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.094743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g" event={"ID":"0b49128c-62fd-4068-b9d4-11e31e7f6cf7","Type":"ContainerDied","Data":"d8da5f258304b800fe5fdbe8b111397ea650753b7f93ed2d34d323dd81911c5d"}
Aug 04 19:05:35.094970 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.094765    2579 scope.go:117] "RemoveContainer" containerID="0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b"
Aug 04 19:05:35.103962 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.103940    2579 scope.go:117] "RemoveContainer" containerID="0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b"
Aug 04 19:05:35.104246 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:05:35.104228    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b\": container with ID starting with 0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b not found: ID does not exist" containerID="0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b"
Aug 04 19:05:35.104299 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.104255    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b"} err="failed to get container status \"0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b\": rpc error: code = NotFound desc = could not find container \"0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b\": container with ID starting with 0d9cf8a47d0939a3c09a08c1b42f72e52365ce14ae8e98880dbf420abbbca78b not found: ID does not exist"
Aug 04 19:05:35.121498 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.121464    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"]
Aug 04 19:05:35.136736 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:35.136695    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/sub-test-model-de2394-kserve-5c87bb555c-jt45g"]
Aug 04 19:05:36.162468 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:36.162434    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b49128c-62fd-4068-b9d4-11e31e7f6cf7" path="/var/lib/kubelet/pods/0b49128c-62fd-4068-b9d4-11e31e7f6cf7/volumes"
Aug 04 19:05:41.034377 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:41.034276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:41.034377 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:41.034341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:41.047215 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:41.047186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:41.135364 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:41.135327    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:05:46.394933 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:46.394908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 19:05:46.402561 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:05:46.402537    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 19:06:20.321316 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321223    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"]
Aug 04 19:06:20.321941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321768    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b698c0a0-827d-4014-ac7b-2ac638c3a48f" containerName="main"
Aug 04 19:06:20.321941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321787    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b698c0a0-827d-4014-ac7b-2ac638c3a48f" containerName="main"
Aug 04 19:06:20.321941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321840    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b49128c-62fd-4068-b9d4-11e31e7f6cf7" containerName="main"
Aug 04 19:06:20.321941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321849    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b49128c-62fd-4068-b9d4-11e31e7f6cf7" containerName="main"
Aug 04 19:06:20.321941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321927    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b698c0a0-827d-4014-ac7b-2ac638c3a48f" containerName="main"
Aug 04 19:06:20.321941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.321941    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b49128c-62fd-4068-b9d4-11e31e7f6cf7" containerName="main"
Aug 04 19:06:20.324830 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.324807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.328701 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.328507    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"openshift-service-ca.crt\""
Aug 04 19:06:20.328701 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.328555    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"kube-root-ca.crt\""
Aug 04 19:06:20.328701 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.328582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"default-dockercfg-nnbkw\""
Aug 04 19:06:20.328701 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.328595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-de2394\"/\"rate-test-model-de2394-kserve-self-signed-certs\""
Aug 04 19:06:20.334821 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.334788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"]
Aug 04 19:06:20.367138 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.367104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tmp-dir\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.367334 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.367223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-home\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.367654 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.367625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-dshm\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.367820 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.367660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tls-certs\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.367820 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.367711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-852z7\" (UniqueName: \"kubernetes.io/projected/d2299ce5-c678-4a83-9669-92c52ab5aa8a-kube-api-access-852z7\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.367820 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.367796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-model-cache\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468255 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-model-cache\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468470 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tmp-dir\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468470 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-home\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468470 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-dshm\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468470 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tls-certs\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468470 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-852z7\" (UniqueName: \"kubernetes.io/projected/d2299ce5-c678-4a83-9669-92c52ab5aa8a-kube-api-access-852z7\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468823 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tmp-dir\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468823 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-model-cache\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.468960 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.468854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-home\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.470838 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.470815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-dshm\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.471298 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.471277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tls-certs\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.480185 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.480155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-852z7\" (UniqueName: \"kubernetes.io/projected/d2299ce5-c678-4a83-9669-92c52ab5aa8a-kube-api-access-852z7\") pod \"rate-test-model-de2394-kserve-59cc9d5f47-4vhj5\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") " pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.636075 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.635979    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:20.789866 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:20.789836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"]
Aug 04 19:06:20.792359 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:06:20.792334    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2299ce5_c678_4a83_9669_92c52ab5aa8a.slice/crio-38a483899242bb5e97aedb9d69c7277696369198c4374f326a89a9b632e7f893 WatchSource:0}: Error finding container 38a483899242bb5e97aedb9d69c7277696369198c4374f326a89a9b632e7f893: Status 404 returned error can't find the container with id 38a483899242bb5e97aedb9d69c7277696369198c4374f326a89a9b632e7f893
Aug 04 19:06:21.326140 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:21.326101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5" event={"ID":"d2299ce5-c678-4a83-9669-92c52ab5aa8a","Type":"ContainerStarted","Data":"ebaaab43e151235218b2092ef7bd8ada8c589a67d01fa2bdf82fceb1c29ded74"}
Aug 04 19:06:21.326140 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:21.326148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5" event={"ID":"d2299ce5-c678-4a83-9669-92c52ab5aa8a","Type":"ContainerStarted","Data":"38a483899242bb5e97aedb9d69c7277696369198c4374f326a89a9b632e7f893"}
Aug 04 19:06:21.347004 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:21.346951    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5" podStartSLOduration=1.3469342069999999 podStartE2EDuration="1.346934207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:06:21.345166115 +0000 UTC m=+3335.670269267" watchObservedRunningTime="2026-08-04 19:06:21.346934207 +0000 UTC m=+3335.672037326"
Aug 04 19:06:22.931351 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:22.931309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:06:30.636592 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:30.636553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:30.636592 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:30.636608    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:30.649690 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:30.649651    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:31.388038 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:31.388007    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:06:57.553824 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:06:57.553785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:07:05.835039 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:05.834989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:07:22.025963 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:22.025920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:07:27.823342 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:27.823299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"]
Aug 04 19:07:28.618062 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:28.618024    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"]
Aug 04 19:07:29.702815 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.702775    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-139913694633776"]
Aug 04 19:07:29.706260 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.706239    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:29.709171 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.709145    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-r4hj8\""
Aug 04 19:07:29.719181 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.719149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694633776"]
Aug 04 19:07:29.720040 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.720015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz2m9\" (UniqueName: \"kubernetes.io/projected/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa-kube-api-access-zz2m9\") pod \"test-curl-7552-139913694633776\" (UID: \"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa\") " pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:29.821119 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.821083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz2m9\" (UniqueName: \"kubernetes.io/projected/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa-kube-api-access-zz2m9\") pod \"test-curl-7552-139913694633776\" (UID: \"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa\") " pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:29.835079 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:29.835048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz2m9\" (UniqueName: \"kubernetes.io/projected/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa-kube-api-access-zz2m9\") pod \"test-curl-7552-139913694633776\" (UID: \"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa\") " pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:30.016096 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:30.015975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:30.161135 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:07:30.161101    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2c530a_3c3c_41e2_b40c_66bcb02f4efa.slice/crio-97d7c985488d1e148e7578fc669a19bd295289b64d1279e1fab62dd9f26b4c59 WatchSource:0}: Error finding container 97d7c985488d1e148e7578fc669a19bd295289b64d1279e1fab62dd9f26b4c59: Status 404 returned error can't find the container with id 97d7c985488d1e148e7578fc669a19bd295289b64d1279e1fab62dd9f26b4c59
Aug 04 19:07:30.162465 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:30.162445    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:07:30.163792 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:30.163772    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694633776"]
Aug 04 19:07:30.680010 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:30.679970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694633776" event={"ID":"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa","Type":"ContainerStarted","Data":"97d7c985488d1e148e7578fc669a19bd295289b64d1279e1fab62dd9f26b4c59"}
Aug 04 19:07:31.431470 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:31.431372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:07:31.686396 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:31.686365    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" containerID="2e28e2c19301b098769a4d61e80fff97baaac23043555e7694906a50483f9614" exitCode=0
Aug 04 19:07:31.686571 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:31.686424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694633776" event={"ID":"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa","Type":"ContainerDied","Data":"2e28e2c19301b098769a4d61e80fff97baaac23043555e7694906a50483f9614"}
Aug 04 19:07:32.830709 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.830680    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:32.847276 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.847245    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz2m9\" (UniqueName: \"kubernetes.io/projected/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa-kube-api-access-zz2m9\") pod \"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa\" (UID: \"2e2c530a-3c3c-41e2-b40c-66bcb02f4efa\") "
Aug 04 19:07:32.850218 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.850106    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa-kube-api-access-zz2m9" (OuterVolumeSpecName: "kube-api-access-zz2m9") pod "2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" (UID: "2e2c530a-3c3c-41e2-b40c-66bcb02f4efa"). InnerVolumeSpecName "kube-api-access-zz2m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:32.872519 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.872484    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-139913694633776_2e2c530a-3c3c-41e2-b40c-66bcb02f4efa/test-curl-7552-139913694633776/0.log"
Aug 04 19:07:32.897364 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.897327    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-139913694633776"]
Aug 04 19:07:32.901454 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.901424    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-139913694633776"]
Aug 04 19:07:32.948951 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:32.948873    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz2m9\" (UniqueName: \"kubernetes.io/projected/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa-kube-api-access-zz2m9\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:33.043283 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.043251    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-139913694633648"]
Aug 04 19:07:33.043635 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.043621    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" containerName="test-curl-7552-139913694633776"
Aug 04 19:07:33.043681 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.043636    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" containerName="test-curl-7552-139913694633776"
Aug 04 19:07:33.043778 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.043705    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" containerName="test-curl-7552-139913694633776"
Aug 04 19:07:33.046838 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.046819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:33.054775 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.054712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694633648"]
Aug 04 19:07:33.150511 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.150464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djc4x\" (UniqueName: \"kubernetes.io/projected/a4057915-5425-4e27-bed6-59f4fc1351cb-kube-api-access-djc4x\") pod \"test-curl-7552-139913694633648\" (UID: \"a4057915-5425-4e27-bed6-59f4fc1351cb\") " pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:33.252180 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.252021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djc4x\" (UniqueName: \"kubernetes.io/projected/a4057915-5425-4e27-bed6-59f4fc1351cb-kube-api-access-djc4x\") pod \"test-curl-7552-139913694633648\" (UID: \"a4057915-5425-4e27-bed6-59f4fc1351cb\") " pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:33.263000 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.262967    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djc4x\" (UniqueName: \"kubernetes.io/projected/a4057915-5425-4e27-bed6-59f4fc1351cb-kube-api-access-djc4x\") pod \"test-curl-7552-139913694633648\" (UID: \"a4057915-5425-4e27-bed6-59f4fc1351cb\") " pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:33.356786 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.356749    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:33.494538 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.494507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694633648"]
Aug 04 19:07:33.496872 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:07:33.496845    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4057915_5425_4e27_bed6_59f4fc1351cb.slice/crio-1c5322263b380043b9cc9d8a9bf6024425e5ed70ae2b3174d549b1b94f7800ea WatchSource:0}: Error finding container 1c5322263b380043b9cc9d8a9bf6024425e5ed70ae2b3174d549b1b94f7800ea: Status 404 returned error can't find the container with id 1c5322263b380043b9cc9d8a9bf6024425e5ed70ae2b3174d549b1b94f7800ea
Aug 04 19:07:33.696693 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.696648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694633648" event={"ID":"a4057915-5425-4e27-bed6-59f4fc1351cb","Type":"ContainerStarted","Data":"1c5322263b380043b9cc9d8a9bf6024425e5ed70ae2b3174d549b1b94f7800ea"}
Aug 04 19:07:33.697991 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.697970    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:33.698106 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:33.698007    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97d7c985488d1e148e7578fc669a19bd295289b64d1279e1fab62dd9f26b4c59"
Aug 04 19:07:33.708577 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:07:33.708543    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-139913694633776\" is forbidden: User \"system:node:ip-10-0-137-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-226.ec2.internal' and this object" podUID="2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" pod="opendatahub/test-curl-7552-139913694633776"
Aug 04 19:07:34.162583 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:34.162505    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2c530a-3c3c-41e2-b40c-66bcb02f4efa" path="/var/lib/kubelet/pods/2e2c530a-3c3c-41e2-b40c-66bcb02f4efa/volumes"
Aug 04 19:07:34.704847 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:34.704813    2579 generic.go:356] "Generic (PLEG): container finished" podID="a4057915-5425-4e27-bed6-59f4fc1351cb" containerID="929e201a841d3368cca797445b5ece6890442229daa2def87fbff2ba66452422" exitCode=0
Aug 04 19:07:34.705018 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:34.704908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694633648" event={"ID":"a4057915-5425-4e27-bed6-59f4fc1351cb","Type":"ContainerDied","Data":"929e201a841d3368cca797445b5ece6890442229daa2def87fbff2ba66452422"}
Aug 04 19:07:35.853043 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.853012    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:35.875080 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.875048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djc4x\" (UniqueName: \"kubernetes.io/projected/a4057915-5425-4e27-bed6-59f4fc1351cb-kube-api-access-djc4x\") pod \"a4057915-5425-4e27-bed6-59f4fc1351cb\" (UID: \"a4057915-5425-4e27-bed6-59f4fc1351cb\") "
Aug 04 19:07:35.877690 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.877651    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4057915-5425-4e27-bed6-59f4fc1351cb-kube-api-access-djc4x" (OuterVolumeSpecName: "kube-api-access-djc4x") pod "a4057915-5425-4e27-bed6-59f4fc1351cb" (UID: "a4057915-5425-4e27-bed6-59f4fc1351cb"). InnerVolumeSpecName "kube-api-access-djc4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:35.879492 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.879468    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-139913694633648_a4057915-5425-4e27-bed6-59f4fc1351cb/test-curl-7552-139913694633648/0.log"
Aug 04 19:07:35.904869 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.904827    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-139913694633648"]
Aug 04 19:07:35.912090 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.912056    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-139913694633648"]
Aug 04 19:07:35.976407 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:35.976331    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djc4x\" (UniqueName: \"kubernetes.io/projected/a4057915-5425-4e27-bed6-59f4fc1351cb-kube-api-access-djc4x\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:36.100892 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.100853    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:36.101224 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.101212    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4057915-5425-4e27-bed6-59f4fc1351cb" containerName="test-curl-7552-139913694633648"
Aug 04 19:07:36.101283 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.101226    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4057915-5425-4e27-bed6-59f4fc1351cb" containerName="test-curl-7552-139913694633648"
Aug 04 19:07:36.101321 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.101299    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4057915-5425-4e27-bed6-59f4fc1351cb" containerName="test-curl-7552-139913694633648"
Aug 04 19:07:36.104077 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.104059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:36.109850 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.109821    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:36.162584 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.162549    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4057915-5425-4e27-bed6-59f4fc1351cb" path="/var/lib/kubelet/pods/a4057915-5425-4e27-bed6-59f4fc1351cb/volumes"
Aug 04 19:07:36.178705 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.178669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r26k5\" (UniqueName: \"kubernetes.io/projected/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74-kube-api-access-r26k5\") pod \"test-curl-7552-139913694559520\" (UID: \"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74\") " pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:36.280259 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.280163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r26k5\" (UniqueName: \"kubernetes.io/projected/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74-kube-api-access-r26k5\") pod \"test-curl-7552-139913694559520\" (UID: \"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74\") " pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:36.290550 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.290521    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r26k5\" (UniqueName: \"kubernetes.io/projected/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74-kube-api-access-r26k5\") pod \"test-curl-7552-139913694559520\" (UID: \"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74\") " pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:36.415050 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.414966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:36.556211 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.556182    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:36.557669 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:07:36.557642    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c0f84ce_87b8_4738_b27f_ee1dcb4c0a74.slice/crio-716996ba80ccf90339db6dac1e865114a9ae1a30afdd5978d68d7cb887a57fc4 WatchSource:0}: Error finding container 716996ba80ccf90339db6dac1e865114a9ae1a30afdd5978d68d7cb887a57fc4: Status 404 returned error can't find the container with id 716996ba80ccf90339db6dac1e865114a9ae1a30afdd5978d68d7cb887a57fc4
Aug 04 19:07:36.716170 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.716140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694633648"
Aug 04 19:07:36.716448 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.716150    2579 scope.go:117] "RemoveContainer" containerID="929e201a841d3368cca797445b5ece6890442229daa2def87fbff2ba66452422"
Aug 04 19:07:36.717625 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:36.717504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694559520" event={"ID":"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74","Type":"ContainerStarted","Data":"716996ba80ccf90339db6dac1e865114a9ae1a30afdd5978d68d7cb887a57fc4"}
Aug 04 19:07:37.725882 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:37.725848    2579 generic.go:356] "Generic (PLEG): container finished" podID="5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" containerID="7d57b209e23fe3bce52ef9bd1162ab7b4930789464ffeb5cc755b7efb6bae737" exitCode=0
Aug 04 19:07:37.726275 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:37.725912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694559520" event={"ID":"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74","Type":"ContainerDied","Data":"7d57b209e23fe3bce52ef9bd1162ab7b4930789464ffeb5cc755b7efb6bae737"}
Aug 04 19:07:38.879805 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:38.879779    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:38.903670 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:38.903643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-139913694559520_5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74/test-curl-7552-139913694559520/0.log"
Aug 04 19:07:38.931696 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:38.931666    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:38.936299 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:38.936272    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:39.005635 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.005537    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r26k5\" (UniqueName: \"kubernetes.io/projected/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74-kube-api-access-r26k5\") pod \"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74\" (UID: \"5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74\") "
Aug 04 19:07:39.007895 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.007871    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74-kube-api-access-r26k5" (OuterVolumeSpecName: "kube-api-access-r26k5") pod "5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" (UID: "5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74"). InnerVolumeSpecName "kube-api-access-r26k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:39.095829 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.095793    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:39.096264 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.096244    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" containerName="test-curl-7552-139913694559520"
Aug 04 19:07:39.096357 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.096266    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" containerName="test-curl-7552-139913694559520"
Aug 04 19:07:39.096411 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.096381    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" containerName="test-curl-7552-139913694559520"
Aug 04 19:07:39.099766 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.099743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:39.106511 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.106395    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r26k5\" (UniqueName: \"kubernetes.io/projected/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74-kube-api-access-r26k5\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:39.110317 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.110291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:39.206947 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.206901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcgh\" (UniqueName: \"kubernetes.io/projected/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3-kube-api-access-2tcgh\") pod \"test-curl-7552-139913694559520\" (UID: \"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3\") " pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:39.308022 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.307938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcgh\" (UniqueName: \"kubernetes.io/projected/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3-kube-api-access-2tcgh\") pod \"test-curl-7552-139913694559520\" (UID: \"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3\") " pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:39.317463 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.317437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcgh\" (UniqueName: \"kubernetes.io/projected/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3-kube-api-access-2tcgh\") pod \"test-curl-7552-139913694559520\" (UID: \"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3\") " pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:39.409190 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.409152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:39.546844 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.546817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:39.549328 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:07:39.549303    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0563dc4_ca8b_4f0c_93bb_f884c0b873d3.slice/crio-f4ac84314be0e617f06a73f0a17a3f7fb2ff02c3d8b594e41404d8732336b9a6 WatchSource:0}: Error finding container f4ac84314be0e617f06a73f0a17a3f7fb2ff02c3d8b594e41404d8732336b9a6: Status 404 returned error can't find the container with id f4ac84314be0e617f06a73f0a17a3f7fb2ff02c3d8b594e41404d8732336b9a6
Aug 04 19:07:39.743342 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.743312    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:39.743533 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.743315    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="716996ba80ccf90339db6dac1e865114a9ae1a30afdd5978d68d7cb887a57fc4"
Aug 04 19:07:39.744464 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.744433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694559520" event={"ID":"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3","Type":"ContainerStarted","Data":"f4ac84314be0e617f06a73f0a17a3f7fb2ff02c3d8b594e41404d8732336b9a6"}
Aug 04 19:07:39.755122 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:39.755094    2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7552-139913694559520" oldPodUID="5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" podUID="f0563dc4-ca8b-4f0c-93bb-f884c0b873d3"
Aug 04 19:07:40.162750 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:40.162651    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74" path="/var/lib/kubelet/pods/5c0f84ce-87b8-4738-b27f-ee1dcb4c0a74/volumes"
Aug 04 19:07:40.750426 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:40.750391    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0563dc4-ca8b-4f0c-93bb-f884c0b873d3" containerID="7401e43a1f9c14132ef6c61a8781d5ddf2155902f11a69cd1d537141e8d6d1f3" exitCode=0
Aug 04 19:07:40.750618 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:40.750485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694559520" event={"ID":"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3","Type":"ContainerDied","Data":"7401e43a1f9c14132ef6c61a8781d5ddf2155902f11a69cd1d537141e8d6d1f3"}
Aug 04 19:07:41.897162 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:41.897135    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:41.920454 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:41.920416    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-139913694559520_f0563dc4-ca8b-4f0c-93bb-f884c0b873d3/test-curl-7552-139913694559520/0.log"
Aug 04 19:07:41.930627 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:41.930600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tcgh\" (UniqueName: \"kubernetes.io/projected/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3-kube-api-access-2tcgh\") pod \"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3\" (UID: \"f0563dc4-ca8b-4f0c-93bb-f884c0b873d3\") "
Aug 04 19:07:41.932792 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:41.932762    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3-kube-api-access-2tcgh" (OuterVolumeSpecName: "kube-api-access-2tcgh") pod "f0563dc4-ca8b-4f0c-93bb-f884c0b873d3" (UID: "f0563dc4-ca8b-4f0c-93bb-f884c0b873d3"). InnerVolumeSpecName "kube-api-access-2tcgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:41.947596 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:41.947566    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:41.952752 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:41.952711    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-139913694559520"]
Aug 04 19:07:42.031664 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.031590    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tcgh\" (UniqueName: \"kubernetes.io/projected/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3-kube-api-access-2tcgh\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:42.086109 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.086074    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:42.086515 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.086500    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0563dc4-ca8b-4f0c-93bb-f884c0b873d3" containerName="test-curl-7552-139913694559520"
Aug 04 19:07:42.086567 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.086518    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0563dc4-ca8b-4f0c-93bb-f884c0b873d3" containerName="test-curl-7552-139913694559520"
Aug 04 19:07:42.086611 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.086597    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0563dc4-ca8b-4f0c-93bb-f884c0b873d3" containerName="test-curl-7552-139913694559520"
Aug 04 19:07:42.089573 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.089556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:42.098564 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.098539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:42.132925 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.132883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dwvg\" (UniqueName: \"kubernetes.io/projected/dd09b849-d284-416b-beee-7e53b8b96394-kube-api-access-5dwvg\") pod \"test-curl-7552-139913694544208\" (UID: \"dd09b849-d284-416b-beee-7e53b8b96394\") " pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:42.162386 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.162351    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0563dc4-ca8b-4f0c-93bb-f884c0b873d3" path="/var/lib/kubelet/pods/f0563dc4-ca8b-4f0c-93bb-f884c0b873d3/volumes"
Aug 04 19:07:42.233790 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.233749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dwvg\" (UniqueName: \"kubernetes.io/projected/dd09b849-d284-416b-beee-7e53b8b96394-kube-api-access-5dwvg\") pod \"test-curl-7552-139913694544208\" (UID: \"dd09b849-d284-416b-beee-7e53b8b96394\") " pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:42.243675 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.243647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dwvg\" (UniqueName: \"kubernetes.io/projected/dd09b849-d284-416b-beee-7e53b8b96394-kube-api-access-5dwvg\") pod \"test-curl-7552-139913694544208\" (UID: \"dd09b849-d284-416b-beee-7e53b8b96394\") " pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:42.399117 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.399020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:42.540400 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.540373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:42.542685 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:07:42.542648    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd09b849_d284_416b_beee_7e53b8b96394.slice/crio-a57c7838388fc90a9efbe70de252c8360bb24a0c0f434983a7647609c6ea2cc1 WatchSource:0}: Error finding container a57c7838388fc90a9efbe70de252c8360bb24a0c0f434983a7647609c6ea2cc1: Status 404 returned error can't find the container with id a57c7838388fc90a9efbe70de252c8360bb24a0c0f434983a7647609c6ea2cc1
Aug 04 19:07:42.761279 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.761238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694544208" event={"ID":"dd09b849-d284-416b-beee-7e53b8b96394","Type":"ContainerStarted","Data":"a57c7838388fc90a9efbe70de252c8360bb24a0c0f434983a7647609c6ea2cc1"}
Aug 04 19:07:42.762445 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.762421    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694559520"
Aug 04 19:07:42.762546 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.762465    2579 scope.go:117] "RemoveContainer" containerID="7401e43a1f9c14132ef6c61a8781d5ddf2155902f11a69cd1d537141e8d6d1f3"
Aug 04 19:07:42.842526 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:42.842492    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5" podUID="c9d4871a-7d04-447e-acde-0376711d893d" containerName="main" containerID="cri-o://c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d" gracePeriod=45
Aug 04 19:07:43.111621 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.111591    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:07:43.243918 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.243883    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-home\") pod \"c9d4871a-7d04-447e-acde-0376711d893d\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") "
Aug 04 19:07:43.244096 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.243935    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-tmp-dir\") pod \"c9d4871a-7d04-447e-acde-0376711d893d\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") "
Aug 04 19:07:43.244096 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.243971    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdc8k\" (UniqueName: \"kubernetes.io/projected/c9d4871a-7d04-447e-acde-0376711d893d-kube-api-access-gdc8k\") pod \"c9d4871a-7d04-447e-acde-0376711d893d\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") "
Aug 04 19:07:43.244096 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244016    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-model-cache\") pod \"c9d4871a-7d04-447e-acde-0376711d893d\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") "
Aug 04 19:07:43.244096 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244081    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d4871a-7d04-447e-acde-0376711d893d-tls-certs\") pod \"c9d4871a-7d04-447e-acde-0376711d893d\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") "
Aug 04 19:07:43.244335 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244109    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-dshm\") pod \"c9d4871a-7d04-447e-acde-0376711d893d\" (UID: \"c9d4871a-7d04-447e-acde-0376711d893d\") "
Aug 04 19:07:43.244335 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-home" (OuterVolumeSpecName: "home") pod "c9d4871a-7d04-447e-acde-0376711d893d" (UID: "c9d4871a-7d04-447e-acde-0376711d893d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.244335 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244278    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9d4871a-7d04-447e-acde-0376711d893d" (UID: "c9d4871a-7d04-447e-acde-0376711d893d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.244482 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244448    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9d4871a-7d04-447e-acde-0376711d893d" (UID: "c9d4871a-7d04-447e-acde-0376711d893d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.244539 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244481    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.244539 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.244501    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.246430 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.246402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-dshm" (OuterVolumeSpecName: "dshm") pod "c9d4871a-7d04-447e-acde-0376711d893d" (UID: "c9d4871a-7d04-447e-acde-0376711d893d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.246430 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.246425    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d4871a-7d04-447e-acde-0376711d893d-kube-api-access-gdc8k" (OuterVolumeSpecName: "kube-api-access-gdc8k") pod "c9d4871a-7d04-447e-acde-0376711d893d" (UID: "c9d4871a-7d04-447e-acde-0376711d893d"). InnerVolumeSpecName "kube-api-access-gdc8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:43.246610 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.246449    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9d4871a-7d04-447e-acde-0376711d893d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9d4871a-7d04-447e-acde-0376711d893d" (UID: "c9d4871a-7d04-447e-acde-0376711d893d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:07:43.345776 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.345642    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.345776 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.345693    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9d4871a-7d04-447e-acde-0376711d893d-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.345776 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.345702    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9d4871a-7d04-447e-acde-0376711d893d-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.345776 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.345711    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdc8k\" (UniqueName: \"kubernetes.io/projected/c9d4871a-7d04-447e-acde-0376711d893d-kube-api-access-gdc8k\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.637991 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.637870    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5" podUID="d2299ce5-c678-4a83-9669-92c52ab5aa8a" containerName="main" containerID="cri-o://ebaaab43e151235218b2092ef7bd8ada8c589a67d01fa2bdf82fceb1c29ded74" gracePeriod=45
Aug 04 19:07:43.769561 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.769514    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2299ce5-c678-4a83-9669-92c52ab5aa8a" containerID="ebaaab43e151235218b2092ef7bd8ada8c589a67d01fa2bdf82fceb1c29ded74" exitCode=0
Aug 04 19:07:43.769703 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.769574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5" event={"ID":"d2299ce5-c678-4a83-9669-92c52ab5aa8a","Type":"ContainerDied","Data":"ebaaab43e151235218b2092ef7bd8ada8c589a67d01fa2bdf82fceb1c29ded74"}
Aug 04 19:07:43.771214 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.771179    2579 generic.go:356] "Generic (PLEG): container finished" podID="c9d4871a-7d04-447e-acde-0376711d893d" containerID="c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d" exitCode=0
Aug 04 19:07:43.771214 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.771214    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"
Aug 04 19:07:43.771410 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.771260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5" event={"ID":"c9d4871a-7d04-447e-acde-0376711d893d","Type":"ContainerDied","Data":"c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d"}
Aug 04 19:07:43.771410 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.771309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5" event={"ID":"c9d4871a-7d04-447e-acde-0376711d893d","Type":"ContainerDied","Data":"82c0ae6ddd53c1f4211927f66842136574f679122ed526b1161ad7058f1e73c5"}
Aug 04 19:07:43.771410 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.771333    2579 scope.go:117] "RemoveContainer" containerID="c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d"
Aug 04 19:07:43.772893 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.772868    2579 generic.go:356] "Generic (PLEG): container finished" podID="dd09b849-d284-416b-beee-7e53b8b96394" containerID="0b90bfed7e97d9a0396ac45647ba82da16b9e8a6a379756c1e5c4c9cdfc10b14" exitCode=0
Aug 04 19:07:43.773187 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.772957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694544208" event={"ID":"dd09b849-d284-416b-beee-7e53b8b96394","Type":"ContainerDied","Data":"0b90bfed7e97d9a0396ac45647ba82da16b9e8a6a379756c1e5c4c9cdfc10b14"}
Aug 04 19:07:43.781935 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.781914    2579 scope.go:117] "RemoveContainer" containerID="c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d"
Aug 04 19:07:43.782250 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:07:43.782227    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d\": container with ID starting with c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d not found: ID does not exist" containerID="c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d"
Aug 04 19:07:43.782304 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.782264    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d"} err="failed to get container status \"c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d\": rpc error: code = NotFound desc = could not find container \"c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d\": container with ID starting with c1c058d8f1d8353cb64443b06eed03ddd6b0506cb680695bf286e186edd52a0d not found: ID does not exist"
Aug 04 19:07:43.810979 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.810945    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"]
Aug 04 19:07:43.815644 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.815616    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-219d48/rate-test-model-219d48-kserve-568cf4584c-dl8w5"]
Aug 04 19:07:43.892958 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.892884    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:07:43.949829 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.949799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tls-certs\") pod \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") "
Aug 04 19:07:43.950001 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.949848    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-home\") pod \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") "
Aug 04 19:07:43.950001 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.949985    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tmp-dir\") pod \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") "
Aug 04 19:07:43.950085 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-dshm\") pod \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") "
Aug 04 19:07:43.950085 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-852z7\" (UniqueName: \"kubernetes.io/projected/d2299ce5-c678-4a83-9669-92c52ab5aa8a-kube-api-access-852z7\") pod \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") "
Aug 04 19:07:43.950198 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950108    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-model-cache\") pod \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\" (UID: \"d2299ce5-c678-4a83-9669-92c52ab5aa8a\") "
Aug 04 19:07:43.950249 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950109    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-home" (OuterVolumeSpecName: "home") pod "d2299ce5-c678-4a83-9669-92c52ab5aa8a" (UID: "d2299ce5-c678-4a83-9669-92c52ab5aa8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.950308 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950254    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2299ce5-c678-4a83-9669-92c52ab5aa8a" (UID: "d2299ce5-c678-4a83-9669-92c52ab5aa8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.950361 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950338    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2299ce5-c678-4a83-9669-92c52ab5aa8a" (UID: "d2299ce5-c678-4a83-9669-92c52ab5aa8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.950485 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950463    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.950485 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950483    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.950485 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.950492    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:43.952145 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.952124    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2299ce5-c678-4a83-9669-92c52ab5aa8a" (UID: "d2299ce5-c678-4a83-9669-92c52ab5aa8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:07:43.952264 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.952243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-dshm" (OuterVolumeSpecName: "dshm") pod "d2299ce5-c678-4a83-9669-92c52ab5aa8a" (UID: "d2299ce5-c678-4a83-9669-92c52ab5aa8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:07:43.952302 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:43.952258    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2299ce5-c678-4a83-9669-92c52ab5aa8a-kube-api-access-852z7" (OuterVolumeSpecName: "kube-api-access-852z7") pod "d2299ce5-c678-4a83-9669-92c52ab5aa8a" (UID: "d2299ce5-c678-4a83-9669-92c52ab5aa8a"). InnerVolumeSpecName "kube-api-access-852z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:44.051972 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.051931    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2299ce5-c678-4a83-9669-92c52ab5aa8a-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:44.051972 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.051965    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-852z7\" (UniqueName: \"kubernetes.io/projected/d2299ce5-c678-4a83-9669-92c52ab5aa8a-kube-api-access-852z7\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:44.051972 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.051975    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2299ce5-c678-4a83-9669-92c52ab5aa8a-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:44.162645 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.162567    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d4871a-7d04-447e-acde-0376711d893d" path="/var/lib/kubelet/pods/c9d4871a-7d04-447e-acde-0376711d893d/volumes"
Aug 04 19:07:44.782216 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.782183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5" event={"ID":"d2299ce5-c678-4a83-9669-92c52ab5aa8a","Type":"ContainerDied","Data":"38a483899242bb5e97aedb9d69c7277696369198c4374f326a89a9b632e7f893"}
Aug 04 19:07:44.782392 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.782239    2579 scope.go:117] "RemoveContainer" containerID="ebaaab43e151235218b2092ef7bd8ada8c589a67d01fa2bdf82fceb1c29ded74"
Aug 04 19:07:44.782392 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.782194    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"
Aug 04 19:07:44.804035 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.804001    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"]
Aug 04 19:07:44.808133 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.808101    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-de2394/rate-test-model-de2394-kserve-59cc9d5f47-4vhj5"]
Aug 04 19:07:44.925528 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.925498    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:44.948579 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.948555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-139913694544208_dd09b849-d284-416b-beee-7e53b8b96394/test-curl-7552-139913694544208/0.log"
Aug 04 19:07:44.973926 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.973892    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:44.978194 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:44.978147    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:45.061895 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.061806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dwvg\" (UniqueName: \"kubernetes.io/projected/dd09b849-d284-416b-beee-7e53b8b96394-kube-api-access-5dwvg\") pod \"dd09b849-d284-416b-beee-7e53b8b96394\" (UID: \"dd09b849-d284-416b-beee-7e53b8b96394\") "
Aug 04 19:07:45.064157 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.064128    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd09b849-d284-416b-beee-7e53b8b96394-kube-api-access-5dwvg" (OuterVolumeSpecName: "kube-api-access-5dwvg") pod "dd09b849-d284-416b-beee-7e53b8b96394" (UID: "dd09b849-d284-416b-beee-7e53b8b96394"). InnerVolumeSpecName "kube-api-access-5dwvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:45.108362 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108321    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:45.108687 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108675    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d4871a-7d04-447e-acde-0376711d893d" containerName="main"
Aug 04 19:07:45.108747 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108688    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d4871a-7d04-447e-acde-0376711d893d" containerName="main"
Aug 04 19:07:45.108747 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108703    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd09b849-d284-416b-beee-7e53b8b96394" containerName="test-curl-7552-139913694544208"
Aug 04 19:07:45.108747 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108710    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd09b849-d284-416b-beee-7e53b8b96394" containerName="test-curl-7552-139913694544208"
Aug 04 19:07:45.108747 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108737    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2299ce5-c678-4a83-9669-92c52ab5aa8a" containerName="main"
Aug 04 19:07:45.108747 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108743    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2299ce5-c678-4a83-9669-92c52ab5aa8a" containerName="main"
Aug 04 19:07:45.108903 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108807    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2299ce5-c678-4a83-9669-92c52ab5aa8a" containerName="main"
Aug 04 19:07:45.108903 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108817    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d4871a-7d04-447e-acde-0376711d893d" containerName="main"
Aug 04 19:07:45.108903 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.108825    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd09b849-d284-416b-beee-7e53b8b96394" containerName="test-curl-7552-139913694544208"
Aug 04 19:07:45.111956 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.111938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:45.120339 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.120311    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:45.163118 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.163084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmqxj\" (UniqueName: \"kubernetes.io/projected/24748263-2129-4885-9c6f-2dc001ea3a23-kube-api-access-nmqxj\") pod \"test-curl-7552-139913694544208\" (UID: \"24748263-2129-4885-9c6f-2dc001ea3a23\") " pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:45.163490 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.163158    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dwvg\" (UniqueName: \"kubernetes.io/projected/dd09b849-d284-416b-beee-7e53b8b96394-kube-api-access-5dwvg\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:45.264382 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.264347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmqxj\" (UniqueName: \"kubernetes.io/projected/24748263-2129-4885-9c6f-2dc001ea3a23-kube-api-access-nmqxj\") pod \"test-curl-7552-139913694544208\" (UID: \"24748263-2129-4885-9c6f-2dc001ea3a23\") " pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:45.274405 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.274372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmqxj\" (UniqueName: \"kubernetes.io/projected/24748263-2129-4885-9c6f-2dc001ea3a23-kube-api-access-nmqxj\") pod \"test-curl-7552-139913694544208\" (UID: \"24748263-2129-4885-9c6f-2dc001ea3a23\") " pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:45.422125 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.422032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:45.559932 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.559906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:45.562140 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:07:45.562096    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24748263_2129_4885_9c6f_2dc001ea3a23.slice/crio-5789c7e4496641de34ca1a816f6b3304fd4a3e0e08bd62442f6fb7bfdfa2e083 WatchSource:0}: Error finding container 5789c7e4496641de34ca1a816f6b3304fd4a3e0e08bd62442f6fb7bfdfa2e083: Status 404 returned error can't find the container with id 5789c7e4496641de34ca1a816f6b3304fd4a3e0e08bd62442f6fb7bfdfa2e083
Aug 04 19:07:45.788648 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.788622    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:45.788648 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.788639    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a57c7838388fc90a9efbe70de252c8360bb24a0c0f434983a7647609c6ea2cc1"
Aug 04 19:07:45.789918 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.789893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694544208" event={"ID":"24748263-2129-4885-9c6f-2dc001ea3a23","Type":"ContainerStarted","Data":"5789c7e4496641de34ca1a816f6b3304fd4a3e0e08bd62442f6fb7bfdfa2e083"}
Aug 04 19:07:45.803676 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:45.803647    2579 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7552-139913694544208" oldPodUID="dd09b849-d284-416b-beee-7e53b8b96394" podUID="24748263-2129-4885-9c6f-2dc001ea3a23"
Aug 04 19:07:46.165575 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:46.165479    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2299ce5-c678-4a83-9669-92c52ab5aa8a" path="/var/lib/kubelet/pods/d2299ce5-c678-4a83-9669-92c52ab5aa8a/volumes"
Aug 04 19:07:46.166058 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:46.165991    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd09b849-d284-416b-beee-7e53b8b96394" path="/var/lib/kubelet/pods/dd09b849-d284-416b-beee-7e53b8b96394/volumes"
Aug 04 19:07:46.797409 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:46.797370    2579 generic.go:356] "Generic (PLEG): container finished" podID="24748263-2129-4885-9c6f-2dc001ea3a23" containerID="10260aac6fe7bfb3c8a22dfb1d87701664913d0550e2e2af40beee062f8234d0" exitCode=0
Aug 04 19:07:46.797615 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:46.797459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-139913694544208" event={"ID":"24748263-2129-4885-9c6f-2dc001ea3a23","Type":"ContainerDied","Data":"10260aac6fe7bfb3c8a22dfb1d87701664913d0550e2e2af40beee062f8234d0"}
Aug 04 19:07:47.937225 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:47.937189    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:47.961507 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:47.961467    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-139913694544208_24748263-2129-4885-9c6f-2dc001ea3a23/test-curl-7552-139913694544208/0.log"
Aug 04 19:07:47.986813 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:47.986781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmqxj\" (UniqueName: \"kubernetes.io/projected/24748263-2129-4885-9c6f-2dc001ea3a23-kube-api-access-nmqxj\") pod \"24748263-2129-4885-9c6f-2dc001ea3a23\" (UID: \"24748263-2129-4885-9c6f-2dc001ea3a23\") "
Aug 04 19:07:47.987786 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:47.987761    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:47.989071 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:47.989047    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24748263-2129-4885-9c6f-2dc001ea3a23-kube-api-access-nmqxj" (OuterVolumeSpecName: "kube-api-access-nmqxj") pod "24748263-2129-4885-9c6f-2dc001ea3a23" (UID: "24748263-2129-4885-9c6f-2dc001ea3a23"). InnerVolumeSpecName "kube-api-access-nmqxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:07:47.994293 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:47.994266    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-139913694544208"]
Aug 04 19:07:48.087932 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:48.087848    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmqxj\" (UniqueName: \"kubernetes.io/projected/24748263-2129-4885-9c6f-2dc001ea3a23-kube-api-access-nmqxj\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:07:48.161612 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:48.161578    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24748263-2129-4885-9c6f-2dc001ea3a23" path="/var/lib/kubelet/pods/24748263-2129-4885-9c6f-2dc001ea3a23/volumes"
Aug 04 19:07:48.808954 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:48.808919    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-139913694544208"
Aug 04 19:07:48.808954 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:48.808958    2579 scope.go:117] "RemoveContainer" containerID="10260aac6fe7bfb3c8a22dfb1d87701664913d0550e2e2af40beee062f8234d0"
Aug 04 19:07:57.428766 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:07:57.428710    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:08:07.546938 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.546893    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"]
Aug 04 19:08:07.547554 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.547464    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24748263-2129-4885-9c6f-2dc001ea3a23" containerName="test-curl-7552-139913694544208"
Aug 04 19:08:07.547554 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.547487    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="24748263-2129-4885-9c6f-2dc001ea3a23" containerName="test-curl-7552-139913694544208"
Aug 04 19:08:07.547680 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.547598    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="24748263-2129-4885-9c6f-2dc001ea3a23" containerName="test-curl-7552-139913694544208"
Aug 04 19:08:07.550924 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.550902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.555044 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.555017    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-4b6c58-openshift-default-dockercfg-rkjxf\""
Aug 04 19:08:07.555203 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.555072    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 19:08:07.567932 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.567900    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"]
Aug 04 19:08:07.668302 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-token\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668491 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-socket\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668491 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2aae973-9cb4-4fdc-b732-116ed616cc25-istiod-ca-cert\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668491 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-podinfo\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668491 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-certs\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668631 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-data\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668631 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-credential-socket\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668631 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfrk\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-kube-api-access-xvfrk\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.668631 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.668588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-envoy\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.769884 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.769844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfrk\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-kube-api-access-xvfrk\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.769884 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.769890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-envoy\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770136 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.769935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-token\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770136 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.769966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-socket\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770136 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.769989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2aae973-9cb4-4fdc-b732-116ed616cc25-istiod-ca-cert\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770136 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-podinfo\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770339 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-certs\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770339 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-data\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770339 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-credential-socket\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770521 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-socket\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770602 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-certs\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770662 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-data\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770742 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770691    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-credential-socket\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.770940 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.770919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2aae973-9cb4-4fdc-b732-116ed616cc25-istiod-ca-cert\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.772506 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.772479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-envoy\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.773224 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.773198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-podinfo\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.784971 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.784942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-token\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.785132 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.785003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfrk\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-kube-api-access-xvfrk\") pod \"e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") " pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:07.862127 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:07.862033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:08.023108 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:08.023082    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"]
Aug 04 19:08:08.025701 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:08:08.025674    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aae973_9cb4_4fdc_b732_116ed616cc25.slice/crio-58a04e278fc350287ff7e01daa3fc100de5f5f626f7869a3a0d028f36c52aeb0 WatchSource:0}: Error finding container 58a04e278fc350287ff7e01daa3fc100de5f5f626f7869a3a0d028f36c52aeb0: Status 404 returned error can't find the container with id 58a04e278fc350287ff7e01daa3fc100de5f5f626f7869a3a0d028f36c52aeb0
Aug 04 19:08:08.911789 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:08.911754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" event={"ID":"f2aae973-9cb4-4fdc-b732-116ed616cc25","Type":"ContainerStarted","Data":"58a04e278fc350287ff7e01daa3fc100de5f5f626f7869a3a0d028f36c52aeb0"}
Aug 04 19:08:11.445906 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:11.445863    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:08:11.446225 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:11.445943    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:08:11.446225 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:11.445973    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:08:11.931572 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:11.931473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" event={"ID":"f2aae973-9cb4-4fdc-b732-116ed616cc25","Type":"ContainerStarted","Data":"e25df4254b391082e0d99d32f1bd5ed11a2491d90c9dcd4e72b976671490f4a1"}
Aug 04 19:08:11.958114 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:11.958059    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podStartSLOduration=1.5404227160000001 podStartE2EDuration="4.958043614s" totalImagesPullingTime="3.417620898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:08:11.95639293 +0000 UTC m=+3446.281496086" watchObservedRunningTime="2026-08-04 19:08:11.958043614 +0000 UTC m=+3446.283146733"
Aug 04 19:08:12.862834 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:12.862778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:12.867998 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:12.867973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:12.936712 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:12.936682    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:12.937841 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:12.937821    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:19.744043 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:19.744006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:08:28.977988 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:28.977934    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 04 19:08:28.978420 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:28.978020    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 04 19:08:30.027558 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:30.027520    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerID="e25df4254b391082e0d99d32f1bd5ed11a2491d90c9dcd4e72b976671490f4a1" exitCode=0
Aug 04 19:08:30.027558 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:30.027564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" event={"ID":"f2aae973-9cb4-4fdc-b732-116ed616cc25","Type":"ContainerDied","Data":"e25df4254b391082e0d99d32f1bd5ed11a2491d90c9dcd4e72b976671490f4a1"}
Aug 04 19:08:30.028066 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:30.027998    2579 scope.go:117] "RemoveContainer" containerID="e25df4254b391082e0d99d32f1bd5ed11a2491d90c9dcd4e72b976671490f4a1"
Aug 04 19:08:30.029119 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:30.029083    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:08:30.029189 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:30.029162    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:08:30.029226 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:30.029195    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:08:31.034431 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:31.034398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" event={"ID":"f2aae973-9cb4-4fdc-b732-116ed616cc25","Type":"ContainerStarted","Data":"9b5f847dff38294e2c5783536733f7b31feee8370cc9a29c2da97498f4b3f0b1"}
Aug 04 19:08:31.862680 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:31.862627    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:31.862934 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:31.862776    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:08:31.862934 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:31.862828    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:08:32.863206 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:32.863155    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:08:32.863756 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:32.863233    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:08:33.863014 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:33.862975    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:08:33.863343 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:33.863311    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:08:34.862489 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:34.862447    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:08:34.862845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:34.862809    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:08:35.863512 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:35.863466    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Aug 04 19:08:35.864060 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:35.863538    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Aug 04 19:08:36.866416 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:36.866387    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:36.866889 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:36.866662    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:36.867414 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:36.867383    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:08:44.517353 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.517316    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"]
Aug 04 19:08:44.525791 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.525707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.531605 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.531361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-0c0dc7\"/\"kube-root-ca.crt\""
Aug 04 19:08:44.531815 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.531769    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-0c0dc7\"/\"openshift-service-ca.crt\""
Aug 04 19:08:44.531987 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.531965    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-0c0dc7\"/\"default-dockercfg-74hql\""
Aug 04 19:08:44.533178 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.533152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-0c0dc7\"/\"ipp-route-0c0dc7-kserve-self-signed-certs\""
Aug 04 19:08:44.533519 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.533499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"]
Aug 04 19:08:44.609979 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.609942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-dshm\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.610206 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.609998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-model-cache\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.610206 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.610099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-tmp-dir\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.610317 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.610204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f516b20-5260-4a43-a5ce-a99f50780cc4-tls-certs\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.610317 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.610236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-home\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.610317 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.610262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg755\" (UniqueName: \"kubernetes.io/projected/6f516b20-5260-4a43-a5ce-a99f50780cc4-kube-api-access-wg755\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711277 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-tmp-dir\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f516b20-5260-4a43-a5ce-a99f50780cc4-tls-certs\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-home\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg755\" (UniqueName: \"kubernetes.io/projected/6f516b20-5260-4a43-a5ce-a99f50780cc4-kube-api-access-wg755\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-dshm\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-model-cache\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711833 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-tmp-dir\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711833 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-home\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.711923 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.711865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-model-cache\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.713945 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.713913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-dshm\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.714257 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.714193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f516b20-5260-4a43-a5ce-a99f50780cc4-tls-certs\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.720798 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.720770    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg755\" (UniqueName: \"kubernetes.io/projected/6f516b20-5260-4a43-a5ce-a99f50780cc4-kube-api-access-wg755\") pod \"ipp-route-0c0dc7-kserve-5589b69795-9rx6r\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") " pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.835943 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.835853    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:44.976903 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:44.976873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"]
Aug 04 19:08:44.979293 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:08:44.979259    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f516b20_5260_4a43_a5ce_a99f50780cc4.slice/crio-0e05188db66534c21d9f2863495935ecbf4a717c3ffd9443cbd00ab8519a4b7b WatchSource:0}: Error finding container 0e05188db66534c21d9f2863495935ecbf4a717c3ffd9443cbd00ab8519a4b7b: Status 404 returned error can't find the container with id 0e05188db66534c21d9f2863495935ecbf4a717c3ffd9443cbd00ab8519a4b7b
Aug 04 19:08:45.110862 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:45.110769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r" event={"ID":"6f516b20-5260-4a43-a5ce-a99f50780cc4","Type":"ContainerStarted","Data":"34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f"}
Aug 04 19:08:45.110862 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:45.110824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r" event={"ID":"6f516b20-5260-4a43-a5ce-a99f50780cc4","Type":"ContainerStarted","Data":"0e05188db66534c21d9f2863495935ecbf4a717c3ffd9443cbd00ab8519a4b7b"}
Aug 04 19:08:45.134188 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:45.134131    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r" podStartSLOduration=1.134115306 podStartE2EDuration="1.134115306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:08:45.131554536 +0000 UTC m=+3479.456657659" watchObservedRunningTime="2026-08-04 19:08:45.134115306 +0000 UTC m=+3479.459218426"
Aug 04 19:08:47.042783 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:47.042657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:08:54.836634 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:54.836587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:54.837074 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:54.836647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:54.849710 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:54.849683    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:08:55.175272 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:08:55.175198    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:09:10.828770 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:10.828672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:09:21.031012 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.030970    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"]
Aug 04 19:09:21.035181 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.035160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.038481 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.038459    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-c75b82-openshift-default-dockercfg-wx6kn\""
Aug 04 19:09:21.064083 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.064048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"]
Aug 04 19:09:21.168415 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-socket\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-podinfo\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-credential-socket\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-certs\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-token\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168824 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-data\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168824 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-envoy\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.168824 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.168674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5lb\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-kube-api-access-th5lb\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.269853 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.269811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-token\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.269853 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.269853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-data\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.269879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-envoy\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.269902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5lb\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-kube-api-access-th5lb\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.269951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-socket\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-podinfo\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-credential-socket\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270120 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-certs\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-data\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270488 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270402    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-socket\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270609 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-certs\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270707 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-credential-socket\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.270918 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.270868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.272636 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.272609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-envoy\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.272827 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.272811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-podinfo\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.285617 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.285543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5lb\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-kube-api-access-th5lb\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.286210 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.286190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-token\") pod \"e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") " pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.345373 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.345330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:21.496159 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.496137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"]
Aug 04 19:09:21.498179 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:09:21.498143    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8011d465_a66e_4cfb_8406_4abf8bcd8c21.slice/crio-90ce3c3b3ca18a70340e6493ef7aedb5bf014a5f98e5623e549f2480c5c64b35 WatchSource:0}: Error finding container 90ce3c3b3ca18a70340e6493ef7aedb5bf014a5f98e5623e549f2480c5c64b35: Status 404 returned error can't find the container with id 90ce3c3b3ca18a70340e6493ef7aedb5bf014a5f98e5623e549f2480c5c64b35
Aug 04 19:09:21.500408 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.500364    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:09:21.500531 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.500456    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:09:21.500531 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:21.500501    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:09:22.300840 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:22.300804    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" event={"ID":"8011d465-a66e-4cfb-8406-4abf8bcd8c21","Type":"ContainerStarted","Data":"b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"}
Aug 04 19:09:22.301290 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:22.300857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" event={"ID":"8011d465-a66e-4cfb-8406-4abf8bcd8c21","Type":"ContainerStarted","Data":"90ce3c3b3ca18a70340e6493ef7aedb5bf014a5f98e5623e549f2480c5c64b35"}
Aug 04 19:09:22.345550 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:22.345514    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:22.351272 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:22.351224    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:22.351790 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:22.351752    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podStartSLOduration=2.351713462 podStartE2EDuration="2.351713462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:09:22.350293273 +0000 UTC m=+3516.675396418" watchObservedRunningTime="2026-08-04 19:09:22.351713462 +0000 UTC m=+3516.676816584"
Aug 04 19:09:23.306222 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:23.306188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:23.307162 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:23.307144    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:31.844737 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:31.844692    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:09:42.416458 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:42.416423    2579 generic.go:356] "Generic (PLEG): container finished" podID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerID="b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0" exitCode=0
Aug 04 19:09:42.417017 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:42.416502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" event={"ID":"8011d465-a66e-4cfb-8406-4abf8bcd8c21","Type":"ContainerDied","Data":"b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"}
Aug 04 19:09:42.417090 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:42.417031    2579 scope.go:117] "RemoveContainer" containerID="b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"
Aug 04 19:09:42.418227 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:42.418195    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:09:42.418300 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:42.418275    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:09:42.418349 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:42.418309    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Aug 04 19:09:43.424700 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:43.424665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" event={"ID":"8011d465-a66e-4cfb-8406-4abf8bcd8c21","Type":"ContainerStarted","Data":"c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5"}
Aug 04 19:09:44.345801 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:44.345767    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:44.346014 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:44.345992    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 19:09:44.346070 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:44.346042    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 19:09:45.221263 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.221230    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"]
Aug 04 19:09:45.223907 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.223881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:45.228271 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.228246    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:09:45.228633 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.228614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 19:09:45.239175 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.239138    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"]
Aug 04 19:09:45.311878 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.311840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2885628-bf5a-4f6d-bfe1-03761b4943d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn\" (UID: \"e2885628-bf5a-4f6d-bfe1-03761b4943d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:45.346009 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.345980    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 19:09:45.346149 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.346031    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 19:09:45.412541 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.412499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2885628-bf5a-4f6d-bfe1-03761b4943d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn\" (UID: \"e2885628-bf5a-4f6d-bfe1-03761b4943d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:45.413237 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.413214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2885628-bf5a-4f6d-bfe1-03761b4943d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn\" (UID: \"e2885628-bf5a-4f6d-bfe1-03761b4943d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:45.535091 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.534980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:45.926113 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:45.926026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"]
Aug 04 19:09:45.929574 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:09:45.929544    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2885628_bf5a_4f6d_bfe1_03761b4943d2.slice/crio-e8af6e18e92c4a959188acf69d7b85083a67d9d820210ebf38d6eb3c856326b5 WatchSource:0}: Error finding container e8af6e18e92c4a959188acf69d7b85083a67d9d820210ebf38d6eb3c856326b5: Status 404 returned error can't find the container with id e8af6e18e92c4a959188acf69d7b85083a67d9d820210ebf38d6eb3c856326b5
Aug 04 19:09:46.346294 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:46.346254    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 19:09:46.346706 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:46.346310    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 19:09:46.441543 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:46.441501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn" event={"ID":"e2885628-bf5a-4f6d-bfe1-03761b4943d2","Type":"ContainerStarted","Data":"d1adb8909ec0b298abee3ced7a650a7059c75ff3481d9196a77ea0f33d111c79"}
Aug 04 19:09:46.441755 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:46.441564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn" event={"ID":"e2885628-bf5a-4f6d-bfe1-03761b4943d2","Type":"ContainerStarted","Data":"e8af6e18e92c4a959188acf69d7b85083a67d9d820210ebf38d6eb3c856326b5"}
Aug 04 19:09:46.465467 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:46.465401    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn" podStartSLOduration=1.465378361 podStartE2EDuration="1.465378361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:09:46.463540385 +0000 UTC m=+3540.788643509" watchObservedRunningTime="2026-08-04 19:09:46.465378361 +0000 UTC m=+3540.790481482"
Aug 04 19:09:47.346074 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:47.346040    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 19:09:47.346258 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:47.346097    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 19:09:47.449047 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:47.449015    2579 generic.go:356] "Generic (PLEG): container finished" podID="e2885628-bf5a-4f6d-bfe1-03761b4943d2" containerID="d1adb8909ec0b298abee3ced7a650a7059c75ff3481d9196a77ea0f33d111c79" exitCode=0
Aug 04 19:09:47.449661 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:47.449075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn" event={"ID":"e2885628-bf5a-4f6d-bfe1-03761b4943d2","Type":"ContainerDied","Data":"d1adb8909ec0b298abee3ced7a650a7059c75ff3481d9196a77ea0f33d111c79"}
Aug 04 19:09:48.346804 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:48.346766    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Aug 04 19:09:48.346993 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:48.346823    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Aug 04 19:09:48.595354 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:48.595278    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:48.646144 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:48.646050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2885628-bf5a-4f6d-bfe1-03761b4943d2-maas-api-service-ca\") pod \"e2885628-bf5a-4f6d-bfe1-03761b4943d2\" (UID: \"e2885628-bf5a-4f6d-bfe1-03761b4943d2\") "
Aug 04 19:09:48.646464 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:48.646442    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2885628-bf5a-4f6d-bfe1-03761b4943d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e2885628-bf5a-4f6d-bfe1-03761b4943d2" (UID: "e2885628-bf5a-4f6d-bfe1-03761b4943d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:09:48.747680 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:48.747402    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2885628-bf5a-4f6d-bfe1-03761b4943d2-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:09:49.351007 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:49.350975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:49.351383 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:49.351359    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:49.352213 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:49.352162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:09:49.461269 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:49.461239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"
Aug 04 19:09:49.461269 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:49.461247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn" event={"ID":"e2885628-bf5a-4f6d-bfe1-03761b4943d2","Type":"ContainerDied","Data":"e8af6e18e92c4a959188acf69d7b85083a67d9d820210ebf38d6eb3c856326b5"}
Aug 04 19:09:49.461541 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:49.461302    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8af6e18e92c4a959188acf69d7b85083a67d9d820210ebf38d6eb3c856326b5"
Aug 04 19:09:56.474558 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:56.474520    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"]
Aug 04 19:09:56.483528 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:56.483499    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c75b82-cwbgn"]
Aug 04 19:09:58.161773 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:58.161742    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2885628-bf5a-4f6d-bfe1-03761b4943d2" path="/var/lib/kubelet/pods/e2885628-bf5a-4f6d-bfe1-03761b4943d2/volumes"
Aug 04 19:09:59.439320 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:09:59.439283    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:10:04.987068 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:04.987034    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"]
Aug 04 19:10:04.987523 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:04.987250    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy" containerID="cri-o://c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5" gracePeriod=30
Aug 04 19:10:08.981562 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.981525    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"]
Aug 04 19:10:08.982068 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.981933    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2885628-bf5a-4f6d-bfe1-03761b4943d2" containerName="revoke-keys"
Aug 04 19:10:08.982068 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.981944    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2885628-bf5a-4f6d-bfe1-03761b4943d2" containerName="revoke-keys"
Aug 04 19:10:08.982068 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.982000    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2885628-bf5a-4f6d-bfe1-03761b4943d2" containerName="revoke-keys"
Aug 04 19:10:08.984031 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.984014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:08.986777 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.986751    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:10:08.986917 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.986835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 19:10:08.998623 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:08.998579    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"]
Aug 04 19:10:09.148033 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:09.147984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45038406-20c4-4415-b994-8b53649eab66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds\" (UID: \"45038406-20c4-4415-b994-8b53649eab66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:09.248798 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:09.248679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45038406-20c4-4415-b994-8b53649eab66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds\" (UID: \"45038406-20c4-4415-b994-8b53649eab66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:09.249319 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:09.249298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45038406-20c4-4415-b994-8b53649eab66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds\" (UID: \"45038406-20c4-4415-b994-8b53649eab66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:09.297768 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:09.297703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:09.437661 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:09.437599    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"]
Aug 04 19:10:09.439891 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:10:09.439864    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45038406_20c4_4415_b994_8b53649eab66.slice/crio-ba5ee800e21565597d1077c3ab53f7b62efa1e9b14064811f99005c1cba6a7bb WatchSource:0}: Error finding container ba5ee800e21565597d1077c3ab53f7b62efa1e9b14064811f99005c1cba6a7bb: Status 404 returned error can't find the container with id ba5ee800e21565597d1077c3ab53f7b62efa1e9b14064811f99005c1cba6a7bb
Aug 04 19:10:09.571315 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:09.571220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds" event={"ID":"45038406-20c4-4415-b994-8b53649eab66","Type":"ContainerStarted","Data":"ba5ee800e21565597d1077c3ab53f7b62efa1e9b14064811f99005c1cba6a7bb"}
Aug 04 19:10:10.328807 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.328782    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:10:10.461000 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.460955    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-podinfo\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461000 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.460997    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-credential-socket\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461252 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istiod-ca-cert\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461252 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461047    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-socket\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461252 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461127    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-token\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461252 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-certs\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461252 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-envoy\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461252 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461227    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th5lb\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-kube-api-access-th5lb\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461557 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461313    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-data\") pod \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\" (UID: \"8011d465-a66e-4cfb-8406-4abf8bcd8c21\") "
Aug 04 19:10:10.461557 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461320    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:10.461557 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461376    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:10.461557 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461481    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:10:10.461557 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461536    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:10.461820 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461666    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.461820 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461747    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-credential-socket\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.461904 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461867    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istiod-ca-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.461904 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.461892    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-workload-socket\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.462122 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.462096    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-data" (OuterVolumeSpecName: "istio-data") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:10.463626 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.463599    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:10.463805 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.463600    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:10:10.463805 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.463648    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-token" (OuterVolumeSpecName: "istio-token") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:10:10.464020 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.464000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-kube-api-access-th5lb" (OuterVolumeSpecName: "kube-api-access-th5lb") pod "8011d465-a66e-4cfb-8406-4abf8bcd8c21" (UID: "8011d465-a66e-4cfb-8406-4abf8bcd8c21"). InnerVolumeSpecName "kube-api-access-th5lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:10:10.563270 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.563171    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-token\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.563270 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.563205    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-envoy\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.563270 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.563214    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th5lb\" (UniqueName: \"kubernetes.io/projected/8011d465-a66e-4cfb-8406-4abf8bcd8c21-kube-api-access-th5lb\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.563270 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.563226    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-data\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.563270 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.563237    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8011d465-a66e-4cfb-8406-4abf8bcd8c21-istio-podinfo\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:10.578536 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.578498    2579 generic.go:356] "Generic (PLEG): container finished" podID="45038406-20c4-4415-b994-8b53649eab66" containerID="2c6f995edcdfe0c54217a6c14beea880755a7cac93be07b88c6f46a622dd6a1f" exitCode=0
Aug 04 19:10:10.578761 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.578586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds" event={"ID":"45038406-20c4-4415-b994-8b53649eab66","Type":"ContainerDied","Data":"2c6f995edcdfe0c54217a6c14beea880755a7cac93be07b88c6f46a622dd6a1f"}
Aug 04 19:10:10.580304 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.580280    2579 generic.go:356] "Generic (PLEG): container finished" podID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerID="c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5" exitCode=0
Aug 04 19:10:10.580419 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.580313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" event={"ID":"8011d465-a66e-4cfb-8406-4abf8bcd8c21","Type":"ContainerDied","Data":"c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5"}
Aug 04 19:10:10.580419 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.580326    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"
Aug 04 19:10:10.580419 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.580348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl" event={"ID":"8011d465-a66e-4cfb-8406-4abf8bcd8c21","Type":"ContainerDied","Data":"90ce3c3b3ca18a70340e6493ef7aedb5bf014a5f98e5623e549f2480c5c64b35"}
Aug 04 19:10:10.580419 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.580369    2579 scope.go:117] "RemoveContainer" containerID="c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5"
Aug 04 19:10:10.590411 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.590390    2579 scope.go:117] "RemoveContainer" containerID="b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"
Aug 04 19:10:10.600117 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.600093    2579 scope.go:117] "RemoveContainer" containerID="c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5"
Aug 04 19:10:10.600483 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:10:10.600451    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5\": container with ID starting with c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5 not found: ID does not exist" containerID="c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5"
Aug 04 19:10:10.600540 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.600482    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5"} err="failed to get container status \"c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5\": rpc error: code = NotFound desc = could not find container \"c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5\": container with ID starting with c92c40611b48418b6eefadd6126ac334e9401c2f907a11ea268a93c1756a0ac5 not found: ID does not exist"
Aug 04 19:10:10.600540 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.600503    2579 scope.go:117] "RemoveContainer" containerID="b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"
Aug 04 19:10:10.600810 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:10:10.600791    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0\": container with ID starting with b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0 not found: ID does not exist" containerID="b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"
Aug 04 19:10:10.600861 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.600818    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0"} err="failed to get container status \"b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0\": rpc error: code = NotFound desc = could not find container \"b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0\": container with ID starting with b708a718facb6b1fbf5ac53d88b0fc6576e6c5024888ca01290aa4d51b3ef0b0 not found: ID does not exist"
Aug 04 19:10:10.612572 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.612535    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"]
Aug 04 19:10:10.621082 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:10.621048    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c75b82-openshift-default-7bbd4bb966-7cvxl"]
Aug 04 19:10:11.722528 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:11.722500    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:11.875592 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:11.875498    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45038406-20c4-4415-b994-8b53649eab66-maas-api-service-ca\") pod \"45038406-20c4-4415-b994-8b53649eab66\" (UID: \"45038406-20c4-4415-b994-8b53649eab66\") "
Aug 04 19:10:11.875935 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:11.875913    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45038406-20c4-4415-b994-8b53649eab66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45038406-20c4-4415-b994-8b53649eab66" (UID: "45038406-20c4-4415-b994-8b53649eab66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:10:11.976523 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:11.976477    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45038406-20c4-4415-b994-8b53649eab66-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:12.162230 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:12.162148    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" path="/var/lib/kubelet/pods/8011d465-a66e-4cfb-8406-4abf8bcd8c21/volumes"
Aug 04 19:10:12.592215 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:12.592182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds" event={"ID":"45038406-20c4-4415-b994-8b53649eab66","Type":"ContainerDied","Data":"ba5ee800e21565597d1077c3ab53f7b62efa1e9b14064811f99005c1cba6a7bb"}
Aug 04 19:10:12.592428 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:12.592231    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba5ee800e21565597d1077c3ab53f7b62efa1e9b14064811f99005c1cba6a7bb"
Aug 04 19:10:12.592428 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:12.592189    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"
Aug 04 19:10:23.631290 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:23.631245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:10:29.005692 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:29.005651    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"]
Aug 04 19:10:29.012151 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:29.012119    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0c0dc7-9jwds"]
Aug 04 19:10:30.162191 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:30.162158    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45038406-20c4-4415-b994-8b53649eab66" path="/var/lib/kubelet/pods/45038406-20c4-4415-b994-8b53649eab66/volumes"
Aug 04 19:10:31.246218 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:31.246177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:10:34.400287 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:34.400250    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"]
Aug 04 19:10:46.426404 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:46.426377    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 19:10:46.435273 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:46.435244    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzbpk_b2b08036-6367-42c9-a6fe-32683902f7ac/ovn-acl-logging/0.log"
Aug 04 19:10:49.420185 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.420127    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r" podUID="6f516b20-5260-4a43-a5ce-a99f50780cc4" containerName="main" containerID="cri-o://34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f" gracePeriod=45
Aug 04 19:10:49.679677 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.679610    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:10:49.793974 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.793935    2579 generic.go:356] "Generic (PLEG): container finished" podID="6f516b20-5260-4a43-a5ce-a99f50780cc4" containerID="34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f" exitCode=0
Aug 04 19:10:49.794154 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.793980    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"
Aug 04 19:10:49.794154 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.794022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r" event={"ID":"6f516b20-5260-4a43-a5ce-a99f50780cc4","Type":"ContainerDied","Data":"34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f"}
Aug 04 19:10:49.794154 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.794067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r" event={"ID":"6f516b20-5260-4a43-a5ce-a99f50780cc4","Type":"ContainerDied","Data":"0e05188db66534c21d9f2863495935ecbf4a717c3ffd9443cbd00ab8519a4b7b"}
Aug 04 19:10:49.794154 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.794088    2579 scope.go:117] "RemoveContainer" containerID="34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f"
Aug 04 19:10:49.803219 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.803195    2579 scope.go:117] "RemoveContainer" containerID="34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f"
Aug 04 19:10:49.803577 ip-10-0-137-226 kubenswrapper[2579]: E0804 19:10:49.803551    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f\": container with ID starting with 34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f not found: ID does not exist" containerID="34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f"
Aug 04 19:10:49.803618 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.803587    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f"} err="failed to get container status \"34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f\": rpc error: code = NotFound desc = could not find container \"34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f\": container with ID starting with 34d098b52952aa6617a036cc762a80f5c2294008d58b80341f7c1f56d52fb83f not found: ID does not exist"
Aug 04 19:10:49.825998 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.825960    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-model-cache\") pod \"6f516b20-5260-4a43-a5ce-a99f50780cc4\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") "
Aug 04 19:10:49.826169 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826072    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-home\") pod \"6f516b20-5260-4a43-a5ce-a99f50780cc4\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") "
Aug 04 19:10:49.826169 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826095    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f516b20-5260-4a43-a5ce-a99f50780cc4-tls-certs\") pod \"6f516b20-5260-4a43-a5ce-a99f50780cc4\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") "
Aug 04 19:10:49.826169 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826121    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-dshm\") pod \"6f516b20-5260-4a43-a5ce-a99f50780cc4\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") "
Aug 04 19:10:49.826169 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg755\" (UniqueName: \"kubernetes.io/projected/6f516b20-5260-4a43-a5ce-a99f50780cc4-kube-api-access-wg755\") pod \"6f516b20-5260-4a43-a5ce-a99f50780cc4\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") "
Aug 04 19:10:49.826397 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-tmp-dir\") pod \"6f516b20-5260-4a43-a5ce-a99f50780cc4\" (UID: \"6f516b20-5260-4a43-a5ce-a99f50780cc4\") "
Aug 04 19:10:49.826397 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826249    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f516b20-5260-4a43-a5ce-a99f50780cc4" (UID: "6f516b20-5260-4a43-a5ce-a99f50780cc4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:49.826397 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826351    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-home" (OuterVolumeSpecName: "home") pod "6f516b20-5260-4a43-a5ce-a99f50780cc4" (UID: "6f516b20-5260-4a43-a5ce-a99f50780cc4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:49.826552 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826507    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f516b20-5260-4a43-a5ce-a99f50780cc4" (UID: "6f516b20-5260-4a43-a5ce-a99f50780cc4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:49.826552 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826526    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-home\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:49.826552 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.826549    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-model-cache\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:49.828667 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.828636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-dshm" (OuterVolumeSpecName: "dshm") pod "6f516b20-5260-4a43-a5ce-a99f50780cc4" (UID: "6f516b20-5260-4a43-a5ce-a99f50780cc4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:10:49.828808 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.828702    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f516b20-5260-4a43-a5ce-a99f50780cc4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f516b20-5260-4a43-a5ce-a99f50780cc4" (UID: "6f516b20-5260-4a43-a5ce-a99f50780cc4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 19:10:49.828808 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.828702    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f516b20-5260-4a43-a5ce-a99f50780cc4-kube-api-access-wg755" (OuterVolumeSpecName: "kube-api-access-wg755") pod "6f516b20-5260-4a43-a5ce-a99f50780cc4" (UID: "6f516b20-5260-4a43-a5ce-a99f50780cc4"). InnerVolumeSpecName "kube-api-access-wg755". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:10:49.927364 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.927316    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-tmp-dir\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:49.927364 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.927355    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f516b20-5260-4a43-a5ce-a99f50780cc4-tls-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:49.927364 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.927366    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f516b20-5260-4a43-a5ce-a99f50780cc4-dshm\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:49.927615 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:49.927377    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg755\" (UniqueName: \"kubernetes.io/projected/6f516b20-5260-4a43-a5ce-a99f50780cc4-kube-api-access-wg755\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:10:50.117068 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:50.117030    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"]
Aug 04 19:10:50.122066 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:50.122035    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-0c0dc7/ipp-route-0c0dc7-kserve-5589b69795-9rx6r"]
Aug 04 19:10:50.163346 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:10:50.163310    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f516b20-5260-4a43-a5ce-a99f50780cc4" path="/var/lib/kubelet/pods/6f516b20-5260-4a43-a5ce-a99f50780cc4/volumes"
Aug 04 19:11:26.973395 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973359    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"]
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973742    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973754    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973768    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45038406-20c4-4415-b994-8b53649eab66" containerName="revoke-keys"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973773    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="45038406-20c4-4415-b994-8b53649eab66" containerName="revoke-keys"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973786    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f516b20-5260-4a43-a5ce-a99f50780cc4" containerName="main"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973792    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f516b20-5260-4a43-a5ce-a99f50780cc4" containerName="main"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973844    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f516b20-5260-4a43-a5ce-a99f50780cc4" containerName="main"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973852    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy"
Aug 04 19:11:26.973920 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.973858    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="45038406-20c4-4415-b994-8b53649eab66" containerName="revoke-keys"
Aug 04 19:11:26.977093 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.977078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:26.979947 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.979924    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:11:26.980089 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.980040    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 19:11:26.987363 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:26.987331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"]
Aug 04 19:11:27.069851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.069806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce99f5f4-7c63-4e87-b9c1-10ac849ed226-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29\" (UID: \"ce99f5f4-7c63-4e87-b9c1-10ac849ed226\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:27.170833 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.170801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce99f5f4-7c63-4e87-b9c1-10ac849ed226-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29\" (UID: \"ce99f5f4-7c63-4e87-b9c1-10ac849ed226\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:27.171511 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.171488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce99f5f4-7c63-4e87-b9c1-10ac849ed226-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29\" (UID: \"ce99f5f4-7c63-4e87-b9c1-10ac849ed226\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:27.289113 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.289020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:27.434869 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.434818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"]
Aug 04 19:11:27.437257 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:11:27.437227    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce99f5f4_7c63_4e87_b9c1_10ac849ed226.slice/crio-9c28cdf0fbd9024dd63a25f74aa320ddcd3452337911367db7108db040e5d862 WatchSource:0}: Error finding container 9c28cdf0fbd9024dd63a25f74aa320ddcd3452337911367db7108db040e5d862: Status 404 returned error can't find the container with id 9c28cdf0fbd9024dd63a25f74aa320ddcd3452337911367db7108db040e5d862
Aug 04 19:11:27.995348 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.995317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29" event={"ID":"ce99f5f4-7c63-4e87-b9c1-10ac849ed226","Type":"ContainerStarted","Data":"b5d4b6f6020b687311ec1dfd201c13db8a4eb7f484c41e0add5fe5f660e3b9e2"}
Aug 04 19:11:27.995800 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:27.995366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29" event={"ID":"ce99f5f4-7c63-4e87-b9c1-10ac849ed226","Type":"ContainerStarted","Data":"9c28cdf0fbd9024dd63a25f74aa320ddcd3452337911367db7108db040e5d862"}
Aug 04 19:11:28.029168 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:28.029098    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29" podStartSLOduration=2.029075398 podStartE2EDuration="2.029075398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:11:28.025841071 +0000 UTC m=+3642.350944217" watchObservedRunningTime="2026-08-04 19:11:28.029075398 +0000 UTC m=+3642.354178519"
Aug 04 19:11:29.001869 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:29.001832    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce99f5f4-7c63-4e87-b9c1-10ac849ed226" containerID="b5d4b6f6020b687311ec1dfd201c13db8a4eb7f484c41e0add5fe5f660e3b9e2" exitCode=0
Aug 04 19:11:29.002279 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:29.001928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29" event={"ID":"ce99f5f4-7c63-4e87-b9c1-10ac849ed226","Type":"ContainerDied","Data":"b5d4b6f6020b687311ec1dfd201c13db8a4eb7f484c41e0add5fe5f660e3b9e2"}
Aug 04 19:11:30.143349 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:30.143315    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:30.298898 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:30.298806    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce99f5f4-7c63-4e87-b9c1-10ac849ed226-maas-api-service-ca\") pod \"ce99f5f4-7c63-4e87-b9c1-10ac849ed226\" (UID: \"ce99f5f4-7c63-4e87-b9c1-10ac849ed226\") "
Aug 04 19:11:30.299207 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:30.299185    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce99f5f4-7c63-4e87-b9c1-10ac849ed226-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce99f5f4-7c63-4e87-b9c1-10ac849ed226" (UID: "ce99f5f4-7c63-4e87-b9c1-10ac849ed226"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:30.400239 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:30.400204    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce99f5f4-7c63-4e87-b9c1-10ac849ed226-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:31.012851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:31.012819    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"
Aug 04 19:11:31.013032 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:31.012820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29" event={"ID":"ce99f5f4-7c63-4e87-b9c1-10ac849ed226","Type":"ContainerDied","Data":"9c28cdf0fbd9024dd63a25f74aa320ddcd3452337911367db7108db040e5d862"}
Aug 04 19:11:31.013032 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:31.012952    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c28cdf0fbd9024dd63a25f74aa320ddcd3452337911367db7108db040e5d862"
Aug 04 19:11:34.487453 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:34.487410    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"]
Aug 04 19:11:34.514773 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:34.514714    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4b6c58-9sg29"]
Aug 04 19:11:36.161450 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:36.161417    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce99f5f4-7c63-4e87-b9c1-10ac849ed226" path="/var/lib/kubelet/pods/ce99f5f4-7c63-4e87-b9c1-10ac849ed226/volumes"
Aug 04 19:11:36.696385 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:36.696345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:11:42.970381 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:42.970345    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"]
Aug 04 19:11:42.970823 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:42.970609    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy" containerID="cri-o://9b5f847dff38294e2c5783536733f7b31feee8370cc9a29c2da97498f4b3f0b1" gracePeriod=30
Aug 04 19:11:43.376215 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376129    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"]
Aug 04 19:11:43.376542 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376528    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce99f5f4-7c63-4e87-b9c1-10ac849ed226" containerName="revoke-keys"
Aug 04 19:11:43.376585 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376543    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce99f5f4-7c63-4e87-b9c1-10ac849ed226" containerName="revoke-keys"
Aug 04 19:11:43.376585 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376567    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy"
Aug 04 19:11:43.376585 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376575    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy"
Aug 04 19:11:43.376679 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376651    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8011d465-a66e-4cfb-8406-4abf8bcd8c21" containerName="istio-proxy"
Aug 04 19:11:43.376679 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.376666    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce99f5f4-7c63-4e87-b9c1-10ac849ed226" containerName="revoke-keys"
Aug 04 19:11:43.380140 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.380120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:43.383073 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.383044    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 19:11:43.383073 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.383071    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:11:43.392480 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.392439    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"]
Aug 04 19:11:43.523367 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.523329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/553550b5-48a7-4974-aea1-f7c2368b17a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-219d48-gd45m\" (UID: \"553550b5-48a7-4974-aea1-f7c2368b17a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:43.624563 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.624527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/553550b5-48a7-4974-aea1-f7c2368b17a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-219d48-gd45m\" (UID: \"553550b5-48a7-4974-aea1-f7c2368b17a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:43.625236 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.625216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/553550b5-48a7-4974-aea1-f7c2368b17a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-219d48-gd45m\" (UID: \"553550b5-48a7-4974-aea1-f7c2368b17a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:43.690691 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.690662    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:43.836320 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:43.836300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"]
Aug 04 19:11:43.838591 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:11:43.838560    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553550b5_48a7_4974_aea1_f7c2368b17a7.slice/crio-5e84d339cf86a350bfae5e6f7dde079e4b9fbd22b21104d104c5c5ad080fdb21 WatchSource:0}: Error finding container 5e84d339cf86a350bfae5e6f7dde079e4b9fbd22b21104d104c5c5ad080fdb21: Status 404 returned error can't find the container with id 5e84d339cf86a350bfae5e6f7dde079e4b9fbd22b21104d104c5c5ad080fdb21
Aug 04 19:11:44.083551 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:44.083514    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m" event={"ID":"553550b5-48a7-4974-aea1-f7c2368b17a7","Type":"ContainerStarted","Data":"5e84d339cf86a350bfae5e6f7dde079e4b9fbd22b21104d104c5c5ad080fdb21"}
Aug 04 19:11:45.089653 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:45.089619    2579 generic.go:356] "Generic (PLEG): container finished" podID="553550b5-48a7-4974-aea1-f7c2368b17a7" containerID="b43025f302bbca66684ffcedc19fb8ef9fe555185f66ef27d1ee951b65b4f87d" exitCode=0
Aug 04 19:11:45.090058 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:45.089706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m" event={"ID":"553550b5-48a7-4974-aea1-f7c2368b17a7","Type":"ContainerDied","Data":"b43025f302bbca66684ffcedc19fb8ef9fe555185f66ef27d1ee951b65b4f87d"}
Aug 04 19:11:46.231031 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:46.230999    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:46.348142 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:46.348038    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/553550b5-48a7-4974-aea1-f7c2368b17a7-maas-api-service-ca\") pod \"553550b5-48a7-4974-aea1-f7c2368b17a7\" (UID: \"553550b5-48a7-4974-aea1-f7c2368b17a7\") "
Aug 04 19:11:46.348365 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:46.348344    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/553550b5-48a7-4974-aea1-f7c2368b17a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "553550b5-48a7-4974-aea1-f7c2368b17a7" (UID: "553550b5-48a7-4974-aea1-f7c2368b17a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:46.449630 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:46.449596    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/553550b5-48a7-4974-aea1-f7c2368b17a7-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:47.102311 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:47.102228    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"
Aug 04 19:11:47.102311 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:47.102265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m" event={"ID":"553550b5-48a7-4974-aea1-f7c2368b17a7","Type":"ContainerDied","Data":"5e84d339cf86a350bfae5e6f7dde079e4b9fbd22b21104d104c5c5ad080fdb21"}
Aug 04 19:11:47.102496 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:47.102342    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e84d339cf86a350bfae5e6f7dde079e4b9fbd22b21104d104c5c5ad080fdb21"
Aug 04 19:11:48.110555 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.110519    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerID="9b5f847dff38294e2c5783536733f7b31feee8370cc9a29c2da97498f4b3f0b1" exitCode=0
Aug 04 19:11:48.110988 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.110606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" event={"ID":"f2aae973-9cb4-4fdc-b732-116ed616cc25","Type":"ContainerDied","Data":"9b5f847dff38294e2c5783536733f7b31feee8370cc9a29c2da97498f4b3f0b1"}
Aug 04 19:11:48.110988 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.110686    2579 scope.go:117] "RemoveContainer" containerID="e25df4254b391082e0d99d32f1bd5ed11a2491d90c9dcd4e72b976671490f4a1"
Aug 04 19:11:48.222306 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.222281    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:11:48.366306 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-data\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366306 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366256    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-credential-socket\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366306 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-certs\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2aae973-9cb4-4fdc-b732-116ed616cc25-istiod-ca-cert\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366398    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-podinfo\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366446    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-socket\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366471    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvfrk\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-kube-api-access-xvfrk\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366547 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-envoy\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366551    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:48.366845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366564    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:48.366845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366616    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-token\") pod \"f2aae973-9cb4-4fdc-b732-116ed616cc25\" (UID: \"f2aae973-9cb4-4fdc-b732-116ed616cc25\") "
Aug 04 19:11:48.366845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366635    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:48.366845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366760    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2aae973-9cb4-4fdc-b732-116ed616cc25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:11:48.367118 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366975    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-data\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.367118 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.366989    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-credential-socket\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.367118 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.367063    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-certs\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.367118 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.367077    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2aae973-9cb4-4fdc-b732-116ed616cc25-istiod-ca-cert\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.367283 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.367110    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:48.368866 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.368833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 19:11:48.369004 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.368982    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-kube-api-access-xvfrk" (OuterVolumeSpecName: "kube-api-access-xvfrk") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "kube-api-access-xvfrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:48.369331 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.369317    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 19:11:48.369370 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.369332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2aae973-9cb4-4fdc-b732-116ed616cc25" (UID: "f2aae973-9cb4-4fdc-b732-116ed616cc25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 19:11:48.467927 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.467888    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-podinfo\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.467927 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.467920    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-workload-socket\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.467927 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.467932    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvfrk\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-kube-api-access-xvfrk\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.468161 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.467942    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-envoy\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:48.468161 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:48.467950    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aae973-9cb4-4fdc-b732-116ed616cc25-istio-token\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:11:49.117378 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:49.117347    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"
Aug 04 19:11:49.117893 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:49.117387    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb" event={"ID":"f2aae973-9cb4-4fdc-b732-116ed616cc25","Type":"ContainerDied","Data":"58a04e278fc350287ff7e01daa3fc100de5f5f626f7869a3a0d028f36c52aeb0"}
Aug 04 19:11:49.117893 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:49.117443    2579 scope.go:117] "RemoveContainer" containerID="9b5f847dff38294e2c5783536733f7b31feee8370cc9a29c2da97498f4b3f0b1"
Aug 04 19:11:49.144731 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:49.144671    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"]
Aug 04 19:11:49.151514 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:49.151479    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-4b6c58-openshift-default-cdb7b46d8-bpjbb"]
Aug 04 19:11:50.161939 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:50.161903    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" path="/var/lib/kubelet/pods/f2aae973-9cb4-4fdc-b732-116ed616cc25/volumes"
Aug 04 19:11:50.439647 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:50.439609    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"]
Aug 04 19:11:50.444845 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:50.444811    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-219d48-29764500-8vfc4"]
Aug 04 19:11:50.795618 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:50.795523    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"]
Aug 04 19:11:50.799994 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:50.799961    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-219d48-gd45m"]
Aug 04 19:11:52.161850 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:52.161814    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="553550b5-48a7-4974-aea1-f7c2368b17a7" path="/var/lib/kubelet/pods/553550b5-48a7-4974-aea1-f7c2368b17a7/volumes"
Aug 04 19:11:52.162246 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:52.162110    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae57be1-dc4e-410d-ab5c-cea5684ba332" path="/var/lib/kubelet/pods/eae57be1-dc4e-410d-ab5c-cea5684ba332/volumes"
Aug 04 19:11:52.870767 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:52.870716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:11:59.446874 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.446835    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"]
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447215    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553550b5-48a7-4974-aea1-f7c2368b17a7" containerName="revoke-keys"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447226    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="553550b5-48a7-4974-aea1-f7c2368b17a7" containerName="revoke-keys"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447237    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447243    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447250    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447256    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447320    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy"
Aug 04 19:11:59.447325 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447329    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="553550b5-48a7-4974-aea1-f7c2368b17a7" containerName="revoke-keys"
Aug 04 19:11:59.447621 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.447336    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2aae973-9cb4-4fdc-b732-116ed616cc25" containerName="istio-proxy"
Aug 04 19:11:59.450297 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.450281    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:11:59.453335 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.453314    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nlm72\""
Aug 04 19:11:59.453492 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.453315    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 19:11:59.460344 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.460314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"]
Aug 04 19:11:59.460797 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.460772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51a2ec9-6521-4238-a39f-49561e75e0d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6\" (UID: \"d51a2ec9-6521-4238-a39f-49561e75e0d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:11:59.561447 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.561402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51a2ec9-6521-4238-a39f-49561e75e0d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6\" (UID: \"d51a2ec9-6521-4238-a39f-49561e75e0d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:11:59.562062 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.562041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51a2ec9-6521-4238-a39f-49561e75e0d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6\" (UID: \"d51a2ec9-6521-4238-a39f-49561e75e0d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:11:59.761586 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.761503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:11:59.906972 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:11:59.906937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"]
Aug 04 19:11:59.910512 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:11:59.910477    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51a2ec9_6521_4238_a39f_49561e75e0d2.slice/crio-9657ae478b62304fabd006a652d75ad19b7a786a7bca65c1150701fcd28e861f WatchSource:0}: Error finding container 9657ae478b62304fabd006a652d75ad19b7a786a7bca65c1150701fcd28e861f: Status 404 returned error can't find the container with id 9657ae478b62304fabd006a652d75ad19b7a786a7bca65c1150701fcd28e861f
Aug 04 19:12:00.177305 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:00.177275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6" event={"ID":"d51a2ec9-6521-4238-a39f-49561e75e0d2","Type":"ContainerStarted","Data":"9657ae478b62304fabd006a652d75ad19b7a786a7bca65c1150701fcd28e861f"}
Aug 04 19:12:01.183340 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:01.183302    2579 generic.go:356] "Generic (PLEG): container finished" podID="d51a2ec9-6521-4238-a39f-49561e75e0d2" containerID="ef5e831bc9ae57404f9f324ef18082e4edf1cf7442cd2a69f8db4258d72f7f33" exitCode=0
Aug 04 19:12:01.183787 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:01.183396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6" event={"ID":"d51a2ec9-6521-4238-a39f-49561e75e0d2","Type":"ContainerDied","Data":"ef5e831bc9ae57404f9f324ef18082e4edf1cf7442cd2a69f8db4258d72f7f33"}
Aug 04 19:12:02.334553 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:02.334517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:12:02.387037 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:02.387005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51a2ec9-6521-4238-a39f-49561e75e0d2-maas-api-service-ca\") pod \"d51a2ec9-6521-4238-a39f-49561e75e0d2\" (UID: \"d51a2ec9-6521-4238-a39f-49561e75e0d2\") "
Aug 04 19:12:02.387406 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:02.387371    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51a2ec9-6521-4238-a39f-49561e75e0d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d51a2ec9-6521-4238-a39f-49561e75e0d2" (UID: "d51a2ec9-6521-4238-a39f-49561e75e0d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 19:12:02.488637 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:02.488546    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d51a2ec9-6521-4238-a39f-49561e75e0d2-maas-api-service-ca\") on node \"ip-10-0-137-226.ec2.internal\" DevicePath \"\""
Aug 04 19:12:03.195973 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:03.195931    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6" event={"ID":"d51a2ec9-6521-4238-a39f-49561e75e0d2","Type":"ContainerDied","Data":"9657ae478b62304fabd006a652d75ad19b7a786a7bca65c1150701fcd28e861f"}
Aug 04 19:12:03.196131 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:03.195986    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9657ae478b62304fabd006a652d75ad19b7a786a7bca65c1150701fcd28e861f"
Aug 04 19:12:03.196131 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:03.195951    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"
Aug 04 19:12:04.913297 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:04.913233    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"]
Aug 04 19:12:04.915000 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:04.914977    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-de2394-29764500-gltgj"]
Aug 04 19:12:05.252160 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:05.252127    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"]
Aug 04 19:12:05.256472 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:05.256441    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-de2394-gfqd6"]
Aug 04 19:12:06.162183 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:06.162145    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7645c9-a20c-4cba-9de0-d96848d79460" path="/var/lib/kubelet/pods/cc7645c9-a20c-4cba-9de0-d96848d79460/volumes"
Aug 04 19:12:06.162814 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:06.162571    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51a2ec9-6521-4238-a39f-49561e75e0d2" path="/var/lib/kubelet/pods/d51a2ec9-6521-4238-a39f-49561e75e0d2/volumes"
Aug 04 19:12:07.276450 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:07.276398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-f226r"]
Aug 04 19:12:13.141098 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:13.141062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9b57679d-7l554_132cae74-9081-4c11-83c5-51c0679cd2c7/authorino/0.log"
Aug 04 19:12:20.181769 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:20.181709    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bbc69bc6-m9h89_da170a38-895d-4755-8a0c-81f14b242f57/copy-manifests/0.log"
Aug 04 19:12:20.193973 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:20.193938    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bbc69bc6-m9h89_da170a38-895d-4755-8a0c-81f14b242f57/manager/0.log"
Aug 04 19:12:20.882777 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:20.882750    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764470-5x8p5_86738e81-0d8e-4612-9c83-b58bd3920fc1/cleanup/0.log"
Aug 04 19:12:21.021418 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:21.021388    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764485-rfbdr_b1937e65-cf4a-47e4-a049-86c7519a9806/cleanup/0.log"
Aug 04 19:12:21.157466 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:21.157390    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764500-plp9x_12792e28-ee2f-4317-a8a4-72e57b8f43be/cleanup/0.log"
Aug 04 19:12:22.124930 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:22.124896    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9b57679d-7l554_132cae74-9081-4c11-83c5-51c0679cd2c7/authorino/0.log"
Aug 04 19:12:22.525108 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:22.525081    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-47lhb_a251113c-27aa-4f42-98c7-819545699f24/kuadrant-console-plugin/0.log"
Aug 04 19:12:22.792765 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:22.792643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-f226r_f4d38c27-178f-407f-8fb2-37f852808da2/limitador/0.log"
Aug 04 19:12:23.671172 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:23.671144    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489764dcd-mjxdk_4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60/kube-auth-proxy/0.log"
Aug 04 19:12:25.055851 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:25.055815    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fdqbm_90f03d38-b425-431d-b442-7462c3189b13/main/0.log"
Aug 04 19:12:31.136483 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.136447    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwzfh/must-gather-vxfqt"]
Aug 04 19:12:31.137025 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.136839    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51a2ec9-6521-4238-a39f-49561e75e0d2" containerName="revoke-keys"
Aug 04 19:12:31.137025 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.136850    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51a2ec9-6521-4238-a39f-49561e75e0d2" containerName="revoke-keys"
Aug 04 19:12:31.137025 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.136915    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51a2ec9-6521-4238-a39f-49561e75e0d2" containerName="revoke-keys"
Aug 04 19:12:31.140006 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.139987    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.143494 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.143468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kwzfh\"/\"default-dockercfg-gz4dk\""
Aug 04 19:12:31.143494 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.143488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwzfh\"/\"kube-root-ca.crt\""
Aug 04 19:12:31.143705 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.143692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwzfh\"/\"openshift-service-ca.crt\""
Aug 04 19:12:31.171279 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.171248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwzfh/must-gather-vxfqt"]
Aug 04 19:12:31.261596 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.261564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eff75784-5f72-47d4-8544-e5264a840538-must-gather-output\") pod \"must-gather-vxfqt\" (UID: \"eff75784-5f72-47d4-8544-e5264a840538\") " pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.261814 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.261605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2bl\" (UniqueName: \"kubernetes.io/projected/eff75784-5f72-47d4-8544-e5264a840538-kube-api-access-2n2bl\") pod \"must-gather-vxfqt\" (UID: \"eff75784-5f72-47d4-8544-e5264a840538\") " pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.362454 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.362412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eff75784-5f72-47d4-8544-e5264a840538-must-gather-output\") pod \"must-gather-vxfqt\" (UID: \"eff75784-5f72-47d4-8544-e5264a840538\") " pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.362454 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.362450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2bl\" (UniqueName: \"kubernetes.io/projected/eff75784-5f72-47d4-8544-e5264a840538-kube-api-access-2n2bl\") pod \"must-gather-vxfqt\" (UID: \"eff75784-5f72-47d4-8544-e5264a840538\") " pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.362872 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.362850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/eff75784-5f72-47d4-8544-e5264a840538-must-gather-output\") pod \"must-gather-vxfqt\" (UID: \"eff75784-5f72-47d4-8544-e5264a840538\") " pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.378457 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.378432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2bl\" (UniqueName: \"kubernetes.io/projected/eff75784-5f72-47d4-8544-e5264a840538-kube-api-access-2n2bl\") pod \"must-gather-vxfqt\" (UID: \"eff75784-5f72-47d4-8544-e5264a840538\") " pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.449687 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.449653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwzfh/must-gather-vxfqt"
Aug 04 19:12:31.599218 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.599189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwzfh/must-gather-vxfqt"]
Aug 04 19:12:31.601687 ip-10-0-137-226 kubenswrapper[2579]: W0804 19:12:31.601663    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeff75784_5f72_47d4_8544_e5264a840538.slice/crio-6bfdab8df50b131a6c8b99b34b332f20b77b5261679d3d675aaecc1c0e360a22 WatchSource:0}: Error finding container 6bfdab8df50b131a6c8b99b34b332f20b77b5261679d3d675aaecc1c0e360a22: Status 404 returned error can't find the container with id 6bfdab8df50b131a6c8b99b34b332f20b77b5261679d3d675aaecc1c0e360a22
Aug 04 19:12:31.603572 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:31.603548    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 19:12:32.346377 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:32.346326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwzfh/must-gather-vxfqt" event={"ID":"eff75784-5f72-47d4-8544-e5264a840538","Type":"ContainerStarted","Data":"6bfdab8df50b131a6c8b99b34b332f20b77b5261679d3d675aaecc1c0e360a22"}
Aug 04 19:12:33.357763 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:33.357706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwzfh/must-gather-vxfqt" event={"ID":"eff75784-5f72-47d4-8544-e5264a840538","Type":"ContainerStarted","Data":"9ed7ef1d515f5e12c3cde25ae6a9294f55f06987653cf75c35c592c35b05f97e"}
Aug 04 19:12:33.358156 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:33.357777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwzfh/must-gather-vxfqt" event={"ID":"eff75784-5f72-47d4-8544-e5264a840538","Type":"ContainerStarted","Data":"0b9243dd47a9bad13910d34ae50759bc8457564fab6ffe728fb7527381cd61bc"}
Aug 04 19:12:33.390012 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:33.389907    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwzfh/must-gather-vxfqt" podStartSLOduration=0.866761555 podStartE2EDuration="2.389889712s" totalImagesPullingTime="1.523128157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 19:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:12:33.388403018 +0000 UTC m=+3707.713506169" watchObservedRunningTime="2026-08-04 19:12:33.389889712 +0000 UTC m=+3707.714992830"
Aug 04 19:12:34.984172 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:34.984128    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mwfzl_b20b5f74-9033-4fd4-a1ba-e72aece50d92/global-pull-secret-syncer/0.log"
Aug 04 19:12:35.133034 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:35.133004    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8zkpv_7e1daf79-fc08-41eb-bb03-cccbc2294956/konnectivity-agent/0.log"
Aug 04 19:12:35.241406 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:35.241330    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-226.ec2.internal_dd8bc490af8a6a5247a729399b554aa6/haproxy/0.log"
Aug 04 19:12:40.357297 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:40.355179    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9b57679d-7l554_132cae74-9081-4c11-83c5-51c0679cd2c7/authorino/0.log"
Aug 04 19:12:40.441100 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:40.441065    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-47lhb_a251113c-27aa-4f42-98c7-819545699f24/kuadrant-console-plugin/0.log"
Aug 04 19:12:40.632326 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:40.632236    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-f226r_f4d38c27-178f-407f-8fb2-37f852808da2/limitador/0.log"
Aug 04 19:12:42.173099 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.173058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/alertmanager/0.log"
Aug 04 19:12:42.205796 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.205684    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/config-reloader/0.log"
Aug 04 19:12:42.236622 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.236577    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/kube-rbac-proxy-web/0.log"
Aug 04 19:12:42.277776 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.277740    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/kube-rbac-proxy/0.log"
Aug 04 19:12:42.326991 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.326937    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/kube-rbac-proxy-metric/0.log"
Aug 04 19:12:42.370374 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.370340    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/prom-label-proxy/0.log"
Aug 04 19:12:42.438192 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.438158    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62bbe98f-3acb-478c-8e58-58bdebc1f7e8/init-config-reloader/0.log"
Aug 04 19:12:42.774272 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:42.774179    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-t7xvf_f7153f7d-dab3-4724-8cef-6fbacfcad93c/monitoring-plugin/0.log"
Aug 04 19:12:43.074662 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.074580    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9s4p_24d1ee97-9b3f-4188-a4dc-d770b524956e/node-exporter/0.log"
Aug 04 19:12:43.116734 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.116683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9s4p_24d1ee97-9b3f-4188-a4dc-d770b524956e/kube-rbac-proxy/0.log"
Aug 04 19:12:43.155566 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.155538    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9s4p_24d1ee97-9b3f-4188-a4dc-d770b524956e/init-textfile/0.log"
Aug 04 19:12:43.319828 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.319797    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/prometheus/0.log"
Aug 04 19:12:43.357905 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.357752    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/config-reloader/0.log"
Aug 04 19:12:43.393066 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.393033    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/thanos-sidecar/0.log"
Aug 04 19:12:43.425089 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.425055    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/kube-rbac-proxy-web/0.log"
Aug 04 19:12:43.467602 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.467578    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/kube-rbac-proxy/0.log"
Aug 04 19:12:43.506190 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.506156    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/kube-rbac-proxy-thanos/0.log"
Aug 04 19:12:43.542350 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.542324    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d3faaad7-5def-4bf1-9800-89748589ee9d/init-config-reloader/0.log"
Aug 04 19:12:43.591462 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.591431    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5jbfl_a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a/prometheus-operator/0.log"
Aug 04 19:12:43.623194 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.623102    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5jbfl_a0cb3d83-cffa-46c6-b208-8e6fdb55cf6a/kube-rbac-proxy/0.log"
Aug 04 19:12:43.678637 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.678609    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-gwd28_0cf52470-6702-4d3e-9aee-1f246bd783c1/prometheus-operator-admission-webhook/0.log"
Aug 04 19:12:43.844436 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.844410    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5668775658-99ppw_5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f/thanos-query/0.log"
Aug 04 19:12:43.887091 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.887008    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5668775658-99ppw_5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f/kube-rbac-proxy-web/0.log"
Aug 04 19:12:43.920650 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.920612    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5668775658-99ppw_5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f/kube-rbac-proxy/0.log"
Aug 04 19:12:43.961858 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.961827    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5668775658-99ppw_5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f/prom-label-proxy/0.log"
Aug 04 19:12:43.993763 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:43.993738    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5668775658-99ppw_5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f/kube-rbac-proxy-rules/0.log"
Aug 04 19:12:44.022899 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:44.022870    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5668775658-99ppw_5f42c5a0-e3ce-47eb-a1c1-a28ecb413e4f/kube-rbac-proxy-metrics/0.log"
Aug 04 19:12:45.239537 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.239499    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"]
Aug 04 19:12:45.246152 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.246123    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.253703 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.253672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"]
Aug 04 19:12:45.303026 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.302998    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-d6s4m_ca0e9ea7-abae-4a7c-aa74-51a17562b27a/networking-console-plugin/0.log"
Aug 04 19:12:45.314941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.314904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-proc\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.314941 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.314945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76k8\" (UniqueName: \"kubernetes.io/projected/f6ad3274-6696-4f10-80f3-4ef6167f6153-kube-api-access-t76k8\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.315261 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.315084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-lib-modules\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.315261 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.315124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-sys\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.315261 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.315198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-podres\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416267 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-lib-modules\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416478 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-sys\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416478 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-podres\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416478 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-proc\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416478 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76k8\" (UniqueName: \"kubernetes.io/projected/f6ad3274-6696-4f10-80f3-4ef6167f6153-kube-api-access-t76k8\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416478 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-lib-modules\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416478 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416457    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-sys\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416706 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-proc\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.416706 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.416511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6ad3274-6696-4f10-80f3-4ef6167f6153-podres\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.428136 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.428101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76k8\" (UniqueName: \"kubernetes.io/projected/f6ad3274-6696-4f10-80f3-4ef6167f6153-kube-api-access-t76k8\") pod \"perf-node-gather-daemonset-j7nw8\" (UID: \"f6ad3274-6696-4f10-80f3-4ef6167f6153\") " pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.562259 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.562171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:45.763530 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:45.762766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"]
Aug 04 19:12:46.477474 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.477436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8" event={"ID":"f6ad3274-6696-4f10-80f3-4ef6167f6153","Type":"ContainerStarted","Data":"3467b54763d81e18783cd6f8da80bb64337470b5ee164210688b13c513f35e39"}
Aug 04 19:12:46.478080 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.478055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8" event={"ID":"f6ad3274-6696-4f10-80f3-4ef6167f6153","Type":"ContainerStarted","Data":"dd4fa952156769de53e3790b757ce2ebaa99eb18a4d2d4f159ed89268320b21f"}
Aug 04 19:12:46.479934 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.479911    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:46.503765 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.503677    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8" podStartSLOduration=1.503655148 podStartE2EDuration="1.503655148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 19:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 19:12:46.501367888 +0000 UTC m=+3720.826471042" watchObservedRunningTime="2026-08-04 19:12:46.503655148 +0000 UTC m=+3720.828758269"
Aug 04 19:12:46.738779 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.738672    2579 scope.go:117] "RemoveContainer" containerID="5abcc7335997cff7019e6a9ca6df0a342a5f6906bfaef7c3c622b029df19310b"
Aug 04 19:12:46.748437 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.748407    2579 scope.go:117] "RemoveContainer" containerID="e8e9d0f1fbca5bb87d628ec9260dd01e1b412d5ca08584f8486d1b5645ba07fc"
Aug 04 19:12:46.804032 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:46.803998    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-zct58_991511a5-ab50-4fc1-88ba-8eab5391ee95/download-server/0.log"
Aug 04 19:12:48.785413 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:48.785377    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l7wqs_c25caaa8-9d11-4e7b-8904-2596aef01fc1/dns/0.log"
Aug 04 19:12:48.813006 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:48.812975    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l7wqs_c25caaa8-9d11-4e7b-8904-2596aef01fc1/kube-rbac-proxy/0.log"
Aug 04 19:12:48.842044 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:48.842009    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jv9x4_55f67dd0-e011-484d-8788-922e108e96cd/dns-node-resolver/0.log"
Aug 04 19:12:49.487399 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:49.487340    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6977db9676-r82zm_110f73a1-6e71-4165-ae41-d297b4ce384e/registry/0.log"
Aug 04 19:12:49.516543 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:49.516509    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fm6ff_ce74f133-1e9c-42c7-a860-45c19a0186db/node-ca/0.log"
Aug 04 19:12:51.046876 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:51.046840    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489764dcd-mjxdk_4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60/kube-auth-proxy/0.log"
Aug 04 19:12:52.070571 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:52.070539    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tmbs9_2c5587ab-c910-4bc0-94f0-3700cfe5b79e/serve-healthcheck-canary/0.log"
Aug 04 19:12:52.678017 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:52.677979    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctwpn_be07886b-58ca-43dc-a15f-61f25526d904/kube-rbac-proxy/0.log"
Aug 04 19:12:52.703511 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:52.703485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctwpn_be07886b-58ca-43dc-a15f-61f25526d904/exporter/0.log"
Aug 04 19:12:52.731082 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:52.731054    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctwpn_be07886b-58ca-43dc-a15f-61f25526d904/extractor/0.log"
Aug 04 19:12:53.503788 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:53.503758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kwzfh/perf-node-gather-daemonset-j7nw8"
Aug 04 19:12:55.903930 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:55.903889    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bbc69bc6-m9h89_da170a38-895d-4755-8a0c-81f14b242f57/manager/0.log"
Aug 04 19:12:55.989329 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:55.989243    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76bbc69bc6-m9h89_da170a38-895d-4755-8a0c-81f14b242f57/copy-manifests/0.log"
Aug 04 19:12:56.451215 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:56.451166    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489764dcd-mjxdk_4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60/kube-auth-proxy/0.log"
Aug 04 19:12:57.505474 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:57.505447    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84559d8974-k79c5_be68e9eb-7477-4776-a9e0-ecc42e30b520/manager/0.log"
Aug 04 19:12:58.391195 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:12:58.391164    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8489764dcd-mjxdk_4f7c521f-5e4d-4e95-a81b-1e5c6fd9ad60/kube-auth-proxy/0.log"
Aug 04 19:13:02.722529 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:13:02.722497    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-nrpgd_464814d7-c93c-49dd-bc5b-06e408139705/migrator/0.log"
Aug 04 19:13:02.747435 ip-10-0-137-226 kubenswrapper[2579]: I0804 19:13:02.747400    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-nrpgd_464814d7-c93c-49dd-bc5b-06e408139705/graceful-termination/0.log"