Jul 30 17:24:50.644660 ip-10-0-137-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 17:24:50.644672 ip-10-0-137-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 17:24:50.644681 ip-10-0-137-250 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 17:24:50.644991 ip-10-0-137-250 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 17:25:02.103108 ip-10-0-137-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 17:25:02.103123 ip-10-0-137-250 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 05e51a061a4d4a96be5201796a781cc5 --
Jul 30 17:26:58.160178 ip-10-0-137-250 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 17:26:58.548491 ip-10-0-137-250 kubenswrapper[2538]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:26:58.548491 ip-10-0-137-250 kubenswrapper[2538]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 17:26:58.548491 ip-10-0-137-250 kubenswrapper[2538]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:26:58.548491 ip-10-0-137-250 kubenswrapper[2538]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 17:26:58.548491 ip-10-0-137-250 kubenswrapper[2538]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 17:26:58.549293 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.548560    2538 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 17:26:58.553778 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553757    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:26:58.553778 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553775    2538 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:26:58.553778 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553779    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:26:58.553778 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553784    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553790    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553793    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553803    2538 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553807    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553811    2538 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553816    2538 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553819    2538 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553823    2538 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553827    2538 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553830    2538 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553834    2538 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553838    2538 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553842    2538 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553845    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553849    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553853    2538 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553857    2538 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553860    2538 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553864    2538 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:26:58.554052 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553868    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553889    2538 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553893    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553897    2538 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553903    2538 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553907    2538 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553911    2538 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553915    2538 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553919    2538 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553923    2538 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553927    2538 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553931    2538 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553935    2538 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553940    2538 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553945    2538 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553949    2538 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553954    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553959    2538 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553963    2538 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:26:58.554891 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553970    2538 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553977    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553983    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553988    2538 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553992    2538 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.553997    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554002    2538 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554006    2538 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554010    2538 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554015    2538 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554020    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554024    2538 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554028    2538 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554032    2538 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554036    2538 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554040    2538 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554044    2538 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554049    2538 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554053    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554057    2538 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:26:58.555684 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554061    2538 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554065    2538 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554069    2538 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554074    2538 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554080    2538 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554086    2538 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554093    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554097    2538 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554102    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554108    2538 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554113    2538 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554117    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554122    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554126    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554131    2538 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554135    2538 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554139    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554143    2538 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554147    2538 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:26:58.556526 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554151    2538 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554156    2538 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554160    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554164    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554169    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554173    2538 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554177    2538 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554182    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554186    2538 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554190    2538 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554194    2538 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554199    2538 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554203    2538 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554214    2538 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554218    2538 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554223    2538 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554227    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.554231    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555397    2538 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555406    2538 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:26:58.557352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555411    2538 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555415    2538 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555420    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555425    2538 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555430    2538 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555434    2538 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555438    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555443    2538 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555447    2538 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555452    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555456    2538 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555460    2538 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555464    2538 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555468    2538 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555472    2538 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555476    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555480    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555484    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555490    2538 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555494    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:26:58.558269 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555498    2538 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555503    2538 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555508    2538 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555513    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555518    2538 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555522    2538 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555529    2538 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555535    2538 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555539    2538 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555544    2538 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555549    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555553    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555557    2538 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555562    2538 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555566    2538 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555571    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555575    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555580    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555584    2538 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:26:58.558865 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555588    2538 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555593    2538 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555597    2538 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555603    2538 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555607    2538 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555612    2538 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555615    2538 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555620    2538 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555624    2538 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555628    2538 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555632    2538 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555636    2538 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555639    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555643    2538 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555647    2538 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555652    2538 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555656    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555660    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555664    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555668    2538 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:26:58.559431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555672    2538 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555676    2538 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555680    2538 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555684    2538 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555688    2538 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555692    2538 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555696    2538 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555700    2538 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555703    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555707    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555711    2538 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555716    2538 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555721    2538 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555725    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555730    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555734    2538 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555738    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555742    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555746    2538 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555751    2538 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:26:58.560047 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555755    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555759    2538 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555763    2538 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555767    2538 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555771    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555776    2538 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555780    2538 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555787    2538 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555793    2538 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555802    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555807    2538 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555812    2538 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555817    2538 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555821    2538 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555826    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555830    2538 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555835    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.555839    2538 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556451    2538 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:26:58.560705 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556460    2538 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556465    2538 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556470    2538 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556475    2538 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556480    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556485    2538 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556489    2538 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556494    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556499    2538 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556503    2538 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556508    2538 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556512    2538 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556517    2538 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556522    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556527    2538 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556531    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556535    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556539    2538 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556544    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:26:58.561193 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556548    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556552    2538 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556557    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556564    2538 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556568    2538 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556573    2538 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556576    2538 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556581    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556585    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556589    2538 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556593    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556597    2538 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556601    2538 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556605    2538 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556609    2538 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556613    2538 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556619    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556623    2538 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556628    2538 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556632    2538 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:26:58.561753 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556636    2538 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556640    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556643    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556647    2538 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556651    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556656    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556661    2538 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556665    2538 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556669    2538 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556673    2538 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556677    2538 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556681    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556685    2538 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556689    2538 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556693    2538 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556699    2538 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556703    2538 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556708    2538 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556712    2538 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:26:58.562267 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556716    2538 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556720    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556724    2538 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556731    2538 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556738    2538 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556743    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556747    2538 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556752    2538 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556756    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556760    2538 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556764    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556768    2538 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556773    2538 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556777    2538 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556781    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556785    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556789    2538 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556793    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556797    2538 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556802    2538 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:26:58.562811 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556806    2538 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556810    2538 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556814    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556819    2538 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556823    2538 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556827    2538 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556831    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556835    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556840    2538 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556844    2538 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556848    2538 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556852    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556858    2538 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556864    2538 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556868    2538 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556891    2538 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556895    2538 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556900    2538 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556904    2538 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.556909    2538 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:26:58.563325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557009    2538 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557020    2538 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557031    2538 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557038    2538 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557044    2538 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557050    2538 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557056    2538 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557063    2538 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557068    2538 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557073    2538 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557079    2538 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557084    2538 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557089    2538 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557094    2538 flags.go:64] FLAG: --cgroup-root=""
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557099    2538 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557103    2538 flags.go:64] FLAG: --client-ca-file=""
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557108    2538 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557113    2538 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557118    2538 flags.go:64] FLAG: --cluster-domain=""
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557123    2538 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557130    2538 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557135    2538 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557141    2538 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557147    2538 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 17:26:58.563829 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557152    2538 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557157    2538 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557163    2538 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557168    2538 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557173    2538 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557177    2538 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557182    2538 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557187    2538 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557194    2538 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557199    2538 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557204    2538 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557209    2538 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557214    2538 flags.go:64] FLAG: --enable-server="true"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557219    2538 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557226    2538 flags.go:64] FLAG: --event-burst="100"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557232    2538 flags.go:64] FLAG: --event-qps="50"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557237    2538 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557242    2538 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557247    2538 flags.go:64] FLAG: --eviction-hard=""
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557253    2538 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557258    2538 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557263    2538 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557268    2538 flags.go:64] FLAG: --eviction-soft=""
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557272    2538 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557278    2538 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 17:26:58.564428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557283    2538 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557287    2538 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557292    2538 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557298    2538 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557303    2538 flags.go:64] FLAG: --feature-gates=""
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557309    2538 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557314    2538 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557319    2538 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557324    2538 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557329    2538 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557334    2538 flags.go:64] FLAG: --help="false"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557340    2538 flags.go:64] FLAG: --hostname-override="ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557345    2538 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557350    2538 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557355    2538 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557361    2538 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557366    2538 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557371    2538 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557376    2538 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557380    2538 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557385    2538 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557390    2538 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557396    2538 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557401    2538 flags.go:64] FLAG: --kube-reserved=""
Jul 30 17:26:58.565138 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557406    2538 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557410    2538 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557416    2538 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557421    2538 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557425    2538 flags.go:64] FLAG: --lock-file=""
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557430    2538 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557435    2538 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557445    2538 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557454    2538 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557459    2538 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557463    2538 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557468    2538 flags.go:64] FLAG: --logging-format="text"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557473    2538 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557479    2538 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557484    2538 flags.go:64] FLAG: --manifest-url=""
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557488    2538 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557495    2538 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557500    2538 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557507    2538 flags.go:64] FLAG: --max-pods="110"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557511    2538 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557516    2538 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557521    2538 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557526    2538 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557530    2538 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557535    2538 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 17:26:58.566114 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557539    2538 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557550    2538 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557555    2538 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557560    2538 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557565    2538 flags.go:64] FLAG: --pod-cidr=""
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557569    2538 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557579    2538 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557584    2538 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557589    2538 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557594    2538 flags.go:64] FLAG: --port="10250"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557598    2538 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557603    2538 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0704ae8694e204fa2"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557608    2538 flags.go:64] FLAG: --qos-reserved=""
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557612    2538 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557619    2538 flags.go:64] FLAG: --register-node="true"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557624    2538 flags.go:64] FLAG: --register-with-taints=""
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557630    2538 flags.go:64] FLAG: --registry-burst="10"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557635    2538 flags.go:64] FLAG: --registry-qps="5"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557639    2538 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557645    2538 flags.go:64] FLAG: --reserved-memory=""
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557657    2538 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557662    2538 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557668    2538 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557673    2538 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557677    2538 flags.go:64] FLAG: --runonce="false"
Jul 30 17:26:58.566753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557682    2538 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557687    2538 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557692    2538 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557696    2538 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557702    2538 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557707    2538 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557712    2538 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557717    2538 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557722    2538 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557727    2538 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557731    2538 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557736    2538 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557741    2538 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557746    2538 flags.go:64] FLAG: --system-cgroups=""
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557751    2538 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557760    2538 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557764    2538 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557769    2538 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557775    2538 flags.go:64] FLAG: --tls-min-version=""
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557779    2538 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557784    2538 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557790    2538 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557795    2538 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557800    2538 flags.go:64] FLAG: --v="2"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557806    2538 flags.go:64] FLAG: --version="false"
Jul 30 17:26:58.567390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557812    2538 flags.go:64] FLAG: --vmodule=""
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557818    2538 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.557823    2538 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558032    2538 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558041    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558046    2538 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558051    2538 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558055    2538 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558061    2538 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558065    2538 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558070    2538 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558075    2538 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558080    2538 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558084    2538 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558088    2538 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558093    2538 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558097    2538 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558102    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558107    2538 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558111    2538 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:26:58.568054 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558116    2538 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558121    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558126    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558131    2538 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558135    2538 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558139    2538 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558143    2538 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558147    2538 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558154    2538 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558158    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558162    2538 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558166    2538 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558170    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558174    2538 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558178    2538 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558182    2538 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558186    2538 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558191    2538 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558195    2538 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558200    2538 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:26:58.568531 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558204    2538 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558216    2538 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558220    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558224    2538 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558228    2538 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558232    2538 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558236    2538 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558241    2538 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558245    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558249    2538 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558253    2538 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558257    2538 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558261    2538 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558265    2538 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558269    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558274    2538 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558280    2538 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558285    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558290    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:26:58.569044 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558294    2538 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558302    2538 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558308    2538 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558313    2538 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558317    2538 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558323    2538 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558327    2538 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558332    2538 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558336    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558340    2538 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558345    2538 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558349    2538 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558354    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558358    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558362    2538 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558366    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558371    2538 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558376    2538 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558380    2538 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558384    2538 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:26:58.569507 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558389    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558393    2538 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558398    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558402    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558406    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558411    2538 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558415    2538 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558419    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558424    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558429    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558433    2538 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558438    2538 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558442    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558448    2538 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558452    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558456    2538 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558460    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558466    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558471    2538 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:26:58.570017 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558475    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558482    2538 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558487    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.558492    2538 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.559185    2538 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.567504    2538 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.567519    2538 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.567538    2538 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.567544    2538 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567599    2538 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567604    2538 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567608    2538 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567612    2538 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567615    2538 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:26:58.570504 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567617    2538 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567620    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567623    2538 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567626    2538 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567628    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567631    2538 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567634    2538 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567637    2538 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567639    2538 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567642    2538 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567645    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567647    2538 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567650    2538 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567652    2538 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567656    2538 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567660    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567663    2538 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567666    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567669    2538 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567671    2538 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:26:58.570939 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567674    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567677    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567680    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567682    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567686    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567688    2538 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567691    2538 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567693    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567696    2538 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567698    2538 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567701    2538 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567703    2538 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567706    2538 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567708    2538 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567711    2538 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567713    2538 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567716    2538 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567718    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567721    2538 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567723    2538 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:26:58.571431 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567726    2538 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567729    2538 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567731    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567734    2538 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567737    2538 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567739    2538 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567742    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567744    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567747    2538 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567749    2538 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567752    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567754    2538 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567757    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567759    2538 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567762    2538 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567764    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567768    2538 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567771    2538 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567774    2538 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567776    2538 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:26:58.571997 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567779    2538 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567781    2538 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567784    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567786    2538 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567789    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567791    2538 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567794    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567796    2538 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567799    2538 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567801    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567804    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567807    2538 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567809    2538 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567813    2538 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567817    2538 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567820    2538 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567823    2538 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567826    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567828    2538 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:26:58.572490 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567831    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567834    2538 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567836    2538 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567839    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567841    2538 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567844    2538 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567847    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567849    2538 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567852    2538 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567855    2538 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567859    2538 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567862    2538 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567865    2538 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567868    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567883    2538 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:26:58.572969 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.567890    2538 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.567996    2538 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568001    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568005    2538 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568008    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568010    2538 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568013    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568016    2538 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568019    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568021    2538 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568024    2538 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568027    2538 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568029    2538 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568033    2538 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568037    2538 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568041    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568044    2538 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568047    2538 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568050    2538 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 17:26:58.573373 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568053    2538 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568055    2538 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568058    2538 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568061    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568064    2538 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568066    2538 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568069    2538 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568072    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568074    2538 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568077    2538 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568080    2538 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568083    2538 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568087    2538 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568089    2538 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568092    2538 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568094    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568097    2538 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568099    2538 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568102    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568104    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 17:26:58.573838 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568107    2538 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568109    2538 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568112    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568114    2538 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568117    2538 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568121    2538 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568124    2538 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568128    2538 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568130    2538 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568133    2538 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568135    2538 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568138    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568140    2538 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568143    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568145    2538 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568148    2538 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568150    2538 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568153    2538 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568155    2538 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 17:26:58.574352 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568158    2538 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568161    2538 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568163    2538 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568166    2538 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568168    2538 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568171    2538 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568173    2538 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568176    2538 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568178    2538 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568180    2538 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568183    2538 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568185    2538 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568188    2538 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568190    2538 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568193    2538 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568195    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568197    2538 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568200    2538 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568203    2538 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568205    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 17:26:58.574822 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568208    2538 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568210    2538 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568213    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568216    2538 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568218    2538 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568221    2538 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568223    2538 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568226    2538 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568228    2538 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568231    2538 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568233    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568236    2538 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568238    2538 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568245    2538 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568247    2538 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568250    2538 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568252    2538 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568255    2538 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568257    2538 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568260    2538 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 17:26:58.575339 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568262    2538 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:58.568265    2538 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.568270    2538 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.568363    2538 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.570264    2538 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.571505    2538 server.go:1019] "Starting client certificate rotation"
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.571602    2538 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.571633    2538 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 17:26:58.575828 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.573749    2538 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 17:26:58.578320 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.578301    2538 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 17:26:58.590014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.589997    2538 log.go:25] "Validated CRI v1 runtime API"
Jul 30 17:26:58.593044 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.593028    2538 log.go:25] "Validated CRI v1 image API"
Jul 30 17:26:58.593819 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.593804    2538 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 17:26:58.596257 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.596229    2538 fs.go:135] Filesystem UUIDs: map[151314a0-c4d0-45a7-8969-7ed83d3656e1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c92273b6-9d79-40df-802e-61c048d7c8ae:/dev/nvme0n1p3]
Jul 30 17:26:58.596318 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.596259    2538 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 17:26:58.602616 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.602504    2538 manager.go:216] Machine: {Timestamp:2026-07-30 17:26:58.601152152 +0000 UTC m=+0.326836423 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099994 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc17ffb6892b5c839121d310e9377 SystemUUID:ec2fc17f-fb68-92b5-c839-121d310e9377 BootID:05e51a06-1a4d-4a96-be52-01796a781cc5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:01:47:c3:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:01:47:c3:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:aa:b2:dd:1d:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 17:26:58.602616 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.602609    2538 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 17:26:58.602743 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.602714    2538 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 17:26:58.605844 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.605817    2538 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 17:26:58.605991 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.605848    2538 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 17:26:58.606555 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.606545    2538 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 17:26:58.606589 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.606557    2538 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 17:26:58.606589 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.606565    2538 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 17:26:58.607318 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.607307    2538 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 17:26:58.608809 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.608799    2538 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 17:26:58.612063 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612051    2538 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 17:26:58.612171 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612162    2538 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 17:26:58.612868 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612860    2538 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 17:26:58.612918 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612884    2538 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 17:26:58.612918 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612899    2538 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 17:26:58.612918 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612907    2538 kubelet.go:398] "Adding apiserver pod source"
Jul 30 17:26:58.612918 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.612915    2538 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 17:26:58.613246 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.613234    2538 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 17:26:58.613285 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.613254    2538 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 17:26:58.615390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.615375    2538 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 17:26:58.616710 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.616698    2538 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 17:26:58.616766 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.616726    2538 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 17:26:58.617325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617303    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 17:26:58.617325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617321    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 17:26:58.617325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617327    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 17:26:58.617325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617332    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617339    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617345    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617496    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617502    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617508    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617513    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617521    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 17:26:58.617564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.617529    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 17:26:58.618277 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.618268    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 17:26:58.618277 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.618277    2538 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 17:26:58.620915 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.620894    2538 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 17:26:58.621288 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.621277    2538 server.go:1268] "Started kubelet"
Jul 30 17:26:58.621387 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.621361    2538 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 17:26:58.621922 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.621858    2538 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 17:26:58.622022 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.621940    2538 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 17:26:58.622256 ip-10-0-137-250 systemd[1]: Started Kubernetes Kubelet.
Jul 30 17:26:58.623739 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.623723    2538 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 17:26:58.624295 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.624277    2538 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 17:26:58.624400 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.624381    2538 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 17:26:58.624449 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.624387    2538 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 17:26:58.624956 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.624937    2538 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 17:26:58.626578 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.626562    2538 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 17:26:58.628958 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.627904    2538 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18c721533a62de75  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-07-30 17:26:58.621251189 +0000 UTC m=+0.346935508,LastTimestamp:2026-07-30 17:26:58.621251189 +0000 UTC m=+0.346935508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Jul 30 17:26:58.630276 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.630257    2538 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 17:26:58.630341 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.630263    2538 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 17:26:58.630389 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.630360    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:58.631059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.630846    2538 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 17:26:58.631059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.630864    2538 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 17:26:58.631059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.630846    2538 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 17:26:58.631059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631017    2538 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 17:26:58.631059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631034    2538 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 17:26:58.631309 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631158    2538 factory.go:55] Registering systemd factory
Jul 30 17:26:58.631309 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631172    2538 factory.go:223] Registration of the systemd container factory successfully
Jul 30 17:26:58.631392 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631361    2538 factory.go:153] Registering CRI-O factory
Jul 30 17:26:58.631392 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631372    2538 factory.go:223] Registration of the crio container factory successfully
Jul 30 17:26:58.631491 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631416    2538 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 17:26:58.631491 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631437    2538 factory.go:103] Registering Raw factory
Jul 30 17:26:58.631491 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631449    2538 manager.go:1196] Started watching for new ooms in manager
Jul 30 17:26:58.631772 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.631758    2538 manager.go:349] Starting recovery of all containers
Jul 30 17:26:58.643304 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.643287    2538 manager.go:354] Recovery completed
Jul 30 17:26:58.644815 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.644789    2538 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 17:26:58.644950 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.644910    2538 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 17:26:58.648429 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.648416    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.650445 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650422    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.650516 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650453    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.650516 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650466    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.650964 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650949    2538 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 17:26:58.650964 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650964    2538 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 17:26:58.651083 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650971    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.651083 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.650982    2538 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 17:26:58.651620 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.651605    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.651676 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.651634    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.651676 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.651649    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.652285 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.652274    2538 policy_none.go:49] "None policy: Start"
Jul 30 17:26:58.652345 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.652288    2538 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 17:26:58.652345 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.652298    2538 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 17:26:58.653319 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.653309    2538 policy_none.go:47] "Start"
Jul 30 17:26:58.661038 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.660975    2538 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18c721533c204a07  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-07-30 17:26:58.650442247 +0000 UTC m=+0.376126520,LastTimestamp:2026-07-30 17:26:58.650442247 +0000 UTC m=+0.376126520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Jul 30 17:26:58.668689 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.668598    2538 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18c721533c2088c0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-07-30 17:26:58.650458304 +0000 UTC m=+0.376142575,LastTimestamp:2026-07-30 17:26:58.650458304 +0000 UTC m=+0.376142575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Jul 30 17:26:58.669204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.669186    2538 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5nxgt"
Jul 30 17:26:58.673744 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.673634    2538 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18c721533c20bfe1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-07-30 17:26:58.650472417 +0000 UTC m=+0.376156691,LastTimestamp:2026-07-30 17:26:58.650472417 +0000 UTC m=+0.376156691,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Jul 30 17:26:58.678825 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.678715    2538 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5nxgt"
Jul 30 17:26:58.680133 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.680079    2538 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-250.ec2.internal.18c721533c204a07\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-250.ec2.internal.18c721533c204a07  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-250.ec2.internal,UID:ip-10-0-137-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-250.ec2.internal,},FirstTimestamp:2026-07-30 17:26:58.650442247 +0000 UTC m=+0.376126520,LastTimestamp:2026-07-30 17:26:58.651619293 +0000 UTC m=+0.377303571,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-250.ec2.internal,}"
Jul 30 17:26:58.683112 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683101    2538 manager.go:337] "Starting Device Plugin manager"
Jul 30 17:26:58.683162 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.683136    2538 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 17:26:58.683162 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683145    2538 server.go:87] "Starting device plugin registration server"
Jul 30 17:26:58.683356 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683345    2538 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 17:26:58.683387 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683360    2538 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 17:26:58.683463 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683449    2538 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 17:26:58.683534 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683524    2538 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 17:26:58.683579 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.683535    2538 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 17:26:58.683982 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.683965    2538 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 17:26:58.684042 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.684015    2538 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:58.784071 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.784050    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.784962 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.784694    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.784962 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.784718    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.784962 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.784728    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.784962 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.784750    2538 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.794796 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.794782    2538 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.794867 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.794800    2538 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-250.ec2.internal\": node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:58.813302 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.813257    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:58.818866 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.818833    2538 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 17:26:58.819940 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.819927    2538 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 17:26:58.819995 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.819963    2538 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 17:26:58.819995 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.819981    2538 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 17:26:58.820095 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.820012    2538 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 17:26:58.822200 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.822181    2538 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:26:58.915569 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.915546    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:58.921152 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.921131    2538 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"]
Jul 30 17:26:58.921234 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.921196    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.921957 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.921943    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.922053 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.921974    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.922053 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.921988    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.923296 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923280    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.923406 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923391    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.923471 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923417    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.923974 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923959    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.924062 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923981    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.924062 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923980    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.924062 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.923992    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.924062 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.924009    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.924062 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.924024    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.925252 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.925235    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.925339 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.925266    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:58.925898 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.925879    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:58.925991 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.925910    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:58.925991 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.925923    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:58.932250 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.932234    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de67530b89680827d7a9f3fa61936a19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"de67530b89680827d7a9f3fa61936a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.932315 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.932259    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de67530b89680827d7a9f3fa61936a19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"de67530b89680827d7a9f3fa61936a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.932315 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:58.932277    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf942a6c196015e0d1cf3112ad1a0b12-config\") pod \"kube-apiserver-proxy-ip-10-0-137-250.ec2.internal\" (UID: \"cf942a6c196015e0d1cf3112ad1a0b12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.952597 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.952575    2538 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-250.ec2.internal\" not found" node="ip-10-0-137-250.ec2.internal"
Jul 30 17:26:58.957124 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:58.957109    2538 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-250.ec2.internal\" not found" node="ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.016664 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.016647    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.033493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.033475    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de67530b89680827d7a9f3fa61936a19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"de67530b89680827d7a9f3fa61936a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.033545 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.033513    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/de67530b89680827d7a9f3fa61936a19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"de67530b89680827d7a9f3fa61936a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.033545 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.033533    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de67530b89680827d7a9f3fa61936a19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"de67530b89680827d7a9f3fa61936a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.033613 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.033548    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf942a6c196015e0d1cf3112ad1a0b12-config\") pod \"kube-apiserver-proxy-ip-10-0-137-250.ec2.internal\" (UID: \"cf942a6c196015e0d1cf3112ad1a0b12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.033613 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.033573    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf942a6c196015e0d1cf3112ad1a0b12-config\") pod \"kube-apiserver-proxy-ip-10-0-137-250.ec2.internal\" (UID: \"cf942a6c196015e0d1cf3112ad1a0b12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.033613 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.033591    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de67530b89680827d7a9f3fa61936a19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal\" (UID: \"de67530b89680827d7a9f3fa61936a19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.117567 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.117504    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.223856 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.223806    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.255962 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.255939    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.260958 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.260503    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:26:59.324230 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.324199    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.430310 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.430234    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.531297 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.531251    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.572691 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.572660    2538 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 17:26:59.573160 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.572835    2538 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 17:26:59.632271 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.632249    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.683737 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.683644    2538 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 17:21:59 +0000 UTC" deadline="2028-01-04 21:22:30.531047575 +0000 UTC"
Jul 30 17:26:59.683737 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.683682    2538 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12555h55m30.847369818s"
Jul 30 17:26:59.733427 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.733387    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.789169 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.789135    2538 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 17:26:59.791453 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.791433    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 17:26:59.791567 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.791468    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 17:26:59.791567 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.791478    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeHasSufficientPID"
Jul 30 17:26:59.833746 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.833719    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:26:59.858805 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.858777    2538 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:26:59.893020 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:59.892987    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf942a6c196015e0d1cf3112ad1a0b12.slice/crio-af5df8023100bfe3517086b26edd0f542b208570a17bdd74374e9c9dc4dd3abb WatchSource:0}: Error finding container af5df8023100bfe3517086b26edd0f542b208570a17bdd74374e9c9dc4dd3abb: Status 404 returned error can't find the container with id af5df8023100bfe3517086b26edd0f542b208570a17bdd74374e9c9dc4dd3abb
Jul 30 17:26:59.893368 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:26:59.893345    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde67530b89680827d7a9f3fa61936a19.slice/crio-47084f1b3510fb4591d57ba8ed4f9173e5f3d208060aaf1339a3bf00587e29d0 WatchSource:0}: Error finding container 47084f1b3510fb4591d57ba8ed4f9173e5f3d208060aaf1339a3bf00587e29d0: Status 404 returned error can't find the container with id 47084f1b3510fb4591d57ba8ed4f9173e5f3d208060aaf1339a3bf00587e29d0
Jul 30 17:26:59.899792 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:26:59.899770    2538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:26:59.934801 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:26:59.934755    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:27:00.034863 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.034837    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:27:00.134936 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.134913    2538 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-250.ec2.internal\" not found"
Jul 30 17:27:00.227040 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.227017    2538 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:27:00.231035 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.231017    2538 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal"
Jul 30 17:27:00.241410 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.241382    2538 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:27:00.247618 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.247602    2538 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 17:27:00.248796 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.248781    2538 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal"
Jul 30 17:27:00.264084 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.264063    2538 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 17:27:00.616533 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.616451    2538 apiserver.go:52] "Watching apiserver"
Jul 30 17:27:00.626617 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.626433    2538 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 17:27:00.628193 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.628163    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rpv68","kube-system/konnectivity-agent-hm9n7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v","openshift-cluster-node-tuning-operator/tuned-lllq4","openshift-dns/node-resolver-hd6zk","openshift-image-registry/node-ca-wstkm","openshift-multus/multus-tmng8","openshift-network-diagnostics/network-check-target-hcqvh","openshift-ovn-kubernetes/ovnkube-node-mt4w6","kube-system/global-pull-secret-syncer-6g9p2","kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal","openshift-multus/multus-additional-cni-plugins-7f9jb","openshift-multus/network-metrics-daemon-spq6s"]
Jul 30 17:27:00.629764 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.629706    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.631168 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.631145    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.631563 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.631326    2538 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 17:27:00.633143 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.632694    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.634148 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.633732    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.635321 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.635297    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.636463 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.636441    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.638015 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.637993    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.638259 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638237    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638485    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638502    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638534    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t7dkp\""
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638596    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-registration-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638627    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-cni-multus\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638655    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-conf-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638689    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-multus-certs\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638715    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-device-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638739    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-system-cni-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638763    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-547rk\" (UniqueName: \"kubernetes.io/projected/72353694-d35b-4305-81ea-1f8f48e0a582-kube-api-access-547rk\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638810    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638886    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72353694-d35b-4305-81ea-1f8f48e0a582-multus-daemon-config\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.638972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638967    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-socket-dir-parent\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.638999    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-cnibin\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639036    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpzds\" (UniqueName: \"kubernetes.io/projected/bcee4279-c4b2-401d-89da-ae7afa063a2b-kube-api-access-xpzds\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639062    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639103    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqjt\" (UniqueName: \"kubernetes.io/projected/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-kube-api-access-9sqjt\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639129    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-cnibin\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639158    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72353694-d35b-4305-81ea-1f8f48e0a582-cni-binary-copy\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639193    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-system-cni-dir\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639218    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-os-release\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639242    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639266    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-socket-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639290    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-sys-fs\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639313    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-netns\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639337    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-cni-bin\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639360    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639409    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-kubelet\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.639717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639438    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-etc-kubernetes\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.640544 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639455    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.640544 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639479    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-cni-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.640544 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639499    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-hostroot\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.640544 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639514    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-k8s-cni-cncf-io\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.640544 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639531    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.640544 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.639554    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-os-release\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.641994 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.641797    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.643112 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.643077    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.643112 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.643092    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 17:27:00.643271 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.643249    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647046    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647069    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647156    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647049    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647203    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x625v\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647336    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647402    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647423    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647466    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647550    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.647685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647668    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.648249 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647836    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 17:27:00.648249 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.647990    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 17:27:00.648249 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648181    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648408    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648480    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5tj5c\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648497    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5r7k\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648590    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648705    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-76sws\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.648974    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.649083    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nkmvt\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.649182    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pnp6q\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.649473    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.649678    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 17:27:00.649860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.649834    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 17:27:00.651920 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.651895    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.652040 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.651997    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:00.652616 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.652333    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 17:27:00.652616 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.652504    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-25b2d\""
Jul 30 17:27:00.653252 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.653205    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 17:27:00.654050 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.654028    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 17:27:00.655805 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.655789    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:00.656015 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.655992    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:00.657301 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.657279    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:00.657381 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.657347    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:00.657889 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.657858    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-92m2b\""
Jul 30 17:27:00.665425 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.665399    2538 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 17:27:00.691444 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.691152    2538 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lfjk4"
Jul 30 17:27:00.706688 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.706668    2538 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lfjk4"
Jul 30 17:27:00.733168 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.733150    2538 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 17:27:00.739757 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739728    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpzds\" (UniqueName: \"kubernetes.io/projected/bcee4279-c4b2-401d-89da-ae7afa063a2b-kube-api-access-xpzds\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.739869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739768    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.739869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739802    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-cni-netd\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.739869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739826    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98e386c8-3e80-41f4-ad02-76680f052a4a-serviceca\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.739869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739851    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-system-cni-dir\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739876    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-os-release\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739920    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739949    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-netns\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.739980    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-cni-bin\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740005    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysctl-conf\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740028    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-systemd\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740051    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75s6s\" (UniqueName: \"kubernetes.io/projected/664c5959-7ccc-4146-aec3-39a123ea1822-kube-api-access-75s6s\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740067    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysctl-d\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740083    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96dc7725-519f-47e6-b694-73eb251906ca-ovn-node-metrics-cert\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740102    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/308cd859-af37-4193-8ac2-281f74978ff8-iptables-alerter-script\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.740128 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740129    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740156    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-cni-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740184    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-hostroot\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740208    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-systemd-units\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740232    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-ovnkube-script-lib\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740256    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5017c50-4a74-45ad-8f74-259e8bbb2eca-kubelet-config\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740290    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740315    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-var-lib-kubelet\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740340    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-env-overrides\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740366    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740397    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-systemd\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740422    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740455    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-device-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740481    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-system-cni-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740502    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-547rk\" (UniqueName: \"kubernetes.io/projected/72353694-d35b-4305-81ea-1f8f48e0a582-kube-api-access-547rk\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740534    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-etc-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.740655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740559    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740589    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/664c5959-7ccc-4146-aec3-39a123ea1822-hosts-file\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740628    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b871e5f-ae5f-4844-9da9-ae39290151ed-agent-certs\") pod \"konnectivity-agent-hm9n7\" (UID: \"8b871e5f-ae5f-4844-9da9-ae39290151ed\") " pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740652    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4a84253-9c74-401b-ba1c-acf75faa8c48-tmp\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740680    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740755    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-system-cni-dir\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740680    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-cnibin\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740848    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-cnibin\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740876    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.740999    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-device-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.741493 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741061    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-system-cni-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741514    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741609    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqjt\" (UniqueName: \"kubernetes.io/projected/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-kube-api-access-9sqjt\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741640    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-cnibin\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741666    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72353694-d35b-4305-81ea-1f8f48e0a582-cni-binary-copy\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741694    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-sys\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741720    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-log-socket\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741748    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741785    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741810    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-run\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741840    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-socket-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741863    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-sys-fs\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741890    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-etc-kubernetes\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741917    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysconfig\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741936    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-kubernetes\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741970    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-kubelet\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.741998    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.742019 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742024    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-kubelet\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742046    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-run-netns\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742061    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-hostroot\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742063    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-ovn\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742114    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-cni-bin\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742135    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcee4279-c4b2-401d-89da-ae7afa063a2b-os-release\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742144    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98565\" (UniqueName: \"kubernetes.io/projected/d8257104-65fb-40c9-817d-51d1aa9987b0-kube-api-access-98565\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742175    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742200    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664c5959-7ccc-4146-aec3-39a123ea1822-tmp-dir\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742236    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308cd859-af37-4193-8ac2-281f74978ff8-host-slash\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742254    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742275    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-k8s-cni-cncf-io\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742293    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-os-release\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742309    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-modprobe-d\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742325    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98e386c8-3e80-41f4-ad02-76680f052a4a-host\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742387    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b871e5f-ae5f-4844-9da9-ae39290151ed-konnectivity-ca\") pod \"konnectivity-agent-hm9n7\" (UID: \"8b871e5f-ae5f-4844-9da9-ae39290151ed\") " pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742405    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-var-lib-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.742846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742421    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742437    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-ovnkube-config\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742458    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-registration-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742478    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-cni-multus\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742505    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-conf-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742528    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-multus-certs\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742547    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2h4r\" (UniqueName: \"kubernetes.io/projected/96dc7725-519f-47e6-b694-73eb251906ca-kube-api-access-f2h4r\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742569    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbn9v\" (UniqueName: \"kubernetes.io/projected/308cd859-af37-4193-8ac2-281f74978ff8-kube-api-access-vbn9v\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742579    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcee4279-c4b2-401d-89da-ae7afa063a2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742588    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-node-log\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742617    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72353694-d35b-4305-81ea-1f8f48e0a582-multus-daemon-config\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742629    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-netns\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742642    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-lib-modules\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742664    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzzhv\" (UniqueName: \"kubernetes.io/projected/d4a84253-9c74-401b-ba1c-acf75faa8c48-kube-api-access-pzzhv\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742669    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-cni-bin\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742681    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26zj8\" (UniqueName: \"kubernetes.io/projected/98e386c8-3e80-41f4-ad02-76680f052a4a-kube-api-access-26zj8\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742700    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-slash\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.743700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742800    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5017c50-4a74-45ad-8f74-259e8bbb2eca-dbus\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742819    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-host\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742846    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-tuned\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742876    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-socket-dir-parent\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742912    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-cnibin\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742943    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-socket-dir-parent\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743011    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-k8s-cni-cncf-io\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743050    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-os-release\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743087    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-registration-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743115    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-cni-multus\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743138    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-conf-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743171    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-run-multus-certs\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743422    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72353694-d35b-4305-81ea-1f8f48e0a582-cni-binary-copy\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743532    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-socket-dir\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743587    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-sys-fs\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743608    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72353694-d35b-4305-81ea-1f8f48e0a582-multus-daemon-config\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743616    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-etc-kubernetes\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.742023    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-multus-cni-dir\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.744588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743765    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.745486 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.743809    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72353694-d35b-4305-81ea-1f8f48e0a582-host-var-lib-kubelet\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.748386 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.748360    2538 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 17:27:00.752885 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.752861    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpzds\" (UniqueName: \"kubernetes.io/projected/bcee4279-c4b2-401d-89da-ae7afa063a2b-kube-api-access-xpzds\") pod \"multus-additional-cni-plugins-7f9jb\" (UID: \"bcee4279-c4b2-401d-89da-ae7afa063a2b\") " pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.753115 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.753088    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-547rk\" (UniqueName: \"kubernetes.io/projected/72353694-d35b-4305-81ea-1f8f48e0a582-kube-api-access-547rk\") pod \"multus-tmng8\" (UID: \"72353694-d35b-4305-81ea-1f8f48e0a582\") " pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.754713 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.754690    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqjt\" (UniqueName: \"kubernetes.io/projected/3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f-kube-api-access-9sqjt\") pod \"aws-ebs-csi-driver-node-zmc8v\" (UID: \"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.814202 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.814172    2538 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 17:27:00.825517 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.825433    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" event={"ID":"de67530b89680827d7a9f3fa61936a19","Type":"ContainerStarted","Data":"47084f1b3510fb4591d57ba8ed4f9173e5f3d208060aaf1339a3bf00587e29d0"}
Jul 30 17:27:00.830287 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.828181    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal" event={"ID":"cf942a6c196015e0d1cf3112ad1a0b12","Type":"ContainerStarted","Data":"af5df8023100bfe3517086b26edd0f542b208570a17bdd74374e9c9dc4dd3abb"}
Jul 30 17:27:00.843898 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.843839    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/664c5959-7ccc-4146-aec3-39a123ea1822-hosts-file\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.843898 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.843877    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b871e5f-ae5f-4844-9da9-ae39290151ed-agent-certs\") pod \"konnectivity-agent-hm9n7\" (UID: \"8b871e5f-ae5f-4844-9da9-ae39290151ed\") " pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.843917    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4a84253-9c74-401b-ba1c-acf75faa8c48-tmp\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.843944    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-sys\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.843978    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-log-socket\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844002    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844025    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-run\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844053    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysconfig\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844078    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-kubernetes\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844102    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-kubelet\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844129    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-run-netns\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844152    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-ovn\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844175    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-cni-bin\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844200    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98565\" (UniqueName: \"kubernetes.io/projected/d8257104-65fb-40c9-817d-51d1aa9987b0-kube-api-access-98565\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844224    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844247    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664c5959-7ccc-4146-aec3-39a123ea1822-tmp-dir\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844271    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308cd859-af37-4193-8ac2-281f74978ff8-host-slash\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844292    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-run\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844355    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-kubernetes\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844355    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysconfig\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844402    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/664c5959-7ccc-4146-aec3-39a123ea1822-hosts-file\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.844430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844409    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-kubelet\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844462    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-run-netns\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844501    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-ovn\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844541    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-cni-bin\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844839    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-log-socket\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844974    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308cd859-af37-4193-8ac2-281f74978ff8-host-slash\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.844294    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845029    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-modprobe-d\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.845066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845056    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98e386c8-3e80-41f4-ad02-76680f052a4a-host\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845082    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b871e5f-ae5f-4844-9da9-ae39290151ed-konnectivity-ca\") pod \"konnectivity-agent-hm9n7\" (UID: \"8b871e5f-ae5f-4844-9da9-ae39290151ed\") " pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845109    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-var-lib-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845142    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845168    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-ovnkube-config\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845190    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664c5959-7ccc-4146-aec3-39a123ea1822-tmp-dir\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845199    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h4r\" (UniqueName: \"kubernetes.io/projected/96dc7725-519f-47e6-b694-73eb251906ca-kube-api-access-f2h4r\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845241    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-sys\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845278    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbn9v\" (UniqueName: \"kubernetes.io/projected/308cd859-af37-4193-8ac2-281f74978ff8-kube-api-access-vbn9v\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845308    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-node-log\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845336    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-lib-modules\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845362    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzzhv\" (UniqueName: \"kubernetes.io/projected/d4a84253-9c74-401b-ba1c-acf75faa8c48-kube-api-access-pzzhv\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845399    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26zj8\" (UniqueName: \"kubernetes.io/projected/98e386c8-3e80-41f4-ad02-76680f052a4a-kube-api-access-26zj8\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845424    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-var-lib-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.845431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845426    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-slash\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845474    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-slash\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845464    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5017c50-4a74-45ad-8f74-259e8bbb2eca-dbus\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845515    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-host\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845534    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5017c50-4a74-45ad-8f74-259e8bbb2eca-dbus\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845540    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-tuned\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845577    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-cni-netd\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845603    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98e386c8-3e80-41f4-ad02-76680f052a4a-serviceca\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845635    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysctl-conf\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845671    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-systemd\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845698    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75s6s\" (UniqueName: \"kubernetes.io/projected/664c5959-7ccc-4146-aec3-39a123ea1822-kube-api-access-75s6s\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845724    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysctl-d\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845752    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96dc7725-519f-47e6-b694-73eb251906ca-ovn-node-metrics-cert\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845779    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/308cd859-af37-4193-8ac2-281f74978ff8-iptables-alerter-script\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845796    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8b871e5f-ae5f-4844-9da9-ae39290151ed-konnectivity-ca\") pod \"konnectivity-agent-hm9n7\" (UID: \"8b871e5f-ae5f-4844-9da9-ae39290151ed\") " pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845810    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-systemd-units\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845835    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-ovnkube-script-lib\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845858    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845861    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5017c50-4a74-45ad-8f74-259e8bbb2eca-kubelet-config\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845900    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-var-lib-kubelet\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845908    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5017c50-4a74-45ad-8f74-259e8bbb2eca-kubelet-config\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845927    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-env-overrides\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845974    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846002    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-systemd\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846032    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846065    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-etc-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846137    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-etc-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846259    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-modprobe-d\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846301    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98e386c8-3e80-41f4-ad02-76680f052a4a-host\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846347    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-var-lib-kubelet\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.846453    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846500    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-ovnkube-config\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.846518    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:27:01.346496485 +0000 UTC m=+3.072180764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.845975    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-openvswitch\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.846807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846552    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-cni-netd\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846564    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-run-systemd\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846603    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846733    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysctl-conf\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846755    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-env-overrides\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846790    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-systemd\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846895    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-lib-modules\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.846994    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98e386c8-3e80-41f4-ad02-76680f052a4a-serviceca\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847123    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-sysctl-d\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847166    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-node-log\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847212    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96dc7725-519f-47e6-b694-73eb251906ca-systemd-units\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.847639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847284    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4a84253-9c74-401b-ba1c-acf75faa8c48-host\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.848205 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847681    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/308cd859-af37-4193-8ac2-281f74978ff8-iptables-alerter-script\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.848205 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847691    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96dc7725-519f-47e6-b694-73eb251906ca-ovnkube-script-lib\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.848205 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.847771    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:00.848205 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.847823    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:01.347805371 +0000 UTC m=+3.073489639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:00.848205 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.847879    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4a84253-9c74-401b-ba1c-acf75faa8c48-etc-tuned\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.850246 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.850223    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96dc7725-519f-47e6-b694-73eb251906ca-ovn-node-metrics-cert\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.850341 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.850272    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4a84253-9c74-401b-ba1c-acf75faa8c48-tmp\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.850459 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.850437    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8b871e5f-ae5f-4844-9da9-ae39290151ed-agent-certs\") pod \"konnectivity-agent-hm9n7\" (UID: \"8b871e5f-ae5f-4844-9da9-ae39290151ed\") " pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:00.861950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.861925    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98565\" (UniqueName: \"kubernetes.io/projected/d8257104-65fb-40c9-817d-51d1aa9987b0-kube-api-access-98565\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:00.866048 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.866027    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:00.866206 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.866056    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:00.866206 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.866070    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:00.866206 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:00.866130    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:01.36611127 +0000 UTC m=+3.091795531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:00.868999 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.868752    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzzhv\" (UniqueName: \"kubernetes.io/projected/d4a84253-9c74-401b-ba1c-acf75faa8c48-kube-api-access-pzzhv\") pod \"tuned-lllq4\" (UID: \"d4a84253-9c74-401b-ba1c-acf75faa8c48\") " pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.868999 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.868913    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2h4r\" (UniqueName: \"kubernetes.io/projected/96dc7725-519f-47e6-b694-73eb251906ca-kube-api-access-f2h4r\") pod \"ovnkube-node-mt4w6\" (UID: \"96dc7725-519f-47e6-b694-73eb251906ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:00.869822 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.869796    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75s6s\" (UniqueName: \"kubernetes.io/projected/664c5959-7ccc-4146-aec3-39a123ea1822-kube-api-access-75s6s\") pod \"node-resolver-hd6zk\" (UID: \"664c5959-7ccc-4146-aec3-39a123ea1822\") " pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.871234 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.871069    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbn9v\" (UniqueName: \"kubernetes.io/projected/308cd859-af37-4193-8ac2-281f74978ff8-kube-api-access-vbn9v\") pod \"iptables-alerter-rpv68\" (UID: \"308cd859-af37-4193-8ac2-281f74978ff8\") " pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:00.873533 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.873510    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26zj8\" (UniqueName: \"kubernetes.io/projected/98e386c8-3e80-41f4-ad02-76680f052a4a-kube-api-access-26zj8\") pod \"node-ca-wstkm\" (UID: \"98e386c8-3e80-41f4-ad02-76680f052a4a\") " pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:00.947456 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.947425    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tmng8"
Jul 30 17:27:00.958333 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:00.958309    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72353694_d35b_4305_81ea_1f8f48e0a582.slice/crio-282e9cdcd9a8ba4d8efd65c9a09b2c32ec021e6b1b97d9590ead9dd7a52e37b1 WatchSource:0}: Error finding container 282e9cdcd9a8ba4d8efd65c9a09b2c32ec021e6b1b97d9590ead9dd7a52e37b1: Status 404 returned error can't find the container with id 282e9cdcd9a8ba4d8efd65c9a09b2c32ec021e6b1b97d9590ead9dd7a52e37b1
Jul 30 17:27:00.961995 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.961973    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7f9jb"
Jul 30 17:27:00.971404 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.971384    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v"
Jul 30 17:27:00.979172 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.979153    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lllq4"
Jul 30 17:27:00.985252 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.985231    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hd6zk"
Jul 30 17:27:00.995136 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:00.995115    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wstkm"
Jul 30 17:27:01.004263 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.004245    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:01.013316 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.013296    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rpv68"
Jul 30 17:27:01.021662 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.021639    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:01.349315 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.349277    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:01.349490 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.349352    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:01.349490 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.349460    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:01.349620 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.349533    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:02.349515709 +0000 UTC m=+4.075199969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:01.349620 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.349461    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:01.349620 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.349614    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:27:02.349595267 +0000 UTC m=+4.075279529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:01.450490 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.450447    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:01.450667 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.450626    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:01.450667 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.450652    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:01.450667 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.450663    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:01.450855 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.450718    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:02.450702195 +0000 UTC m=+4.176386454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:01.710056 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.709998    2538 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 17:22:01 +0000 UTC" deadline="2028-03-22 03:33:49.824733487 +0000 UTC"
Jul 30 17:27:01.710056 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.710049    2538 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14410h6m48.114688827s"
Jul 30 17:27:01.820945 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.820914    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:01.821129 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:01.821043    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:01.831046 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:01.831006    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tmng8" event={"ID":"72353694-d35b-4305-81ea-1f8f48e0a582","Type":"ContainerStarted","Data":"282e9cdcd9a8ba4d8efd65c9a09b2c32ec021e6b1b97d9590ead9dd7a52e37b1"}
Jul 30 17:27:02.000145 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.000115    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcee4279_c4b2_401d_89da_ae7afa063a2b.slice/crio-61c15075154eac9358393903f460dd91ca88b600940399d88c4ee9f5f6ecd1ef WatchSource:0}: Error finding container 61c15075154eac9358393903f460dd91ca88b600940399d88c4ee9f5f6ecd1ef: Status 404 returned error can't find the container with id 61c15075154eac9358393903f460dd91ca88b600940399d88c4ee9f5f6ecd1ef
Jul 30 17:27:02.002394 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.002030    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b871e5f_ae5f_4844_9da9_ae39290151ed.slice/crio-9e3b2d94b03cbe70fc9b27f49d2399c4da35b254c02b6390ec051e5a14847fa3 WatchSource:0}: Error finding container 9e3b2d94b03cbe70fc9b27f49d2399c4da35b254c02b6390ec051e5a14847fa3: Status 404 returned error can't find the container with id 9e3b2d94b03cbe70fc9b27f49d2399c4da35b254c02b6390ec051e5a14847fa3
Jul 30 17:27:02.002911 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.002883    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308cd859_af37_4193_8ac2_281f74978ff8.slice/crio-c8b14df4716e261de676c4a02df58e48e65ef6549e345324fa2b07bb51912293 WatchSource:0}: Error finding container c8b14df4716e261de676c4a02df58e48e65ef6549e345324fa2b07bb51912293: Status 404 returned error can't find the container with id c8b14df4716e261de676c4a02df58e48e65ef6549e345324fa2b07bb51912293
Jul 30 17:27:02.004215 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.003696    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664c5959_7ccc_4146_aec3_39a123ea1822.slice/crio-ef10d11d5372e80dbe4f70e626c7249e82aeab7e3f4723566358da024e03a3a4 WatchSource:0}: Error finding container ef10d11d5372e80dbe4f70e626c7249e82aeab7e3f4723566358da024e03a3a4: Status 404 returned error can't find the container with id ef10d11d5372e80dbe4f70e626c7249e82aeab7e3f4723566358da024e03a3a4
Jul 30 17:27:02.005844 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.005816    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a58ab6a_fbc4_4e79_9f0c_ca646b28c09f.slice/crio-6db74fa8abdc6e4747a5ba5175982f3ff8ff7bdf341b2970aafa14d4c235a124 WatchSource:0}: Error finding container 6db74fa8abdc6e4747a5ba5175982f3ff8ff7bdf341b2970aafa14d4c235a124: Status 404 returned error can't find the container with id 6db74fa8abdc6e4747a5ba5175982f3ff8ff7bdf341b2970aafa14d4c235a124
Jul 30 17:27:02.007069 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.007047    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dc7725_519f_47e6_b694_73eb251906ca.slice/crio-ec0bbefcdf08f10f8e1183ef1c4df2423e0665fbe08a25b91c33ad7562580dfa WatchSource:0}: Error finding container ec0bbefcdf08f10f8e1183ef1c4df2423e0665fbe08a25b91c33ad7562580dfa: Status 404 returned error can't find the container with id ec0bbefcdf08f10f8e1183ef1c4df2423e0665fbe08a25b91c33ad7562580dfa
Jul 30 17:27:02.007965 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:02.007834    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a84253_9c74_401b_ba1c_acf75faa8c48.slice/crio-f2f09ef89bbdc0764bb9662ba07fac15fc8050fd2306a6559366fb85be2df108 WatchSource:0}: Error finding container f2f09ef89bbdc0764bb9662ba07fac15fc8050fd2306a6559366fb85be2df108: Status 404 returned error can't find the container with id f2f09ef89bbdc0764bb9662ba07fac15fc8050fd2306a6559366fb85be2df108
Jul 30 17:27:02.358340 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.358298    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:02.358490 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.358388    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:02.358565 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.358552    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:02.358624 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.358584    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:02.358678 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.358628    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:27:04.358608058 +0000 UTC m=+6.084292321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:02.358678 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.358649    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:04.358639152 +0000 UTC m=+6.084323417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:02.459870 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.459233    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:02.459870 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.459446    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:02.459870 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.459466    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:02.459870 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.459479    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:02.459870 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.459537    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:04.459518347 +0000 UTC m=+6.185202609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:02.711059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.710991    2538 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 17:22:01 +0000 UTC" deadline="2028-03-29 15:20:24.281967724 +0000 UTC"
Jul 30 17:27:02.711059 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.711059    2538 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14589h53m21.570913636s"
Jul 30 17:27:02.823184 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.823151    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:02.823358 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.823292    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:02.823724 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.823703    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:02.823825 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:02.823799    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:02.856400 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.856362    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hm9n7" event={"ID":"8b871e5f-ae5f-4844-9da9-ae39290151ed","Type":"ContainerStarted","Data":"9e3b2d94b03cbe70fc9b27f49d2399c4da35b254c02b6390ec051e5a14847fa3"}
Jul 30 17:27:02.858730 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.858682    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerStarted","Data":"61c15075154eac9358393903f460dd91ca88b600940399d88c4ee9f5f6ecd1ef"}
Jul 30 17:27:02.865572 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.864676    2538 generic.go:356] "Generic (PLEG): container finished" podID="de67530b89680827d7a9f3fa61936a19" containerID="87a93c3a97e55fb4c993f38eea7858ba1e9345b2dd4a7606ad39349dbd89720a" exitCode=0
Jul 30 17:27:02.865572 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.864761    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" event={"ID":"de67530b89680827d7a9f3fa61936a19","Type":"ContainerDied","Data":"87a93c3a97e55fb4c993f38eea7858ba1e9345b2dd4a7606ad39349dbd89720a"}
Jul 30 17:27:02.877101 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.877064    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lllq4" event={"ID":"d4a84253-9c74-401b-ba1c-acf75faa8c48","Type":"ContainerStarted","Data":"f2f09ef89bbdc0764bb9662ba07fac15fc8050fd2306a6559366fb85be2df108"}
Jul 30 17:27:02.889343 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.889218    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v" event={"ID":"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f","Type":"ContainerStarted","Data":"6db74fa8abdc6e4747a5ba5175982f3ff8ff7bdf341b2970aafa14d4c235a124"}
Jul 30 17:27:02.905378 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.905292    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hd6zk" event={"ID":"664c5959-7ccc-4146-aec3-39a123ea1822","Type":"ContainerStarted","Data":"ef10d11d5372e80dbe4f70e626c7249e82aeab7e3f4723566358da024e03a3a4"}
Jul 30 17:27:02.909649 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.909000    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal" event={"ID":"cf942a6c196015e0d1cf3112ad1a0b12","Type":"ContainerStarted","Data":"4c78ccea6d54006d6850fb5c0b437021dddfed14356a561bc7c77c8d844a1349"}
Jul 30 17:27:02.918191 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.918163    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wstkm" event={"ID":"98e386c8-3e80-41f4-ad02-76680f052a4a","Type":"ContainerStarted","Data":"1fcfe8587d45a3e564b16fb20fba997946c43551dbc8f83cea9f8ea1c8ecbc52"}
Jul 30 17:27:02.924996 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.924938    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"ec0bbefcdf08f10f8e1183ef1c4df2423e0665fbe08a25b91c33ad7562580dfa"}
Jul 30 17:27:02.944324 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:02.944287    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rpv68" event={"ID":"308cd859-af37-4193-8ac2-281f74978ff8","Type":"ContainerStarted","Data":"c8b14df4716e261de676c4a02df58e48e65ef6549e345324fa2b07bb51912293"}
Jul 30 17:27:03.820899 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:03.820330    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:03.820899 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:03.820489    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:03.966054 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:03.965682    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" event={"ID":"de67530b89680827d7a9f3fa61936a19","Type":"ContainerStarted","Data":"96421e130c0c830070a686ec7e77776113995f85fffa3e9822c095272b4bd9ff"}
Jul 30 17:27:03.985502 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:03.984630    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-250.ec2.internal" podStartSLOduration=3.984607215 podStartE2EDuration="3.984607215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:02.929521599 +0000 UTC m=+4.655205884" watchObservedRunningTime="2026-07-30 17:27:03.984607215 +0000 UTC m=+5.710291502"
Jul 30 17:27:04.376176 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:04.375208    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:04.376176 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:04.375285    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:04.376176 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.375554    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:04.376176 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.375635    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:08.375605747 +0000 UTC m=+10.101290012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:04.376176 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.376083    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:04.376176 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.376135    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:27:08.376118993 +0000 UTC m=+10.101803269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:04.476073 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:04.476021    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:04.476289 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.476252    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:04.476289 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.476274    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:04.476289 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.476289    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:04.476473 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.476380    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:08.476330268 +0000 UTC m=+10.202014552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:04.822140 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:04.822103    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:04.822666 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.822245    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:04.822739 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:04.822678    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:04.822799 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:04.822784    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:05.821274 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:05.821236    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:05.821483 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:05.821398    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:06.823348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:06.823314    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:06.823814 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:06.823487    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:06.823814 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:06.823500    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:06.823814 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:06.823581    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:07.820799 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:07.820313    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:07.820799 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:07.820448    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:08.409508 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:08.409468    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:08.409969 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:08.409549    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:08.409969 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.409621    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:08.409969 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.409646    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:08.409969 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.409693    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:27:16.409673981 +0000 UTC m=+18.135358239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:08.409969 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.409715    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:16.40970405 +0000 UTC m=+18.135388316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:08.511311 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:08.510753    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:08.511311 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.510935    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:08.511311 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.510954    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:08.511311 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.510964    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:08.511311 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.511019    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:16.511001395 +0000 UTC m=+18.236685656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:08.821381 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:08.821349    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:08.830448 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.821460    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:08.830448 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:08.829869    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:08.830448 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:08.830016    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:09.821265 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:09.821234    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:09.821745 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:09.821372    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:10.821035 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:10.820976    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:10.821213 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:10.821107    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:10.821423 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:10.821296    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:10.821423 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:10.821392    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:11.820186 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:11.820154    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:11.820360 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:11.820282    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:12.820450 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:12.820376    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:12.820826 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:12.820486    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:12.820826 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:12.820547    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:12.820826 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:12.820672    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:13.820932 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:13.820897    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:13.821336 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:13.821010    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:14.820715 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:14.820674    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:14.820901 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:14.820790    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:14.820901 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:14.820849    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:14.821266 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:14.820971    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:15.820951 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:15.820919    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:15.821157 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:15.821026    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:16.471196 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:16.471165    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:16.471394 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:16.471232    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:16.471394 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.471301    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:16.471394 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.471329    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:16.471394 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.471376    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:32.471356308 +0000 UTC m=+34.197040582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:16.471544 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.471399    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:27:32.471389648 +0000 UTC m=+34.197073906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:16.572429 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:16.572391    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:16.572594 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.572538    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:16.572594 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.572558    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:16.572594 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.572567    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:16.572716 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.572616    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:27:32.572600061 +0000 UTC m=+34.298284334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:16.823321 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:16.823253    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:16.823733 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.823351    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:16.823733 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:16.823373    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:16.823733 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:16.823482    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:17.820720 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:17.820682    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:17.820908 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:17.820885    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:18.821723 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:18.821692    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:18.822187 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:18.821800    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:18.822187 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:18.821847    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:18.822187 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:18.821949    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:19.820167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:19.820132    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:19.820334 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:19.820273    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:20.821155 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:20.820843    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:20.821990 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:20.820863    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:20.821990 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:20.821262    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:20.821990 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:20.821293    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:21.005957 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.005901    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"8311c337d476ef9fb3c4f04da2402e6e4eef317a6fcd434a500944b10e653a84"}
Jul 30 17:27:21.006014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.005982    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"f22a253b4810c37fb52387796557e57a30aa55c3407c4d01321505769685b1c5"}
Jul 30 17:27:21.006050 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.006014    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"3daba33a14e5c6bfe67987214471169f4cfa53533ce75cf703c4d5a049354df1"}
Jul 30 17:27:21.006092 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.006046    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"f0f1c11f1c0f21edbfab7d333ce85b0991c3113425bd7678fe9ec02e00e8d642"}
Jul 30 17:27:21.006129 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.006092    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"585dcb2845c9bb362f24a4d4a06060768a0fad6c0fe62e3dc340602fb87c8b55"}
Jul 30 17:27:21.007205 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.007182    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hm9n7" event={"ID":"8b871e5f-ae5f-4844-9da9-ae39290151ed","Type":"ContainerStarted","Data":"b36b673870443c9262c27b1e06c7bcdce2ce6fd7c807f209ccf36990111a7b2c"}
Jul 30 17:27:21.008642 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.008623    2538 generic.go:356] "Generic (PLEG): container finished" podID="bcee4279-c4b2-401d-89da-ae7afa063a2b" containerID="bef7323d6a54fa49d6224f08cb268e3366647cc766cbba3f0b4ea94ffde93523" exitCode=0
Jul 30 17:27:21.008740 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.008690    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerDied","Data":"bef7323d6a54fa49d6224f08cb268e3366647cc766cbba3f0b4ea94ffde93523"}
Jul 30 17:27:21.010089 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.010071    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tmng8" event={"ID":"72353694-d35b-4305-81ea-1f8f48e0a582","Type":"ContainerStarted","Data":"02654216293cb2afe1af9134bf4e21dfdcb08b01145711791249fe2747862de4"}
Jul 30 17:27:21.011411 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.011385    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lllq4" event={"ID":"d4a84253-9c74-401b-ba1c-acf75faa8c48","Type":"ContainerStarted","Data":"a78387ca1c5e78e7ec3a47e49982748a73ce21fdc3d1f50915557c73bcc97d77"}
Jul 30 17:27:21.012701 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.012682    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v" event={"ID":"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f","Type":"ContainerStarted","Data":"aaa5a2eb7eb8bea9fd36e1aebcc699566db0c71bb9f93b82cc59bec2872f9ec7"}
Jul 30 17:27:21.013903 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.013865    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hd6zk" event={"ID":"664c5959-7ccc-4146-aec3-39a123ea1822","Type":"ContainerStarted","Data":"1b032f2ee62ddb7611638ec6f7108a9a4b491ab73b7aca7931f8acbc27762eb4"}
Jul 30 17:27:21.015142 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.015125    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wstkm" event={"ID":"98e386c8-3e80-41f4-ad02-76680f052a4a","Type":"ContainerStarted","Data":"04366272ad733fdae7445fd4f07dd3887a1dc55b5804cb29ef12bd0c1627fc69"}
Jul 30 17:27:21.025389 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.025355    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-250.ec2.internal" podStartSLOduration=21.025343611 podStartE2EDuration="21.025343611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:03.985484882 +0000 UTC m=+5.711169167" watchObservedRunningTime="2026-07-30 17:27:21.025343611 +0000 UTC m=+22.751027890"
Jul 30 17:27:21.047811 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.047775    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hm9n7" podStartSLOduration=11.468187654 podStartE2EDuration="22.047763501s" totalImagesPullingTime="10.579575847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:21.025007086 +0000 UTC m=+22.750691363" watchObservedRunningTime="2026-07-30 17:27:21.047763501 +0000 UTC m=+22.773447781"
Jul 30 17:27:21.087939 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.087870    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lllq4" podStartSLOduration=3.628189988 podStartE2EDuration="22.087857976s" totalImagesPullingTime="18.459667988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:21.087685143 +0000 UTC m=+22.813369423" watchObservedRunningTime="2026-07-30 17:27:21.087857976 +0000 UTC m=+22.813542255"
Jul 30 17:27:21.088057 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.088039    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tmng8" podStartSLOduration=2.528416932 podStartE2EDuration="22.088032697s" totalImagesPullingTime="19.559615765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:21.059311123 +0000 UTC m=+22.784995402" watchObservedRunningTime="2026-07-30 17:27:21.088032697 +0000 UTC m=+22.813716976"
Jul 30 17:27:21.167368 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.167316    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hd6zk" podStartSLOduration=3.707207378 podStartE2EDuration="22.16730379s" totalImagesPullingTime="18.460096412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:21.166491949 +0000 UTC m=+22.892176229" watchObservedRunningTime="2026-07-30 17:27:21.16730379 +0000 UTC m=+22.892988070"
Jul 30 17:27:21.210321 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.210279    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wstkm" podStartSLOduration=3.7523328620000003 podStartE2EDuration="22.210260489s" totalImagesPullingTime="18.457927627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:21.2097005 +0000 UTC m=+22.935384781" watchObservedRunningTime="2026-07-30 17:27:21.210260489 +0000 UTC m=+22.935944772"
Jul 30 17:27:21.304211 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.304104    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:21.442254 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.442219    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:21.821157 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.821124    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:21.821552 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:21.821233    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:21.971325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:21.971299    2538 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 17:27:22.019956 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.019920    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v" event={"ID":"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f","Type":"ContainerStarted","Data":"c4cbc22668788123309bb73e2c1485182fa26131937f5163a977b457381342c3"}
Jul 30 17:27:22.024734 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.024708    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"d5cc72668466aee9f3cb68ea7d29688a3131e5823985bf8de1864a797dc3d601"}
Jul 30 17:27:22.026193 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.026172    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rpv68" event={"ID":"308cd859-af37-4193-8ac2-281f74978ff8","Type":"ContainerStarted","Data":"333ed6f19d0b3219910a40df6cb90939a8e5e0215f371496a78e2e84d7bd2856"}
Jul 30 17:27:22.075894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.075834    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rpv68" podStartSLOduration=4.613072101 podStartE2EDuration="23.075816788s" totalImagesPullingTime="18.462744687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:22.074966229 +0000 UTC m=+23.800650509" watchObservedRunningTime="2026-07-30 17:27:22.075816788 +0000 UTC m=+23.801501068"
Jul 30 17:27:22.432780 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.432745    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:22.544488 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.544446    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:22.612101 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.612017    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:22.697360 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.697159    2538 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T17:27:21.971319589Z","UUID":"a977bbcc-5a80-4637-9609-edd58eb8982c","Handler":null,"Name":"","Endpoint":""}
Jul 30 17:27:22.698897 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.698793    2538 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 17:27:22.698897 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.698829    2538 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 17:27:22.820292 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.820258    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:22.820447 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:22.820380    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:22.820447 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.820434    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:22.820557 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:22.820538    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:22.902821 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.902795    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:22.903325 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:22.903311    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:23.820956 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:23.820924    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:23.821184 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:23.821030    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:24.033801 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.033759    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v" event={"ID":"3a58ab6a-fbc4-4e79-9f0c-ca646b28c09f","Type":"ContainerStarted","Data":"7c99bc171d597f81acfa982e566c0fb4f1f389c99c2c0559497cfafcba46e0eb"}
Jul 30 17:27:24.037700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.037678    2538 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 30 17:27:24.037700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.037688    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"bf08f6470ff02136cef247b58489056a94b360bb93a02d5afbd58470bbe8a90b"}
Jul 30 17:27:24.062630 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.062578    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zmc8v" podStartSLOduration=4.332677695 podStartE2EDuration="25.062562182s" totalImagesPullingTime="20.729884487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:24.061200892 +0000 UTC m=+25.786885173" watchObservedRunningTime="2026-07-30 17:27:24.062562182 +0000 UTC m=+25.788246461"
Jul 30 17:27:24.139501 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.139412    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:24.246771 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.246739    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:24.255614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.255589    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:24.256102 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.256082    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hm9n7"
Jul 30 17:27:24.330616 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.330583    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:24.432962 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.432887    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:24.537405 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.537374    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:24.820842 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.820810    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:24.821018 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:24.820937    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:24.821018 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:24.820992    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:24.821101 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:24.821079    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:25.820647 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:25.820616    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:25.821053 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:25.820755    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:26.821322 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:26.821144    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:26.821890 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:26.821151    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:26.821890 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:26.821434    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:26.821890 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:26.821500    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:27.045721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.045691    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" event={"ID":"96dc7725-519f-47e6-b694-73eb251906ca","Type":"ContainerStarted","Data":"2f60d20d635ed0df1a05017651c80807f3a7d76c431907e0c0e5fbe56a3d7d73"}
Jul 30 17:27:27.045975 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.045959    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:27.047470 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.047445    2538 generic.go:356] "Generic (PLEG): container finished" podID="bcee4279-c4b2-401d-89da-ae7afa063a2b" containerID="0a41fd137779c9dfce3cfa25c87d1e6885b90554d74679edf86e6799bf071803" exitCode=0
Jul 30 17:27:27.047558 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.047484    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerDied","Data":"0a41fd137779c9dfce3cfa25c87d1e6885b90554d74679edf86e6799bf071803"}
Jul 30 17:27:27.061020 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.061003    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:27.073960 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.073925    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6" podStartSLOduration=9.544500421 podStartE2EDuration="28.073913988s" totalImagesPullingTime="18.529413567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:27.072022255 +0000 UTC m=+28.797706535" watchObservedRunningTime="2026-07-30 17:27:27.073913988 +0000 UTC m=+28.799598545"
Jul 30 17:27:27.777496 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.777456    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:27.820429 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.820398    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:27.820583 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:27.820528    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:27.877044 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:27.877009    2538 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log" limit=1024
Jul 30 17:27:28.050613 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.050589    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:28.050726 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.050677    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:28.065204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.065183    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:27:28.126980 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.126955    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spq6s"]
Jul 30 17:27:28.127081 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.127062    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:28.127194 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:28.127172    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:28.134809 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.134785    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6g9p2"]
Jul 30 17:27:28.134950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.134893    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:28.135009 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:28.134985    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:28.135446 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.135416    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcqvh"]
Jul 30 17:27:28.135528 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:28.135500    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:28.135585 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:28.135570    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:29.053612 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:29.053580    2538 generic.go:356] "Generic (PLEG): container finished" podID="bcee4279-c4b2-401d-89da-ae7afa063a2b" containerID="dc7e434f0fee0a5b9e85bda28778c6417ecb891202062d32c1308b756678531b" exitCode=0
Jul 30 17:27:29.053996 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:29.053668    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerDied","Data":"dc7e434f0fee0a5b9e85bda28778c6417ecb891202062d32c1308b756678531b"}
Jul 30 17:27:29.820890 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:29.820839    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:29.821071 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:29.820897    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:29.821071 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:29.820897    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:29.821071 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:29.820988    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:29.821071 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:29.821050    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:29.821283 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:29.821145    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:31.059277 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:31.059239    2538 generic.go:356] "Generic (PLEG): container finished" podID="bcee4279-c4b2-401d-89da-ae7afa063a2b" containerID="67797915534d77bc99d844dabe645d267699ca2ccd70ad2afcfb8ff64eedb4bd" exitCode=0
Jul 30 17:27:31.059745 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:31.059287    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerDied","Data":"67797915534d77bc99d844dabe645d267699ca2ccd70ad2afcfb8ff64eedb4bd"}
Jul 30 17:27:31.820928 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:31.820894    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:31.821125 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:31.821007    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcqvh" podUID="23d95737-cafe-45d3-9637-6d45958286e4"
Jul 30 17:27:31.821125 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:31.821029    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:31.821125 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:31.820907    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:31.821275 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:31.821132    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:27:31.821275 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:31.821203    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g9p2" podUID="e5017c50-4a74-45ad-8f74-259e8bbb2eca"
Jul 30 17:27:32.491109 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:32.491078    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:32.491542 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:32.491134    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:32.491542 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.491258    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:32.491542 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.491268    2538 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:32.491542 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.491317    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:28:04.49130276 +0000 UTC m=+66.216987018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 17:27:32.491542 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.491332    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret podName:e5017c50-4a74-45ad-8f74-259e8bbb2eca nodeName:}" failed. No retries permitted until 2026-07-30 17:28:04.491325761 +0000 UTC m=+66.217010018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret") pod "global-pull-secret-syncer-6g9p2" (UID: "e5017c50-4a74-45ad-8f74-259e8bbb2eca") : object "kube-system"/"original-pull-secret" not registered
Jul 30 17:27:32.592147 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:32.592111    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:32.592297 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.592280    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 17:27:32.592297 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.592297    2538 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 17:27:32.592405 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.592308    2538 projected.go:196] Error preparing data for projected volume kube-api-access-l22x2 for pod openshift-network-diagnostics/network-check-target-hcqvh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:32.592405 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:32.592369    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2 podName:23d95737-cafe-45d3-9637-6d45958286e4 nodeName:}" failed. No retries permitted until 2026-07-30 17:28:04.59235235 +0000 UTC m=+66.318036630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l22x2" (UniqueName: "kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2") pod "network-check-target-hcqvh" (UID: "23d95737-cafe-45d3-9637-6d45958286e4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 17:27:33.087727 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.087696    2538 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-250.ec2.internal" event="NodeReady"
Jul 30 17:27:33.087927 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.087845    2538 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 17:27:33.141224 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.141193    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sdtrv"]
Jul 30 17:27:33.144242 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.144223    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.146984 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.146963    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 17:27:33.147066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.146987    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjl7j\""
Jul 30 17:27:33.147066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.147034    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 17:27:33.147240 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.147217    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dlrgr"]
Jul 30 17:27:33.149567 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.149546    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.152218 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.152175    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 17:27:33.152681 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.152340    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 17:27:33.152681 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.152513    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sr7s9\""
Jul 30 17:27:33.153141 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.153085    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 17:27:33.157201 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.157136    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdtrv"]
Jul 30 17:27:33.174290 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.174249    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlrgr"]
Jul 30 17:27:33.297610 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.297528    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f006530-aef1-40cf-8922-26ad8c96bc1b-cert\") pod \"ingress-canary-dlrgr\" (UID: \"0f006530-aef1-40cf-8922-26ad8c96bc1b\") " pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.297610 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.297571    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnpv\" (UniqueName: \"kubernetes.io/projected/a6236b53-0777-4fb6-ac34-7760b266b16a-kube-api-access-mwnpv\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.297610 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.297598    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb9fm\" (UniqueName: \"kubernetes.io/projected/0f006530-aef1-40cf-8922-26ad8c96bc1b-kube-api-access-rb9fm\") pod \"ingress-canary-dlrgr\" (UID: \"0f006530-aef1-40cf-8922-26ad8c96bc1b\") " pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.297841 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.297686    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6236b53-0777-4fb6-ac34-7760b266b16a-tmp-dir\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.297841 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.297783    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6236b53-0777-4fb6-ac34-7760b266b16a-config-volume\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.297841 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.297813    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.398853 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.398819    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6236b53-0777-4fb6-ac34-7760b266b16a-tmp-dir\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.399033 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.398902    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6236b53-0777-4fb6-ac34-7760b266b16a-config-volume\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.399033 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.398929    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.399033 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.398974    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f006530-aef1-40cf-8922-26ad8c96bc1b-cert\") pod \"ingress-canary-dlrgr\" (UID: \"0f006530-aef1-40cf-8922-26ad8c96bc1b\") " pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.399033 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.398997    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnpv\" (UniqueName: \"kubernetes.io/projected/a6236b53-0777-4fb6-ac34-7760b266b16a-kube-api-access-mwnpv\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.399033 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.399018    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb9fm\" (UniqueName: \"kubernetes.io/projected/0f006530-aef1-40cf-8922-26ad8c96bc1b-kube-api-access-rb9fm\") pod \"ingress-canary-dlrgr\" (UID: \"0f006530-aef1-40cf-8922-26ad8c96bc1b\") " pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.399269 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:33.399124    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:27:33.399269 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:33.399200    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:27:33.899179068 +0000 UTC m=+35.624863342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:27:33.399269 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.399242    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6236b53-0777-4fb6-ac34-7760b266b16a-tmp-dir\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.399552 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.399523    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6236b53-0777-4fb6-ac34-7760b266b16a-config-volume\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.404008 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.403980    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f006530-aef1-40cf-8922-26ad8c96bc1b-cert\") pod \"ingress-canary-dlrgr\" (UID: \"0f006530-aef1-40cf-8922-26ad8c96bc1b\") " pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.413978 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.413951    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb9fm\" (UniqueName: \"kubernetes.io/projected/0f006530-aef1-40cf-8922-26ad8c96bc1b-kube-api-access-rb9fm\") pod \"ingress-canary-dlrgr\" (UID: \"0f006530-aef1-40cf-8922-26ad8c96bc1b\") " pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.414564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.414538    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnpv\" (UniqueName: \"kubernetes.io/projected/a6236b53-0777-4fb6-ac34-7760b266b16a-kube-api-access-mwnpv\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.463650 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.463624    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlrgr"
Jul 30 17:27:33.612022 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.611810    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlrgr"]
Jul 30 17:27:33.616785 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:27:33.616754    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f006530_aef1_40cf_8922_26ad8c96bc1b.slice/crio-07b28e7e5f8ae23678b1f90508f5774633bb1ed679efa7aefe7aa67d9c355d11 WatchSource:0}: Error finding container 07b28e7e5f8ae23678b1f90508f5774633bb1ed679efa7aefe7aa67d9c355d11: Status 404 returned error can't find the container with id 07b28e7e5f8ae23678b1f90508f5774633bb1ed679efa7aefe7aa67d9c355d11
Jul 30 17:27:33.820617 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.820512    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:27:33.820617 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.820559    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:27:33.820814 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.820511    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:27:33.824027 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.823972    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 17:27:33.824027 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.823997    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 17:27:33.824221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.824035    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 17:27:33.824221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.824053    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7qqrb\""
Jul 30 17:27:33.825498 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.825479    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fjwv8\""
Jul 30 17:27:33.825498 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.825488    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 17:27:33.903547 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:33.903524    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:33.903666 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:33.903647    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:27:33.903730 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:33.903718    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:27:34.903702982 +0000 UTC m=+36.629387240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:27:34.067645 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:34.067599    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlrgr" event={"ID":"0f006530-aef1-40cf-8922-26ad8c96bc1b","Type":"ContainerStarted","Data":"07b28e7e5f8ae23678b1f90508f5774633bb1ed679efa7aefe7aa67d9c355d11"}
Jul 30 17:27:34.912130 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:34.912100    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:34.912612 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:34.912235    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:27:34.912612 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:34.912314    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:27:36.912298835 +0000 UTC m=+38.637983092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:27:36.075604 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:36.075564    2538 generic.go:356] "Generic (PLEG): container finished" podID="bcee4279-c4b2-401d-89da-ae7afa063a2b" containerID="a6d93146647cdfabdf0cd0dcbc8c04cb508c592374e187a31b5eace4bbdd0565" exitCode=0
Jul 30 17:27:36.076060 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:36.075635    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerDied","Data":"a6d93146647cdfabdf0cd0dcbc8c04cb508c592374e187a31b5eace4bbdd0565"}
Jul 30 17:27:36.926605 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:36.926572    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:36.926799 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:36.926708    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:27:36.926799 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:36.926764    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:27:40.926750277 +0000 UTC m=+42.652434536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:27:37.083960 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:37.083918    2538 generic.go:356] "Generic (PLEG): container finished" podID="bcee4279-c4b2-401d-89da-ae7afa063a2b" containerID="4cfb0810663abb6e17e98c853de12be89fd87c37f1d72af859c9439f9b618646" exitCode=0
Jul 30 17:27:37.084264 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:37.083994    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerDied","Data":"4cfb0810663abb6e17e98c853de12be89fd87c37f1d72af859c9439f9b618646"}
Jul 30 17:27:38.088870 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:38.088842    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" event={"ID":"bcee4279-c4b2-401d-89da-ae7afa063a2b","Type":"ContainerStarted","Data":"fcdb66712befe2cc5895a727d4deae1034684466ed4210e5509e5b29ed141c42"}
Jul 30 17:27:38.090300 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:38.090276    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlrgr" event={"ID":"0f006530-aef1-40cf-8922-26ad8c96bc1b","Type":"ContainerStarted","Data":"c567a09b13205790b034e1d95687a335cde6bce2a0457bb46624ee3f47dd6d02"}
Jul 30 17:27:38.117224 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:38.117183    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7f9jb" podStartSLOduration=9.173646252 podStartE2EDuration="39.117167415s" totalImagesPullingTime="29.943521163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:38.115354561 +0000 UTC m=+39.841038840" watchObservedRunningTime="2026-07-30 17:27:38.117167415 +0000 UTC m=+39.842851672"
Jul 30 17:27:38.132331 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:38.132288    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dlrgr" podStartSLOduration=1.670605128 podStartE2EDuration="5.132274625s" totalImagesPullingTime="3.461669497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:27:38.131345193 +0000 UTC m=+39.857029486" watchObservedRunningTime="2026-07-30 17:27:38.132274625 +0000 UTC m=+39.857958905"
Jul 30 17:27:40.952633 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:40.952585    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:40.953031 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:40.952725    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:27:40.953031 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:40.952788    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:27:48.952772508 +0000 UTC m=+50.678456766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:27:49.007890 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:27:49.007841    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:27:49.008359 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:49.007989    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:27:49.008359 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:27:49.008066    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:28:05.008048404 +0000 UTC m=+66.733732662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:28:00.065263 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:00.065236    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mt4w6"
Jul 30 17:28:04.441854 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.441822    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"]
Jul 30 17:28:04.444236 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.444219    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.448594 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.448573    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 17:28:04.449862 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.449843    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 17:28:04.449955 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.449929    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 30 17:28:04.449955 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.449945    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fpp8s\""
Jul 30 17:28:04.450068 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.449969    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 17:28:04.468656 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.468636    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"]
Jul 30 17:28:04.501378 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.501357    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f91eda0-549e-4aed-9df7-e2a456300d50-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f696b6c86-9njhq\" (UID: \"4f91eda0-549e-4aed-9df7-e2a456300d50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.501480 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.501385    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:28:04.501480 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.501423    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:28:04.501480 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.501448    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqc6\" (UniqueName: \"kubernetes.io/projected/4f91eda0-549e-4aed-9df7-e2a456300d50-kube-api-access-ncqc6\") pod \"managed-serviceaccount-addon-agent-5f696b6c86-9njhq\" (UID: \"4f91eda0-549e-4aed-9df7-e2a456300d50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.504236 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.504219    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 17:28:04.504352 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.504335    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 17:28:04.511667 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:28:04.511647    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 17:28:04.511719 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:28:04.511708    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:29:08.511693802 +0000 UTC m=+130.237378061 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : secret "metrics-daemon-secret" not found
Jul 30 17:28:04.515139 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.515123    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5017c50-4a74-45ad-8f74-259e8bbb2eca-original-pull-secret\") pod \"global-pull-secret-syncer-6g9p2\" (UID: \"e5017c50-4a74-45ad-8f74-259e8bbb2eca\") " pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:28:04.602545 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.602512    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:28:04.602629 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.602557    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqc6\" (UniqueName: \"kubernetes.io/projected/4f91eda0-549e-4aed-9df7-e2a456300d50-kube-api-access-ncqc6\") pod \"managed-serviceaccount-addon-agent-5f696b6c86-9njhq\" (UID: \"4f91eda0-549e-4aed-9df7-e2a456300d50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.602629 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.602592    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f91eda0-549e-4aed-9df7-e2a456300d50-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f696b6c86-9njhq\" (UID: \"4f91eda0-549e-4aed-9df7-e2a456300d50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.604627 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.604608    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f91eda0-549e-4aed-9df7-e2a456300d50-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f696b6c86-9njhq\" (UID: \"4f91eda0-549e-4aed-9df7-e2a456300d50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.605754 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.605741    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 17:28:04.611855 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.611834    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqc6\" (UniqueName: \"kubernetes.io/projected/4f91eda0-549e-4aed-9df7-e2a456300d50-kube-api-access-ncqc6\") pod \"managed-serviceaccount-addon-agent-5f696b6c86-9njhq\" (UID: \"4f91eda0-549e-4aed-9df7-e2a456300d50\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.616527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.616513    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 17:28:04.625767 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.625742    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22x2\" (UniqueName: \"kubernetes.io/projected/23d95737-cafe-45d3-9637-6d45958286e4-kube-api-access-l22x2\") pod \"network-check-target-hcqvh\" (UID: \"23d95737-cafe-45d3-9637-6d45958286e4\") " pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:28:04.732994 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.732978    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g9p2"
Jul 30 17:28:04.748769 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.748750    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7qqrb\""
Jul 30 17:28:04.756270 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.756252    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:28:04.762543 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.762526    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"
Jul 30 17:28:04.877221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.877192    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6g9p2"]
Jul 30 17:28:04.880710 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:28:04.880674    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5017c50_4a74_45ad_8f74_259e8bbb2eca.slice/crio-b8f2406f32d4eb40ed26410c9d667f915d3f094a994b1f51c85344d76a018017 WatchSource:0}: Error finding container b8f2406f32d4eb40ed26410c9d667f915d3f094a994b1f51c85344d76a018017: Status 404 returned error can't find the container with id b8f2406f32d4eb40ed26410c9d667f915d3f094a994b1f51c85344d76a018017
Jul 30 17:28:04.899126 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.899096    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcqvh"]
Jul 30 17:28:04.902222 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:28:04.902185    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d95737_cafe_45d3_9637_6d45958286e4.slice/crio-852040e42b91e311f41cc0210d1ca3ca5e86713dc99ac97367dcf21fedf4d6fb WatchSource:0}: Error finding container 852040e42b91e311f41cc0210d1ca3ca5e86713dc99ac97367dcf21fedf4d6fb: Status 404 returned error can't find the container with id 852040e42b91e311f41cc0210d1ca3ca5e86713dc99ac97367dcf21fedf4d6fb
Jul 30 17:28:04.919923 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:04.919902    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq"]
Jul 30 17:28:04.922514 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:28:04.922490    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f91eda0_549e_4aed_9df7_e2a456300d50.slice/crio-405a0c3d5f5365b14056b558432fb75f20a97bbdd146191b3bd22b97ec2b46b3 WatchSource:0}: Error finding container 405a0c3d5f5365b14056b558432fb75f20a97bbdd146191b3bd22b97ec2b46b3: Status 404 returned error can't find the container with id 405a0c3d5f5365b14056b558432fb75f20a97bbdd146191b3bd22b97ec2b46b3
Jul 30 17:28:05.107195 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:05.107131    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:28:05.107312 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:28:05.107235    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:28:05.107312 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:28:05.107281    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:28:37.107268656 +0000 UTC m=+98.832952914 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:28:05.155803 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:05.155768    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq" event={"ID":"4f91eda0-549e-4aed-9df7-e2a456300d50","Type":"ContainerStarted","Data":"405a0c3d5f5365b14056b558432fb75f20a97bbdd146191b3bd22b97ec2b46b3"}
Jul 30 17:28:05.156808 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:05.156785    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6g9p2" event={"ID":"e5017c50-4a74-45ad-8f74-259e8bbb2eca","Type":"ContainerStarted","Data":"b8f2406f32d4eb40ed26410c9d667f915d3f094a994b1f51c85344d76a018017"}
Jul 30 17:28:05.157808 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:05.157789    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcqvh" event={"ID":"23d95737-cafe-45d3-9637-6d45958286e4","Type":"ContainerStarted","Data":"852040e42b91e311f41cc0210d1ca3ca5e86713dc99ac97367dcf21fedf4d6fb"}
Jul 30 17:28:11.175210 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.175173    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcqvh" event={"ID":"23d95737-cafe-45d3-9637-6d45958286e4","Type":"ContainerStarted","Data":"347f5980e25e1a0c10da1049b94a90ec2677b74ab81db1bcde713625b108aa41"}
Jul 30 17:28:11.175651 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.175285    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:28:11.176625 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.176603    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq" event={"ID":"4f91eda0-549e-4aed-9df7-e2a456300d50","Type":"ContainerStarted","Data":"7bb33eb2bdcf4fbe2ac88687be5f1281bad8fc2e51f32dd321f9fb10d6b4898b"}
Jul 30 17:28:11.177849 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.177830    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6g9p2" event={"ID":"e5017c50-4a74-45ad-8f74-259e8bbb2eca","Type":"ContainerStarted","Data":"4ad37a7da1e934a39a944cbc423f2f7087f7fe89d121992651a732251c3724a7"}
Jul 30 17:28:11.202292 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.202257    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hcqvh" podStartSLOduration=66.670455137 podStartE2EDuration="1m12.202244695s" totalImagesPullingTime="5.531789558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:28:11.200680833 +0000 UTC m=+72.926365113" watchObservedRunningTime="2026-07-30 17:28:11.202244695 +0000 UTC m=+72.927928974"
Jul 30 17:28:11.222765 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.222729    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6g9p2" podStartSLOduration=66.665181305 podStartE2EDuration="1m12.222718304s" totalImagesPullingTime="5.557536999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:28:11.222171518 +0000 UTC m=+72.947855798" watchObservedRunningTime="2026-07-30 17:28:11.222718304 +0000 UTC m=+72.948402561"
Jul 30 17:28:11.245095 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:11.245056    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq" podStartSLOduration=1.74210924 podStartE2EDuration="7.245045488s" totalImagesPullingTime="5.502936248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:28:11.244958408 +0000 UTC m=+72.970642679" watchObservedRunningTime="2026-07-30 17:28:11.245045488 +0000 UTC m=+72.970729767"
Jul 30 17:28:37.116260 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:37.116142    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:28:37.116260 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:28:37.116260    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:28:37.116784 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:28:37.116309    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:29:41.116294822 +0000 UTC m=+162.841979080 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:28:42.182653 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:28:42.182620    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hcqvh"
Jul 30 17:29:08.520779 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:29:08.520728    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:29:08.521313 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:29:08.520853    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 17:29:08.521313 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:29:08.520935    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:10.520915283 +0000 UTC m=+252.246599546 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : secret "metrics-daemon-secret" not found
Jul 30 17:29:36.157422 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:29:36.157376    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sdtrv" podUID="a6236b53-0777-4fb6-ac34-7760b266b16a"
Jul 30 17:29:36.381141 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:29:36.381110    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:29:36.839551 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:29:36.839512    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:29:41.133766 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:29:41.133731    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:29:41.134254 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:29:41.133856    2538 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 17:29:41.134254 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:29:41.133927    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls podName:a6236b53-0777-4fb6-ac34-7760b266b16a nodeName:}" failed. No retries permitted until 2026-07-30 17:31:43.133908888 +0000 UTC m=+284.859593149 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls") pod "dns-default-sdtrv" (UID: "a6236b53-0777-4fb6-ac34-7760b266b16a") : secret "dns-default-metrics-tls" not found
Jul 30 17:29:50.820860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:29:50.820771    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:30:11.464481 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:30:11.464443    2538 generic.go:356] "Generic (PLEG): container finished" podID="4f91eda0-549e-4aed-9df7-e2a456300d50" containerID="7bb33eb2bdcf4fbe2ac88687be5f1281bad8fc2e51f32dd321f9fb10d6b4898b" exitCode=255
Jul 30 17:30:11.465004 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:30:11.464501    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq" event={"ID":"4f91eda0-549e-4aed-9df7-e2a456300d50","Type":"ContainerDied","Data":"7bb33eb2bdcf4fbe2ac88687be5f1281bad8fc2e51f32dd321f9fb10d6b4898b"}
Jul 30 17:30:11.470084 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:30:11.470065    2538 scope.go:117] "RemoveContainer" containerID="7bb33eb2bdcf4fbe2ac88687be5f1281bad8fc2e51f32dd321f9fb10d6b4898b"
Jul 30 17:30:12.468246 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:30:12.468214    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f696b6c86-9njhq" event={"ID":"4f91eda0-549e-4aed-9df7-e2a456300d50","Type":"ContainerStarted","Data":"6bf2427f65ecf5103f2d3b48c279c4c3f57f2d0a9e9372376d87b97216d93dee"}
Jul 30 17:31:10.611808 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:10.611773    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:31:10.612271 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:10.611932    2538 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 17:31:10.612271 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:10.611991    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs podName:d8257104-65fb-40c9-817d-51d1aa9987b0 nodeName:}" failed. No retries permitted until 2026-07-30 17:33:12.611975667 +0000 UTC m=+374.337659925 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs") pod "network-metrics-daemon-spq6s" (UID: "d8257104-65fb-40c9-817d-51d1aa9987b0") : secret "metrics-daemon-secret" not found
Jul 30 17:31:12.313548 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.313515    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"]
Jul 30 17:31:12.316287 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.316265    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:12.321569 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.321544    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d8l6c\""
Jul 30 17:31:12.322154 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.321791    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 17:31:12.322724 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.322703    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:31:12.322843 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.322824    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 17:31:12.324463 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.324443    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"]
Jul 30 17:31:12.326186 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.326167    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.326550 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.326530    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"]
Jul 30 17:31:12.328221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.328205    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"]
Jul 30 17:31:12.328400 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.328385    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.329389 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.329368    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 17:31:12.329481 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.329425    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qwmnp\""
Jul 30 17:31:12.329540 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.329513    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 17:31:12.329596 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.329369    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 17:31:12.329924 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.329906    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:31:12.330303 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.330288    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"]
Jul 30 17:31:12.330398 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.330386    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.331315 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.331291    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 17:31:12.332788 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.332768    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 17:31:12.332908 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.332831    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 17:31:12.332908 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.332849    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 17:31:12.332908 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.332890    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mpdqr\""
Jul 30 17:31:12.333075 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.332781    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 17:31:12.333344 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.333323    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:31:12.333344 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.333340    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 17:31:12.334167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.334151    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-289hh\""
Jul 30 17:31:12.334167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.334161    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 17:31:12.341547 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.341528    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"]
Jul 30 17:31:12.345862 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.345801    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"]
Jul 30 17:31:12.348753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.348735    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"]
Jul 30 17:31:12.414203 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.412312    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"]
Jul 30 17:31:12.416039 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.416017    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"
Jul 30 17:31:12.416492 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.416471    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c46f99c76-xpqxs"]
Jul 30 17:31:12.418089 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.418071    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l4bg4"]
Jul 30 17:31:12.418187 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.418176    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.418797 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.418780    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 17:31:12.418903 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.418844    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fcbgz\""
Jul 30 17:31:12.418957 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.418896    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:31:12.419764 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.419749    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"]
Jul 30 17:31:12.419950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.419931    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.420860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.420830    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 17:31:12.421207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.421188    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 17:31:12.421814 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.421799    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"
Jul 30 17:31:12.422249 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.422236    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bns8l\""
Jul 30 17:31:12.422564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.422549    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 17:31:12.422992 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.422978    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bv7zq\""
Jul 30 17:31:12.423066 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423025    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-config\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.423123 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423085    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.423167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423121    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.423167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423146    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d450d29-2fd9-43f9-82be-fe0ba8030a77-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.423240 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423182    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-482f5\" (UniqueName: \"kubernetes.io/projected/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-kube-api-access-482f5\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.423279 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423255    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx5n5\" (UniqueName: \"kubernetes.io/projected/1d450d29-2fd9-43f9-82be-fe0ba8030a77-kube-api-access-sx5n5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.423320 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423300    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whtb9\" (UniqueName: \"kubernetes.io/projected/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-kube-api-access-whtb9\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.423361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423326    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d450d29-2fd9-43f9-82be-fe0ba8030a77-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.423361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423352    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:12.423451 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423390    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-serving-cert\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.423451 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423416    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtpz\" (UniqueName: \"kubernetes.io/projected/f4103753-2f34-4c28-b64e-b6fa313efea2-kube-api-access-2wtpz\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:12.423886 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423843    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 17:31:12.423959 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.423896    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 17:31:12.424108 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.424087    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 17:31:12.424295 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.424275    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:31:12.426384 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.426364    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4dl67\""
Jul 30 17:31:12.430361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.429697    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"]
Jul 30 17:31:12.430361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.429802    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 17:31:12.432643 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.432626    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 17:31:12.433826 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.433806    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l4bg4"]
Jul 30 17:31:12.444691 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.444670    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c46f99c76-xpqxs"]
Jul 30 17:31:12.454753 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.454733    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"]
Jul 30 17:31:12.523814 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.523785    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whtb9\" (UniqueName: \"kubernetes.io/projected/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-kube-api-access-whtb9\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.524014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.523824    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3481d49e-047e-48b7-829a-8aed400c2b9b-ca-trust-extracted\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.523865    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.523905    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-config\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.524014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.523957    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxkgp\" (UniqueName: \"kubernetes.io/projected/70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c-kube-api-access-wxkgp\") pod \"network-check-source-7d88cb55d8-q69pz\" (UID: \"70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"
Jul 30 17:31:12.524014 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.523994    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/914923c1-dbde-401a-97f8-f63444f8fed5-config\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524016    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524042    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d450d29-2fd9-43f9-82be-fe0ba8030a77-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524061    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-482f5\" (UniqueName: \"kubernetes.io/projected/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-kube-api-access-482f5\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524084    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqn4m\" (UniqueName: \"kubernetes.io/projected/fc2787c0-180b-4b79-868d-302480799706-kube-api-access-mqn4m\") pod \"volume-data-source-validator-549c6d54cf-bzctf\" (UID: \"fc2787c0-180b-4b79-868d-302480799706\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524103    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-bound-sa-token\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524138    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d450d29-2fd9-43f9-82be-fe0ba8030a77-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524155    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524171    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-certificates\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524207    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdkpp\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-kube-api-access-kdkpp\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524289 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.524265    2538 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.524329    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls podName:f4103753-2f34-4c28-b64e-b6fa313efea2 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:13.024306428 +0000 UTC m=+254.749990687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls") pod "cluster-samples-operator-6748489656-wc9cp" (UID: "f4103753-2f34-4c28-b64e-b6fa313efea2") : secret "samples-operator-tls" not found
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524431    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-installation-pull-secrets\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524464    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/914923c1-dbde-401a-97f8-f63444f8fed5-trusted-ca\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524499    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-serving-cert\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524536    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtpz\" (UniqueName: \"kubernetes.io/projected/f4103753-2f34-4c28-b64e-b6fa313efea2-kube-api-access-2wtpz\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524536    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-config\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524675    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/914923c1-dbde-401a-97f8-f63444f8fed5-serving-cert\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524724    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-image-registry-private-configuration\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524751    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d450d29-2fd9-43f9-82be-fe0ba8030a77-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.524759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524754    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-trusted-ca\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.525143 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524796    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.525143 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524826    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7sn\" (UniqueName: \"kubernetes.io/projected/914923c1-dbde-401a-97f8-f63444f8fed5-kube-api-access-tx7sn\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.525143 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.524852    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx5n5\" (UniqueName: \"kubernetes.io/projected/1d450d29-2fd9-43f9-82be-fe0ba8030a77-kube-api-access-sx5n5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.525143 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.524912    2538 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:12.525143 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.525028    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.525143 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.525044    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls podName:5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb nodeName:}" failed. No retries permitted until 2026-07-30 17:31:13.025024699 +0000 UTC m=+254.750708958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wp68z" (UID: "5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:12.526357 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.526341    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d450d29-2fd9-43f9-82be-fe0ba8030a77-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.526542 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.526527    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-serving-cert\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.534339 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.534308    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whtb9\" (UniqueName: \"kubernetes.io/projected/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-kube-api-access-whtb9\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:12.534552 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.534534    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx5n5\" (UniqueName: \"kubernetes.io/projected/1d450d29-2fd9-43f9-82be-fe0ba8030a77-kube-api-access-sx5n5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6\" (UID: \"1d450d29-2fd9-43f9-82be-fe0ba8030a77\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.535006 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.534983    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtpz\" (UniqueName: \"kubernetes.io/projected/f4103753-2f34-4c28-b64e-b6fa313efea2-kube-api-access-2wtpz\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:12.535061 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.535044    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-482f5\" (UniqueName: \"kubernetes.io/projected/c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3-kube-api-access-482f5\") pod \"service-ca-operator-5d6c75f84f-prbgl\" (UID: \"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.625916 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625836    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqn4m\" (UniqueName: \"kubernetes.io/projected/fc2787c0-180b-4b79-868d-302480799706-kube-api-access-mqn4m\") pod \"volume-data-source-validator-549c6d54cf-bzctf\" (UID: \"fc2787c0-180b-4b79-868d-302480799706\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"
Jul 30 17:31:12.625916 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625863    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-bound-sa-token\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.625916 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625910    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-certificates\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625926    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdkpp\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-kube-api-access-kdkpp\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625943    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-installation-pull-secrets\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625958    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/914923c1-dbde-401a-97f8-f63444f8fed5-trusted-ca\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.625982    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/914923c1-dbde-401a-97f8-f63444f8fed5-serving-cert\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626007    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-image-registry-private-configuration\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626033    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-trusted-ca\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626076    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7sn\" (UniqueName: \"kubernetes.io/projected/914923c1-dbde-401a-97f8-f63444f8fed5-kube-api-access-tx7sn\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.626127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626117    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3481d49e-047e-48b7-829a-8aed400c2b9b-ca-trust-extracted\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626492 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626425    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626492 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626465    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxkgp\" (UniqueName: \"kubernetes.io/projected/70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c-kube-api-access-wxkgp\") pod \"network-check-source-7d88cb55d8-q69pz\" (UID: \"70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"
Jul 30 17:31:12.626608 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626492    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/914923c1-dbde-401a-97f8-f63444f8fed5-config\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.626608 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626581    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3481d49e-047e-48b7-829a-8aed400c2b9b-ca-trust-extracted\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626703 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.626639    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-certificates\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.626703 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.626693    2538 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:31:12.626800 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.626709    2538 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c46f99c76-xpqxs: secret "image-registry-tls" not found
Jul 30 17:31:12.626800 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:12.626770    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls podName:3481d49e-047e-48b7-829a-8aed400c2b9b nodeName:}" failed. No retries permitted until 2026-07-30 17:31:13.126750903 +0000 UTC m=+254.852435177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls") pod "image-registry-7c46f99c76-xpqxs" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b") : secret "image-registry-tls" not found
Jul 30 17:31:12.627169 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.627146    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/914923c1-dbde-401a-97f8-f63444f8fed5-config\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.627299 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.627278    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/914923c1-dbde-401a-97f8-f63444f8fed5-trusted-ca\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.627598 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.627578    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-trusted-ca\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.628431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.628402    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/914923c1-dbde-401a-97f8-f63444f8fed5-serving-cert\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.628546 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.628528    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-installation-pull-secrets\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.628715 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.628694    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-image-registry-private-configuration\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.635079 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.635057    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqn4m\" (UniqueName: \"kubernetes.io/projected/fc2787c0-180b-4b79-868d-302480799706-kube-api-access-mqn4m\") pod \"volume-data-source-validator-549c6d54cf-bzctf\" (UID: \"fc2787c0-180b-4b79-868d-302480799706\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"
Jul 30 17:31:12.635253 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.635234    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-bound-sa-token\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.635379 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.635364    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdkpp\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-kube-api-access-kdkpp\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:12.635499 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.635476    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7sn\" (UniqueName: \"kubernetes.io/projected/914923c1-dbde-401a-97f8-f63444f8fed5-kube-api-access-tx7sn\") pod \"console-operator-584dcb6b54-l4bg4\" (UID: \"914923c1-dbde-401a-97f8-f63444f8fed5\") " pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.636097 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.636082    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxkgp\" (UniqueName: \"kubernetes.io/projected/70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c-kube-api-access-wxkgp\") pod \"network-check-source-7d88cb55d8-q69pz\" (UID: \"70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"
Jul 30 17:31:12.636848 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.636831    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"
Jul 30 17:31:12.649303 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.649283    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"
Jul 30 17:31:12.726403 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.726330    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"
Jul 30 17:31:12.740012 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.739987    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:12.745898 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.745689    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"
Jul 30 17:31:12.766596 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.766576    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6"]
Jul 30 17:31:12.770650 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:12.770620    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d450d29_2fd9_43f9_82be_fe0ba8030a77.slice/crio-ba935aa21817a8ee996c7ba0a4a42a857aeda79a5dd24b9d14f2958d299d8040 WatchSource:0}: Error finding container ba935aa21817a8ee996c7ba0a4a42a857aeda79a5dd24b9d14f2958d299d8040: Status 404 returned error can't find the container with id ba935aa21817a8ee996c7ba0a4a42a857aeda79a5dd24b9d14f2958d299d8040
Jul 30 17:31:12.784232 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.782905    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl"]
Jul 30 17:31:12.786265 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:12.786234    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c630ea_6a7d_4a49_b6d4_8c032cf0efc3.slice/crio-b80f4f0b8d90d688260a5e4e2e9d9f3dcfe39f2f5ecf03bc598c34b66c0357a6 WatchSource:0}: Error finding container b80f4f0b8d90d688260a5e4e2e9d9f3dcfe39f2f5ecf03bc598c34b66c0357a6: Status 404 returned error can't find the container with id b80f4f0b8d90d688260a5e4e2e9d9f3dcfe39f2f5ecf03bc598c34b66c0357a6
Jul 30 17:31:12.870715 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:12.870686    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf"]
Jul 30 17:31:12.873801 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:12.873770    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2787c0_180b_4b79_868d_302480799706.slice/crio-472bcec458a8f4faa7f4d9713ebfcc7585919ed29452f87b66fcc9495d512d0a WatchSource:0}: Error finding container 472bcec458a8f4faa7f4d9713ebfcc7585919ed29452f87b66fcc9495d512d0a: Status 404 returned error can't find the container with id 472bcec458a8f4faa7f4d9713ebfcc7585919ed29452f87b66fcc9495d512d0a
Jul 30 17:31:13.030289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.030254    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:13.030477 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.030306    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:13.030477 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.030416    2538 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:31:13.030556 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.030487    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls podName:f4103753-2f34-4c28-b64e-b6fa313efea2 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:14.030471726 +0000 UTC m=+255.756155985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls") pod "cluster-samples-operator-6748489656-wc9cp" (UID: "f4103753-2f34-4c28-b64e-b6fa313efea2") : secret "samples-operator-tls" not found
Jul 30 17:31:13.030556 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.030424    2538 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:13.030556 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.030552    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls podName:5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb nodeName:}" failed. No retries permitted until 2026-07-30 17:31:14.030540313 +0000 UTC m=+255.756224571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wp68z" (UID: "5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:13.095815 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.095772    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz"]
Jul 30 17:31:13.097952 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.097925    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l4bg4"]
Jul 30 17:31:13.098820 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:13.098802    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ef32a7_a98d_4369_a0e8_58c4b0ecbc4c.slice/crio-733a5b9c65549ed786d5cd36e1bb1d860ff7a160d1ee116cda41503f2393bbc2 WatchSource:0}: Error finding container 733a5b9c65549ed786d5cd36e1bb1d860ff7a160d1ee116cda41503f2393bbc2: Status 404 returned error can't find the container with id 733a5b9c65549ed786d5cd36e1bb1d860ff7a160d1ee116cda41503f2393bbc2
Jul 30 17:31:13.100599 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:13.100576    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914923c1_dbde_401a_97f8_f63444f8fed5.slice/crio-b82a4aad74b02118d71a9ad79b7dffe0f74219b907833c593fdb61da3fa5df71 WatchSource:0}: Error finding container b82a4aad74b02118d71a9ad79b7dffe0f74219b907833c593fdb61da3fa5df71: Status 404 returned error can't find the container with id b82a4aad74b02118d71a9ad79b7dffe0f74219b907833c593fdb61da3fa5df71
Jul 30 17:31:13.131281 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.131152    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:13.131367 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.131299    2538 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:31:13.131367 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.131341    2538 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c46f99c76-xpqxs: secret "image-registry-tls" not found
Jul 30 17:31:13.131450 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:13.131414    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls podName:3481d49e-047e-48b7-829a-8aed400c2b9b nodeName:}" failed. No retries permitted until 2026-07-30 17:31:14.131391653 +0000 UTC m=+255.857075925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls") pod "image-registry-7c46f99c76-xpqxs" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b") : secret "image-registry-tls" not found
Jul 30 17:31:13.620592 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.620490    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" event={"ID":"914923c1-dbde-401a-97f8-f63444f8fed5","Type":"ContainerStarted","Data":"b82a4aad74b02118d71a9ad79b7dffe0f74219b907833c593fdb61da3fa5df71"}
Jul 30 17:31:13.622002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.621976    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf" event={"ID":"fc2787c0-180b-4b79-868d-302480799706","Type":"ContainerStarted","Data":"472bcec458a8f4faa7f4d9713ebfcc7585919ed29452f87b66fcc9495d512d0a"}
Jul 30 17:31:13.623341 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.623316    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6" event={"ID":"1d450d29-2fd9-43f9-82be-fe0ba8030a77","Type":"ContainerStarted","Data":"ba935aa21817a8ee996c7ba0a4a42a857aeda79a5dd24b9d14f2958d299d8040"}
Jul 30 17:31:13.624723 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.624699    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl" event={"ID":"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3","Type":"ContainerStarted","Data":"b80f4f0b8d90d688260a5e4e2e9d9f3dcfe39f2f5ecf03bc598c34b66c0357a6"}
Jul 30 17:31:13.626424 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.626401    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz" event={"ID":"70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c","Type":"ContainerStarted","Data":"3e502cd9f8d01879fbbc10e4284524f1f4ab72114e6ce7287e6f6c2a4a8ac5e6"}
Jul 30 17:31:13.626527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.626440    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz" event={"ID":"70ef32a7-a98d-4369-a0e8-58c4b0ecbc4c","Type":"ContainerStarted","Data":"733a5b9c65549ed786d5cd36e1bb1d860ff7a160d1ee116cda41503f2393bbc2"}
Jul 30 17:31:13.646383 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:13.646327    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-q69pz" podStartSLOduration=1.6463113900000002 podStartE2EDuration="1.64631139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:13.644376657 +0000 UTC m=+255.370060952" watchObservedRunningTime="2026-07-30 17:31:13.64631139 +0000 UTC m=+255.371995671"
Jul 30 17:31:14.042296 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:14.041657    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:14.042296 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:14.041726    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:14.042296 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.041850    2538 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:14.042296 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.041853    2538 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:31:14.042296 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.041931    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls podName:5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb nodeName:}" failed. No retries permitted until 2026-07-30 17:31:16.04191072 +0000 UTC m=+257.767594984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wp68z" (UID: "5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:14.042296 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.041951    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls podName:f4103753-2f34-4c28-b64e-b6fa313efea2 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:16.041940948 +0000 UTC m=+257.767625208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls") pod "cluster-samples-operator-6748489656-wc9cp" (UID: "f4103753-2f34-4c28-b64e-b6fa313efea2") : secret "samples-operator-tls" not found
Jul 30 17:31:14.142530 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:14.142318    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:14.142530 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.142495    2538 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:31:14.142530 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.142520    2538 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c46f99c76-xpqxs: secret "image-registry-tls" not found
Jul 30 17:31:14.142806 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:14.142580    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls podName:3481d49e-047e-48b7-829a-8aed400c2b9b nodeName:}" failed. No retries permitted until 2026-07-30 17:31:16.142562729 +0000 UTC m=+257.868247002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls") pod "image-registry-7c46f99c76-xpqxs" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b") : secret "image-registry-tls" not found
Jul 30 17:31:14.632783 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:14.632436    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf" event={"ID":"fc2787c0-180b-4b79-868d-302480799706","Type":"ContainerStarted","Data":"a91f3603f139435cf095f68f1f011cb859de5a24fa9e9cc300787af159a2961f"}
Jul 30 17:31:14.649309 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:14.649256    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-bzctf" podStartSLOduration=1.312181255 podStartE2EDuration="2.649234213s" totalImagesPullingTime="1.337052958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:14.647449349 +0000 UTC m=+256.373133645" watchObservedRunningTime="2026-07-30 17:31:14.649234213 +0000 UTC m=+256.374918474"
Jul 30 17:31:16.059441 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.059350    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:16.059760 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.059462    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:16.059760 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.059584    2538 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:31:16.059760 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.059660    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls podName:f4103753-2f34-4c28-b64e-b6fa313efea2 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:20.059644054 +0000 UTC m=+261.785328317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls") pod "cluster-samples-operator-6748489656-wc9cp" (UID: "f4103753-2f34-4c28-b64e-b6fa313efea2") : secret "samples-operator-tls" not found
Jul 30 17:31:16.059760 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.059699    2538 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:16.060052 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.059768    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls podName:5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb nodeName:}" failed. No retries permitted until 2026-07-30 17:31:20.059750555 +0000 UTC m=+261.785434827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wp68z" (UID: "5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:16.160164 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.160135    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:16.160352 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.160281    2538 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:31:16.160352 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.160296    2538 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c46f99c76-xpqxs: secret "image-registry-tls" not found
Jul 30 17:31:16.160352 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.160341    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls podName:3481d49e-047e-48b7-829a-8aed400c2b9b nodeName:}" failed. No retries permitted until 2026-07-30 17:31:20.160323809 +0000 UTC m=+261.886008076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls") pod "image-registry-7c46f99c76-xpqxs" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b") : secret "image-registry-tls" not found
Jul 30 17:31:16.493833 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.493804    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k894c"]
Jul 30 17:31:16.495933 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.495917    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.499405 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.499383    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 17:31:16.499525 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.499492    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 17:31:16.500431 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.500403    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85bdp\""
Jul 30 17:31:16.500521 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.500451    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 17:31:16.500521 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.500458    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 17:31:16.511362 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.511335    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k894c"]
Jul 30 17:31:16.562495 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.562473    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4e3c96-4928-4da3-a629-065e09c3f9f9-data-volume\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.562606 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.562540    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhml4\" (UniqueName: \"kubernetes.io/projected/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-api-access-qhml4\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.562606 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.562582    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.562732 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.562615    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.562732 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.562643    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe4e3c96-4928-4da3-a629-065e09c3f9f9-crio-socket\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.640901 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.640865    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/0.log"
Jul 30 17:31:16.641008 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.640918    2538 generic.go:356] "Generic (PLEG): container finished" podID="914923c1-dbde-401a-97f8-f63444f8fed5" containerID="345c2b1e6f945011fb21f9a274ddbbacd1f6be848dcce6759e35d7081dab74e5" exitCode=255
Jul 30 17:31:16.641069 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.641004    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" event={"ID":"914923c1-dbde-401a-97f8-f63444f8fed5","Type":"ContainerDied","Data":"345c2b1e6f945011fb21f9a274ddbbacd1f6be848dcce6759e35d7081dab74e5"}
Jul 30 17:31:16.641178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.641164    2538 scope.go:117] "RemoveContainer" containerID="345c2b1e6f945011fb21f9a274ddbbacd1f6be848dcce6759e35d7081dab74e5"
Jul 30 17:31:16.642629 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.642604    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6" event={"ID":"1d450d29-2fd9-43f9-82be-fe0ba8030a77","Type":"ContainerStarted","Data":"4feb46bed58d83daffaabb58bda4e2dfbbf4ab526136a6e35b89cbd3f42cef4f"}
Jul 30 17:31:16.644105 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.644086    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl" event={"ID":"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3","Type":"ContainerStarted","Data":"7336a3a560a3048b09e8ff18eb9a0b763493be8121d731b879090c7dff335f7b"}
Jul 30 17:31:16.663684 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.663653    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4e3c96-4928-4da3-a629-065e09c3f9f9-data-volume\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.663805 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.663785    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhml4\" (UniqueName: \"kubernetes.io/projected/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-api-access-qhml4\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.663891 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.663835    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.663946 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.663887    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.663946 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.663924    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe4e3c96-4928-4da3-a629-065e09c3f9f9-crio-socket\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.664046 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.664027    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe4e3c96-4928-4da3-a629-065e09c3f9f9-crio-socket\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.664357 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.664335    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe4e3c96-4928-4da3-a629-065e09c3f9f9-data-volume\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.664686 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.664666    2538 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:31:16.664767 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.664747    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:17.164723272 +0000 UTC m=+258.890407550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : configmap "kube-rbac-proxy" not found
Jul 30 17:31:16.665064 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.665045    2538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:16.665151 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:16.665112    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:17.165087402 +0000 UTC m=+258.890771660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:16.672266 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.672243    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhml4\" (UniqueName: \"kubernetes.io/projected/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-api-access-qhml4\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:16.676045 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.676000    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl" podStartSLOduration=1.38404927 podStartE2EDuration="4.675984469s" totalImagesPullingTime="3.291935199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:16.674328978 +0000 UTC m=+258.400013259" watchObservedRunningTime="2026-07-30 17:31:16.675984469 +0000 UTC m=+258.401668751"
Jul 30 17:31:16.690127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:16.690091    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6" podStartSLOduration=1.388824386 podStartE2EDuration="4.690078993s" totalImagesPullingTime="3.301254607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:16.69002985 +0000 UTC m=+258.415714127" watchObservedRunningTime="2026-07-30 17:31:16.690078993 +0000 UTC m=+258.415763305"
Jul 30 17:31:17.167925 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.167868    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:17.167925 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.167935    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:17.168364 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:17.167997    2538 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:31:17.168364 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:17.168072    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:18.16805215 +0000 UTC m=+259.893736412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : configmap "kube-rbac-proxy" not found
Jul 30 17:31:17.168364 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:17.168110    2538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:17.168364 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:17.168207    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:18.168186652 +0000 UTC m=+259.893870924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:17.466979 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.466950    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"]
Jul 30 17:31:17.469221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.469198    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"
Jul 30 17:31:17.472551 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.472524    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 17:31:17.473307 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.473290    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 17:31:17.473398 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.473353    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-t89g8\""
Jul 30 17:31:17.480221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.480198    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"]
Jul 30 17:31:17.571531 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.571502    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskcl\" (UniqueName: \"kubernetes.io/projected/0bcfd972-babc-46bd-ae74-d3b92d8e9ad7-kube-api-access-lskcl\") pod \"migrator-6865c9967-6qt2c\" (UID: \"0bcfd972-babc-46bd-ae74-d3b92d8e9ad7\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"
Jul 30 17:31:17.648772 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.648749    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/1.log"
Jul 30 17:31:17.649181 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.649167    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/0.log"
Jul 30 17:31:17.649262 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.649198    2538 generic.go:356] "Generic (PLEG): container finished" podID="914923c1-dbde-401a-97f8-f63444f8fed5" containerID="6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd" exitCode=255
Jul 30 17:31:17.649311 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.649271    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" event={"ID":"914923c1-dbde-401a-97f8-f63444f8fed5","Type":"ContainerDied","Data":"6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd"}
Jul 30 17:31:17.649352 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.649312    2538 scope.go:117] "RemoveContainer" containerID="345c2b1e6f945011fb21f9a274ddbbacd1f6be848dcce6759e35d7081dab74e5"
Jul 30 17:31:17.649588 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.649569    2538 scope.go:117] "RemoveContainer" containerID="6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd"
Jul 30 17:31:17.649804 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:17.649787    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l4bg4_openshift-console-operator(914923c1-dbde-401a-97f8-f63444f8fed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5"
Jul 30 17:31:17.672538 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.672517    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskcl\" (UniqueName: \"kubernetes.io/projected/0bcfd972-babc-46bd-ae74-d3b92d8e9ad7-kube-api-access-lskcl\") pod \"migrator-6865c9967-6qt2c\" (UID: \"0bcfd972-babc-46bd-ae74-d3b92d8e9ad7\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"
Jul 30 17:31:17.681559 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.681541    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskcl\" (UniqueName: \"kubernetes.io/projected/0bcfd972-babc-46bd-ae74-d3b92d8e9ad7-kube-api-access-lskcl\") pod \"migrator-6865c9967-6qt2c\" (UID: \"0bcfd972-babc-46bd-ae74-d3b92d8e9ad7\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"
Jul 30 17:31:17.779144 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.779085    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"
Jul 30 17:31:17.898270 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:17.898237    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c"]
Jul 30 17:31:17.900436 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:17.900412    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcfd972_babc_46bd_ae74_d3b92d8e9ad7.slice/crio-3a145baa18689f5ea790f9b400a7f869da76581c58bee807faa1b31ee7fec0aa WatchSource:0}: Error finding container 3a145baa18689f5ea790f9b400a7f869da76581c58bee807faa1b31ee7fec0aa: Status 404 returned error can't find the container with id 3a145baa18689f5ea790f9b400a7f869da76581c58bee807faa1b31ee7fec0aa
Jul 30 17:31:18.177742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:18.177666    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:18.177742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:18.177700    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:18.178198 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:18.177798    2538 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:31:18.178198 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:18.177866    2538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:18.178198 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:18.177867    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:20.177849945 +0000 UTC m=+261.903534203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : configmap "kube-rbac-proxy" not found
Jul 30 17:31:18.178198 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:18.177932    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:20.177921405 +0000 UTC m=+261.903605676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:18.262451 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:18.262429    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hd6zk_664c5959-7ccc-4146-aec3-39a123ea1822/dns-node-resolver/0.log"
Jul 30 17:31:18.654143 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:18.654118    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/1.log"
Jul 30 17:31:18.654472 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:18.654455    2538 scope.go:117] "RemoveContainer" containerID="6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd"
Jul 30 17:31:18.654607 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:18.654585    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l4bg4_openshift-console-operator(914923c1-dbde-401a-97f8-f63444f8fed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5"
Jul 30 17:31:18.655295 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:18.655278    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c" event={"ID":"0bcfd972-babc-46bd-ae74-d3b92d8e9ad7","Type":"ContainerStarted","Data":"3a145baa18689f5ea790f9b400a7f869da76581c58bee807faa1b31ee7fec0aa"}
Jul 30 17:31:19.660380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:19.660288    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c" event={"ID":"0bcfd972-babc-46bd-ae74-d3b92d8e9ad7","Type":"ContainerStarted","Data":"6468d64302050a3b6c309669434e32746b165d03324f23ebdf7e1fb8271f4503"}
Jul 30 17:31:19.660769 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:19.660398    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c" event={"ID":"0bcfd972-babc-46bd-ae74-d3b92d8e9ad7","Type":"ContainerStarted","Data":"a82b963c73a38e1dd6665afac83f4fdd8fe2e00f1c8b2d4812c56df856524b8c"}
Jul 30 17:31:19.661146 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:19.661129    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wstkm_98e386c8-3e80-41f4-ad02-76680f052a4a/node-ca/0.log"
Jul 30 17:31:19.677259 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:19.677220    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-6qt2c" podStartSLOduration=1.3675127 podStartE2EDuration="2.677207723s" totalImagesPullingTime="1.309695023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:19.676748078 +0000 UTC m=+261.402432358" watchObservedRunningTime="2026-07-30 17:31:19.677207723 +0000 UTC m=+261.402892043"
Jul 30 17:31:20.091020 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:20.090984    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:20.091156 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:20.091031    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:20.091156 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.091112    2538 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:20.091156 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.091119    2538 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 17:31:20.091260 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.091169    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls podName:5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb nodeName:}" failed. No retries permitted until 2026-07-30 17:31:28.091155387 +0000 UTC m=+269.816839645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wp68z" (UID: "5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:20.091260 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.091183    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls podName:f4103753-2f34-4c28-b64e-b6fa313efea2 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:28.091176888 +0000 UTC m=+269.816861146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls") pod "cluster-samples-operator-6748489656-wc9cp" (UID: "f4103753-2f34-4c28-b64e-b6fa313efea2") : secret "samples-operator-tls" not found
Jul 30 17:31:20.192337 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:20.192304    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:20.192476 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:20.192344    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:20.192476 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:20.192385    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:20.192476 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192418    2538 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:31:20.192476 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192471    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:24.192455765 +0000 UTC m=+265.918140030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : configmap "kube-rbac-proxy" not found
Jul 30 17:31:20.192657 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192498    2538 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 17:31:20.192657 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192506    2538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:20.192657 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192552    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:24.192540105 +0000 UTC m=+265.918224366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:20.192657 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192512    2538 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c46f99c76-xpqxs: secret "image-registry-tls" not found
Jul 30 17:31:20.192657 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:20.192584    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls podName:3481d49e-047e-48b7-829a-8aed400c2b9b nodeName:}" failed. No retries permitted until 2026-07-30 17:31:28.19257781 +0000 UTC m=+269.918262068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls") pod "image-registry-7c46f99c76-xpqxs" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b") : secret "image-registry-tls" not found
Jul 30 17:31:20.462189 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:20.462168    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlrgr_0f006530-aef1-40cf-8922-26ad8c96bc1b/serve-healthcheck-canary/0.log"
Jul 30 17:31:22.740760 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:22.740719    2538 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:22.741207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:22.740785    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:22.741207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:22.741135    2538 scope.go:117] "RemoveContainer" containerID="6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd"
Jul 30 17:31:22.741297 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:22.741276    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l4bg4_openshift-console-operator(914923c1-dbde-401a-97f8-f63444f8fed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5"
Jul 30 17:31:24.226056 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:24.226025    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:24.226056 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:24.226059    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:24.226508 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:24.226150    2538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:24.226508 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:24.226196    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:32.226183092 +0000 UTC m=+273.951867350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:24.226508 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:24.226146    2538 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 17:31:24.226508 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:24.226278    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:32.226263051 +0000 UTC m=+273.951947310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : configmap "kube-rbac-proxy" not found
Jul 30 17:31:28.157499 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.157466    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:28.157853 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.157514    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:28.157853 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:28.157633    2538 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:28.157853 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:28.157696    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls podName:5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb nodeName:}" failed. No retries permitted until 2026-07-30 17:31:44.157679146 +0000 UTC m=+285.883363407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-wp68z" (UID: "5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb") : secret "cluster-monitoring-operator-tls" not found
Jul 30 17:31:28.159639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.159618    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4103753-2f34-4c28-b64e-b6fa313efea2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wc9cp\" (UID: \"f4103753-2f34-4c28-b64e-b6fa313efea2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:28.225161 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.225136    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"
Jul 30 17:31:28.258260 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.258233    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:28.260764 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.260718    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"image-registry-7c46f99c76-xpqxs\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") " pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:28.334090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.334064    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:28.345626 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.345601    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp"]
Jul 30 17:31:28.459537 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.459511    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c46f99c76-xpqxs"]
Jul 30 17:31:28.461546 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:28.461520    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3481d49e_047e_48b7_829a_8aed400c2b9b.slice/crio-fa57e7ef710655ffa58c6cbbb6228370973de0189cfc63b6831b6918f20107bf WatchSource:0}: Error finding container fa57e7ef710655ffa58c6cbbb6228370973de0189cfc63b6831b6918f20107bf: Status 404 returned error can't find the container with id fa57e7ef710655ffa58c6cbbb6228370973de0189cfc63b6831b6918f20107bf
Jul 30 17:31:28.690562 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.690467    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" event={"ID":"3481d49e-047e-48b7-829a-8aed400c2b9b","Type":"ContainerStarted","Data":"3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061"}
Jul 30 17:31:28.690562 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.690532    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" event={"ID":"3481d49e-047e-48b7-829a-8aed400c2b9b","Type":"ContainerStarted","Data":"fa57e7ef710655ffa58c6cbbb6228370973de0189cfc63b6831b6918f20107bf"}
Jul 30 17:31:28.690562 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.690561    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:31:28.691594 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.691568    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp" event={"ID":"f4103753-2f34-4c28-b64e-b6fa313efea2","Type":"ContainerStarted","Data":"85ebfc487fdea29dd832552b8a7a98618e6b0c4248a5339f5fe55d177c0fabaa"}
Jul 30 17:31:28.710613 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:28.710570    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" podStartSLOduration=16.710540346 podStartE2EDuration="16.710540346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:28.709834745 +0000 UTC m=+270.435519026" watchObservedRunningTime="2026-07-30 17:31:28.710540346 +0000 UTC m=+270.436224626"
Jul 30 17:31:30.700196 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:30.700160    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp" event={"ID":"f4103753-2f34-4c28-b64e-b6fa313efea2","Type":"ContainerStarted","Data":"31d7ef0bd859eb24f824458b735ec8365d20ccb82e0fa6d82878b44fdf4e0c6c"}
Jul 30 17:31:30.700565 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:30.700250    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp" event={"ID":"f4103753-2f34-4c28-b64e-b6fa313efea2","Type":"ContainerStarted","Data":"f1aad777cb59611f9e79b73dce19b42fae28eb817860dea97e61ad5c4e295f8d"}
Jul 30 17:31:30.719278 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:30.719198    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wc9cp" podStartSLOduration=16.641161926 podStartE2EDuration="18.719183535s" totalImagesPullingTime="2.078021609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:30.718668158 +0000 UTC m=+272.444352438" watchObservedRunningTime="2026-07-30 17:31:30.719183535 +0000 UTC m=+272.444867816"
Jul 30 17:31:32.295474 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:32.295438    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:32.295474 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:32.295472    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:32.295908 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:32.295577    2538 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:32.295908 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:32.295627    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls podName:fe4e3c96-4928-4da3-a629-065e09c3f9f9 nodeName:}" failed. No retries permitted until 2026-07-30 17:31:48.295613889 +0000 UTC m=+290.021298150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k894c" (UID: "fe4e3c96-4928-4da3-a629-065e09c3f9f9") : secret "insights-runtime-extractor-tls" not found
Jul 30 17:31:32.296012 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:32.295994    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe4e3c96-4928-4da3-a629-065e09c3f9f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:36.824673 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:36.824635    2538 scope.go:117] "RemoveContainer" containerID="6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd"
Jul 30 17:31:37.723693 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:37.723662    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:31:37.724070 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:37.724055    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/1.log"
Jul 30 17:31:37.724151 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:37.724090    2538 generic.go:356] "Generic (PLEG): container finished" podID="914923c1-dbde-401a-97f8-f63444f8fed5" containerID="df864f088ff795cc26fc419b61513e2c58c7f9508ef41eea87ce382f84261e09" exitCode=255
Jul 30 17:31:37.724151 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:37.724117    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" event={"ID":"914923c1-dbde-401a-97f8-f63444f8fed5","Type":"ContainerDied","Data":"df864f088ff795cc26fc419b61513e2c58c7f9508ef41eea87ce382f84261e09"}
Jul 30 17:31:37.724212 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:37.724172    2538 scope.go:117] "RemoveContainer" containerID="6f7c6fd41b28c55d146946da67e54dc43dd160414c5f7ae5c4b51ad658c369bd"
Jul 30 17:31:37.724529 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:37.724502    2538 scope.go:117] "RemoveContainer" containerID="df864f088ff795cc26fc419b61513e2c58c7f9508ef41eea87ce382f84261e09"
Jul 30 17:31:37.724722 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:37.724702    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-l4bg4_openshift-console-operator(914923c1-dbde-401a-97f8-f63444f8fed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5"
Jul 30 17:31:38.728478 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:38.728444    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:31:38.750359 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:38.750331    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c46f99c76-xpqxs"]
Jul 30 17:31:39.382444 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:39.382390    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sdtrv" podUID="a6236b53-0777-4fb6-ac34-7760b266b16a"
Jul 30 17:31:39.731761 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:39.731729    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:31:42.740168 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:42.740122    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:42.740558 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:42.740189    2538 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:31:42.740595 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:42.740566    2538 scope.go:117] "RemoveContainer" containerID="df864f088ff795cc26fc419b61513e2c58c7f9508ef41eea87ce382f84261e09"
Jul 30 17:31:42.740795 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:42.740769    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-l4bg4_openshift-console-operator(914923c1-dbde-401a-97f8-f63444f8fed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5"
Jul 30 17:31:43.185715 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:43.185613    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:31:43.188056 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:43.188032    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6236b53-0777-4fb6-ac34-7760b266b16a-metrics-tls\") pod \"dns-default-sdtrv\" (UID: \"a6236b53-0777-4fb6-ac34-7760b266b16a\") " pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:31:43.335329 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:43.335295    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjl7j\""
Jul 30 17:31:43.343106 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:43.343083    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:31:43.474207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:43.474176    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sdtrv"]
Jul 30 17:31:43.477039 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:43.477010    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6236b53_0777_4fb6_ac34_7760b266b16a.slice/crio-78affda045b8680fdd3156506a8eeb70a3761c0c67e3db52cac5f83287edb2e8 WatchSource:0}: Error finding container 78affda045b8680fdd3156506a8eeb70a3761c0c67e3db52cac5f83287edb2e8: Status 404 returned error can't find the container with id 78affda045b8680fdd3156506a8eeb70a3761c0c67e3db52cac5f83287edb2e8
Jul 30 17:31:43.744892 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:43.744787    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdtrv" event={"ID":"a6236b53-0777-4fb6-ac34-7760b266b16a","Type":"ContainerStarted","Data":"78affda045b8680fdd3156506a8eeb70a3761c0c67e3db52cac5f83287edb2e8"}
Jul 30 17:31:44.194289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:44.194208    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:44.196834 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:44.196808    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-wp68z\" (UID: \"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:44.443976 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:44.443944    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"
Jul 30 17:31:44.595666 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:44.595619    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z"]
Jul 30 17:31:44.599079 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:44.599048    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7ca8bb_1ce1_4349_a438_6a6e6ab1e2eb.slice/crio-9c1bf62eebbdc3d13fc4accac0cbfb242d62af9abd31eaaec9a03de4aafab824 WatchSource:0}: Error finding container 9c1bf62eebbdc3d13fc4accac0cbfb242d62af9abd31eaaec9a03de4aafab824: Status 404 returned error can't find the container with id 9c1bf62eebbdc3d13fc4accac0cbfb242d62af9abd31eaaec9a03de4aafab824
Jul 30 17:31:44.749288 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:44.749215    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z" event={"ID":"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb","Type":"ContainerStarted","Data":"9c1bf62eebbdc3d13fc4accac0cbfb242d62af9abd31eaaec9a03de4aafab824"}
Jul 30 17:31:45.754609 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:45.754580    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdtrv" event={"ID":"a6236b53-0777-4fb6-ac34-7760b266b16a","Type":"ContainerStarted","Data":"5c2252d7aca0d67d91fddf9a777ca4a4dbe1dde9973b1f583f5fefd05cb8d74f"}
Jul 30 17:31:46.761327 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:46.761290    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sdtrv" event={"ID":"a6236b53-0777-4fb6-ac34-7760b266b16a","Type":"ContainerStarted","Data":"4ec072b580c5d2009aceac9069fdc8874a0e2a934802353451029874e8123003"}
Jul 30 17:31:46.761746 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:46.761416    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:31:46.782031 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:46.781979    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sdtrv" podStartSLOduration=251.638640621 podStartE2EDuration="4m13.781962498s" totalImagesPullingTime="2.143321877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:46.780060205 +0000 UTC m=+288.505744509" watchObservedRunningTime="2026-07-30 17:31:46.781962498 +0000 UTC m=+288.507646781"
Jul 30 17:31:47.766137 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:47.766097    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z" event={"ID":"5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb","Type":"ContainerStarted","Data":"19fdb454f5b93dcd67591ef0260a1785a16edbd349149a855391c253b0fc37b7"}
Jul 30 17:31:47.786597 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:47.786545    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-wp68z" podStartSLOduration=33.306507339 podStartE2EDuration="35.786529035s" totalImagesPullingTime="2.480021696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:31:47.786400335 +0000 UTC m=+289.512084627" watchObservedRunningTime="2026-07-30 17:31:47.786529035 +0000 UTC m=+289.512213316"
Jul 30 17:31:48.327578 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.327542    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:48.329691 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.329667    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe4e3c96-4928-4da3-a629-065e09c3f9f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k894c\" (UID: \"fe4e3c96-4928-4da3-a629-065e09c3f9f9\") " pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:48.605959 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.605824    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k894c"
Jul 30 17:31:48.741425 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.741395    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k894c"]
Jul 30 17:31:48.745151 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:31:48.745118    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4e3c96_4928_4da3_a629_065e09c3f9f9.slice/crio-0e78b901e2f63661f43e985334c056f5847e98e30483306300a0398f1c9fc32d WatchSource:0}: Error finding container 0e78b901e2f63661f43e985334c056f5847e98e30483306300a0398f1c9fc32d: Status 404 returned error can't find the container with id 0e78b901e2f63661f43e985334c056f5847e98e30483306300a0398f1c9fc32d
Jul 30 17:31:48.756531 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.756504    2538 patch_prober.go:28] interesting pod/image-registry-7c46f99c76-xpqxs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 17:31:48.756633 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.756550    2538 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" podUID="3481d49e-047e-48b7-829a-8aed400c2b9b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 17:31:48.770693 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:48.770661    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k894c" event={"ID":"fe4e3c96-4928-4da3-a629-065e09c3f9f9","Type":"ContainerStarted","Data":"0e78b901e2f63661f43e985334c056f5847e98e30483306300a0398f1c9fc32d"}
Jul 30 17:31:53.790034 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:53.790000    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k894c" event={"ID":"fe4e3c96-4928-4da3-a629-065e09c3f9f9","Type":"ContainerStarted","Data":"1f7a9c980cc552c5f3d82040d9148fd294d1018938b245158306efcbab483c2a"}
Jul 30 17:31:53.821252 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:53.821221    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-spq6s" podUID="d8257104-65fb-40c9-817d-51d1aa9987b0"
Jul 30 17:31:55.820681 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:55.820651    2538 scope.go:117] "RemoveContainer" containerID="df864f088ff795cc26fc419b61513e2c58c7f9508ef41eea87ce382f84261e09"
Jul 30 17:31:55.821061 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:31:55.820828    2538 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-l4bg4_openshift-console-operator(914923c1-dbde-401a-97f8-f63444f8fed5)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5"
Jul 30 17:31:56.769217 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:56.769189    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sdtrv"
Jul 30 17:31:57.810201 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:57.810165    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k894c" event={"ID":"fe4e3c96-4928-4da3-a629-065e09c3f9f9","Type":"ContainerStarted","Data":"4c728d99a34cda9baf489c921c0b24314f56ae7e5a10ab76937589383ba896f7"}
Jul 30 17:31:58.643218 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:58.643183    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:31:58.643656 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:58.643626    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:31:58.657473 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:58.657449    2538 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 17:31:58.756099 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:31:58.756068    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:32:00.073746 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.073716    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-798jf"]
Jul 30 17:32:00.093370 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.093341    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.096313 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.096277    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 17:32:00.096462 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.096352    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 17:32:00.096532 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.096466    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 17:32:00.096767 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.096688    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 17:32:00.097557 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.097519    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wfrg5\""
Jul 30 17:32:00.125423 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125393    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-metrics-client-ca\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125432    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-sys\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125472    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnl4\" (UniqueName: \"kubernetes.io/projected/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-kube-api-access-pgnl4\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125501    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-accelerators-collector-config\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125564 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125528    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125606    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-tls\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125635    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-root\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125664    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-wtmp\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.125742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.125692    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-textfile\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.226741 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226707    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnl4\" (UniqueName: \"kubernetes.io/projected/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-kube-api-access-pgnl4\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.226930 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226746    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-accelerators-collector-config\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.226930 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226794    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.226930 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226862    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-tls\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.226930 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226908    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-root\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.226930 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226928    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-wtmp\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226948    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-textfile\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.226988    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-metrics-client-ca\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227008    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-sys\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227015    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-root\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227076    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-sys\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:32:00.227125    2538 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:32:00.227180    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-tls podName:e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9 nodeName:}" failed. No retries permitted until 2026-07-30 17:32:00.727160066 +0000 UTC m=+302.452844340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-tls") pod "node-exporter-798jf" (UID: "e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9") : secret "node-exporter-tls" not found
Jul 30 17:32:00.227204 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227201    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-wtmp\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227612 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227432    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-textfile\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227612 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227468    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-accelerators-collector-config\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.227705 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.227685    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-metrics-client-ca\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.229314 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.229296    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.237595 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.237565    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnl4\" (UniqueName: \"kubernetes.io/projected/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-kube-api-access-pgnl4\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.732934 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.732899    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-tls\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.735187 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.735162    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9-node-exporter-tls\") pod \"node-exporter-798jf\" (UID: \"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9\") " pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:00.825002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.824927    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k894c" event={"ID":"fe4e3c96-4928-4da3-a629-065e09c3f9f9","Type":"ContainerStarted","Data":"0f5ef3ac916d8431f909989e3c500c6db4c7e1576457e29bd062b19526343dd9"}
Jul 30 17:32:00.858272 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:00.858226    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k894c" podStartSLOduration=33.179669908 podStartE2EDuration="44.858209869s" totalImagesPullingTime="11.678539961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 17:31:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:00.857224264 +0000 UTC m=+302.582908543" watchObservedRunningTime="2026-07-30 17:32:00.858209869 +0000 UTC m=+302.583894150"
Jul 30 17:32:01.003931 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:01.003901    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-798jf"
Jul 30 17:32:01.014427 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:32:01.014398    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c8b9c7_aa40_44b5_b684_c54cdfeb6ec9.slice/crio-f65e8bc7863b1f7a914bafddb7de66ff4e1ec426e4e4533cb220b54e4a55d3c1 WatchSource:0}: Error finding container f65e8bc7863b1f7a914bafddb7de66ff4e1ec426e4e4533cb220b54e4a55d3c1: Status 404 returned error can't find the container with id f65e8bc7863b1f7a914bafddb7de66ff4e1ec426e4e4533cb220b54e4a55d3c1
Jul 30 17:32:01.016775 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:01.016718    2538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:32:01.827453 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:01.827418    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-798jf" event={"ID":"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9","Type":"ContainerStarted","Data":"f65e8bc7863b1f7a914bafddb7de66ff4e1ec426e4e4533cb220b54e4a55d3c1"}
Jul 30 17:32:02.832311 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:02.832280    2538 generic.go:356] "Generic (PLEG): container finished" podID="e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9" containerID="8ffc3afa919b23a9983d42baa38d63a330d16d5932cdfd54ab3d9a3ece0ac1ff" exitCode=0
Jul 30 17:32:02.832701 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:02.832355    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-798jf" event={"ID":"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9","Type":"ContainerDied","Data":"8ffc3afa919b23a9983d42baa38d63a330d16d5932cdfd54ab3d9a3ece0ac1ff"}
Jul 30 17:32:03.768788 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:03.768727    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" podUID="3481d49e-047e-48b7-829a-8aed400c2b9b" containerName="registry" containerID="cri-o://3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061" gracePeriod=30
Jul 30 17:32:03.837576 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:03.837544    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-798jf" event={"ID":"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9","Type":"ContainerStarted","Data":"d6a0ca6540c82811000f44365b89cd095889496aee88841b40819e189494a790"}
Jul 30 17:32:03.837922 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:03.837600    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-798jf" event={"ID":"e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9","Type":"ContainerStarted","Data":"ce0f03d4037293f4931a99f59c28751dc7f1e6779f0d2d5e1091089598967b33"}
Jul 30 17:32:03.860005 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:03.859957    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-798jf" podStartSLOduration=2.731751594 podStartE2EDuration="3.859943062s" totalImagesPullingTime="1.065031612s" totalInitContainerRuntime="63.159856ms" isStatefulPod=true podCreationTimestamp="2026-07-30 17:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:03.858322898 +0000 UTC m=+305.584007177" watchObservedRunningTime="2026-07-30 17:32:03.859943062 +0000 UTC m=+305.585627389"
Jul 30 17:32:04.008986 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.008957    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:32:04.061573 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061493    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdkpp\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-kube-api-access-kdkpp\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061573 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061532    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-image-registry-private-configuration\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061573 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061555    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3481d49e-047e-48b7-829a-8aed400c2b9b-ca-trust-extracted\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061831 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061593    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-bound-sa-token\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061831 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061620    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-trusted-ca\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061831 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061639    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061831 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061659    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-certificates\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.061831 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.061723    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-installation-pull-secrets\") pod \"3481d49e-047e-48b7-829a-8aed400c2b9b\" (UID: \"3481d49e-047e-48b7-829a-8aed400c2b9b\") "
Jul 30 17:32:04.062217 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.062184    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:32:04.062415 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.062384    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:32:04.064060 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.064033    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-kube-api-access-kdkpp" (OuterVolumeSpecName: "kube-api-access-kdkpp") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "kube-api-access-kdkpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:32:04.064154 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.064053    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:32:04.064249 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.064217    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:32:04.064334 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.064300    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:32:04.065571 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.065553    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:32:04.070704 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.070682    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3481d49e-047e-48b7-829a-8aed400c2b9b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3481d49e-047e-48b7-829a-8aed400c2b9b" (UID: "3481d49e-047e-48b7-829a-8aed400c2b9b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:32:04.162621 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162587    2538 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-installation-pull-secrets\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162621 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162611    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdkpp\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-kube-api-access-kdkpp\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162621 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162621    2538 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3481d49e-047e-48b7-829a-8aed400c2b9b-image-registry-private-configuration\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162621 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162631    2538 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3481d49e-047e-48b7-829a-8aed400c2b9b-ca-trust-extracted\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162640    2538 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-bound-sa-token\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162649    2538 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-trusted-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162656    2538 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-tls\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.162869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.162663    2538 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3481d49e-047e-48b7-829a-8aed400c2b9b-registry-certificates\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:32:04.551189 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.551156    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58fb575bcc-7qjmz"]
Jul 30 17:32:04.551421 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.551410    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3481d49e-047e-48b7-829a-8aed400c2b9b" containerName="registry"
Jul 30 17:32:04.551486 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.551422    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="3481d49e-047e-48b7-829a-8aed400c2b9b" containerName="registry"
Jul 30 17:32:04.551524 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.551492    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="3481d49e-047e-48b7-829a-8aed400c2b9b" containerName="registry"
Jul 30 17:32:04.556113 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.556098    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.560340 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.560309    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 17:32:04.560340 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.560347    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-k3p5v0c20utr\""
Jul 30 17:32:04.560541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.560367    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 17:32:04.560541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.560385    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 17:32:04.560541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.560437    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 17:32:04.560695 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.560669    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vvzkz\""
Jul 30 17:32:04.564982 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.564960    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58fb575bcc-7qjmz"]
Jul 30 17:32:04.665724 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665688    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-secret-metrics-server-tls\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.665724 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665726    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-secret-metrics-server-client-certs\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.665942 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665744    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5e8677d2-977b-445f-9898-a9b71f2963a2-audit-log\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.665942 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665792    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gm8d\" (UniqueName: \"kubernetes.io/projected/5e8677d2-977b-445f-9898-a9b71f2963a2-kube-api-access-7gm8d\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.665942 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665835    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5e8677d2-977b-445f-9898-a9b71f2963a2-metrics-server-audit-profiles\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.665942 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665913    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8677d2-977b-445f-9898-a9b71f2963a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.666063 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.665970    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-client-ca-bundle\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766509 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766475    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-secret-metrics-server-tls\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766512    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-secret-metrics-server-client-certs\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766533    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5e8677d2-977b-445f-9898-a9b71f2963a2-audit-log\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766552    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gm8d\" (UniqueName: \"kubernetes.io/projected/5e8677d2-977b-445f-9898-a9b71f2963a2-kube-api-access-7gm8d\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766578    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5e8677d2-977b-445f-9898-a9b71f2963a2-metrics-server-audit-profiles\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766599    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8677d2-977b-445f-9898-a9b71f2963a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.766685 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.766658    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-client-ca-bundle\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.767067 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.767032    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5e8677d2-977b-445f-9898-a9b71f2963a2-audit-log\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.767466 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.767444    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e8677d2-977b-445f-9898-a9b71f2963a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.767822 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.767801    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5e8677d2-977b-445f-9898-a9b71f2963a2-metrics-server-audit-profiles\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.769035 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.769016    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-secret-metrics-server-client-certs\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.769311 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.769289    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-secret-metrics-server-tls\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.769311 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.769304    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e8677d2-977b-445f-9898-a9b71f2963a2-client-ca-bundle\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.774754 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.774735    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gm8d\" (UniqueName: \"kubernetes.io/projected/5e8677d2-977b-445f-9898-a9b71f2963a2-kube-api-access-7gm8d\") pod \"metrics-server-58fb575bcc-7qjmz\" (UID: \"5e8677d2-977b-445f-9898-a9b71f2963a2\") " pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.780977 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.780957    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"]
Jul 30 17:32:04.785000 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.784985    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:04.787531 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.787507    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 17:32:04.787615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.787549    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k4d4r\""
Jul 30 17:32:04.791443 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.791413    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"]
Jul 30 17:32:04.820278 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.820219    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:32:04.841580 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.841557    2538 generic.go:356] "Generic (PLEG): container finished" podID="3481d49e-047e-48b7-829a-8aed400c2b9b" containerID="3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061" exitCode=0
Jul 30 17:32:04.841894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.841595    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs"
Jul 30 17:32:04.841894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.841619    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" event={"ID":"3481d49e-047e-48b7-829a-8aed400c2b9b","Type":"ContainerDied","Data":"3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061"}
Jul 30 17:32:04.841894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.841652    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c46f99c76-xpqxs" event={"ID":"3481d49e-047e-48b7-829a-8aed400c2b9b","Type":"ContainerDied","Data":"fa57e7ef710655ffa58c6cbbb6228370973de0189cfc63b6831b6918f20107bf"}
Jul 30 17:32:04.841894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.841678    2538 scope.go:117] "RemoveContainer" containerID="3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061"
Jul 30 17:32:04.849442 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.849420    2538 scope.go:117] "RemoveContainer" containerID="3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061"
Jul 30 17:32:04.849720 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:32:04.849697    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061\": container with ID starting with 3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061 not found: ID does not exist" containerID="3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061"
Jul 30 17:32:04.849788 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.849732    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061"} err="failed to get container status \"3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061\": rpc error: code = NotFound desc = could not find container \"3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061\": container with ID starting with 3a691ec6ea107786803d3858136729e11730a024e536242cb6a32e239afa5061 not found: ID does not exist"
Jul 30 17:32:04.865233 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.865212    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:04.866327 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.866308    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c46f99c76-xpqxs"]
Jul 30 17:32:04.867415 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.867390    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9589ec6-83cc-4ecc-b242-cbf95d65f336-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-895qz\" (UID: \"d9589ec6-83cc-4ecc-b242-cbf95d65f336\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:04.867505 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.867430    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgmg\" (UniqueName: \"kubernetes.io/projected/d9589ec6-83cc-4ecc-b242-cbf95d65f336-kube-api-access-msgmg\") pod \"monitoring-plugin-68b7fc9574-895qz\" (UID: \"d9589ec6-83cc-4ecc-b242-cbf95d65f336\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:04.870113 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.870091    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c46f99c76-xpqxs"]
Jul 30 17:32:04.968390 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.968359    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9589ec6-83cc-4ecc-b242-cbf95d65f336-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-895qz\" (UID: \"d9589ec6-83cc-4ecc-b242-cbf95d65f336\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:04.968662 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.968641    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgmg\" (UniqueName: \"kubernetes.io/projected/d9589ec6-83cc-4ecc-b242-cbf95d65f336-kube-api-access-msgmg\") pod \"monitoring-plugin-68b7fc9574-895qz\" (UID: \"d9589ec6-83cc-4ecc-b242-cbf95d65f336\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:04.970778 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.970754    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9589ec6-83cc-4ecc-b242-cbf95d65f336-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-895qz\" (UID: \"d9589ec6-83cc-4ecc-b242-cbf95d65f336\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:04.990033 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:04.990012    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgmg\" (UniqueName: \"kubernetes.io/projected/d9589ec6-83cc-4ecc-b242-cbf95d65f336-kube-api-access-msgmg\") pod \"monitoring-plugin-68b7fc9574-895qz\" (UID: \"d9589ec6-83cc-4ecc-b242-cbf95d65f336\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:05.017597 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:05.017578    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58fb575bcc-7qjmz"]
Jul 30 17:32:05.019800 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:32:05.019773    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8677d2_977b_445f_9898_a9b71f2963a2.slice/crio-ef575f9cc3bd129c4b1180ed229fda292c424714c2d10a6d35efef6cc599f278 WatchSource:0}: Error finding container ef575f9cc3bd129c4b1180ed229fda292c424714c2d10a6d35efef6cc599f278: Status 404 returned error can't find the container with id ef575f9cc3bd129c4b1180ed229fda292c424714c2d10a6d35efef6cc599f278
Jul 30 17:32:05.094749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:05.094682    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:05.220711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:05.220666    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"]
Jul 30 17:32:05.222944 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:32:05.222917    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9589ec6_83cc_4ecc_b242_cbf95d65f336.slice/crio-8f491dc38ecf0158356752a9ca206c6834e458e33a34e192d3057cd37d2636c5 WatchSource:0}: Error finding container 8f491dc38ecf0158356752a9ca206c6834e458e33a34e192d3057cd37d2636c5: Status 404 returned error can't find the container with id 8f491dc38ecf0158356752a9ca206c6834e458e33a34e192d3057cd37d2636c5
Jul 30 17:32:05.846577 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:05.846544    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz" event={"ID":"d9589ec6-83cc-4ecc-b242-cbf95d65f336","Type":"ContainerStarted","Data":"8f491dc38ecf0158356752a9ca206c6834e458e33a34e192d3057cd37d2636c5"}
Jul 30 17:32:05.848311 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:05.848276    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz" event={"ID":"5e8677d2-977b-445f-9898-a9b71f2963a2","Type":"ContainerStarted","Data":"ef575f9cc3bd129c4b1180ed229fda292c424714c2d10a6d35efef6cc599f278"}
Jul 30 17:32:06.345423 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.345390    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:32:06.349604 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.349583    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.352423 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352401    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 17:32:06.352590 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352464    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 17:32:06.352754 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352726    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 17:32:06.352927 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352907    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 17:32:06.353018 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352727    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 17:32:06.353018 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352750    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 17:32:06.353159 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352821    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 17:32:06.353159 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.352813    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-btlk6\""
Jul 30 17:32:06.353802 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.353518    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 17:32:06.353802 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.353568    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 17:32:06.353802 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.353601    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 17:32:06.353802 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.353627    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-au40itkdj30e9\""
Jul 30 17:32:06.353802 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.353692    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 17:32:06.354170 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.353817    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 17:32:06.357425 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.357402    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 17:32:06.359984 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.359963    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 17:32:06.370221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.370185    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:32:06.480978 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.480940    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.480985    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481011    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481045    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481126    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481211    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d25s2\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-kube-api-access-d25s2\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481264    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481302    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481333    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481366    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481391    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481416    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481444    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481500    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481536    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481559    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481587    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481622 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481612    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481678    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.481950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.481704    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582473 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582436    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d25s2\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-kube-api-access-d25s2\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582473 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582480    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582501    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582529    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582558    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582580    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582605    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582630    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582658    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582681    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.582711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582704    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582733    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582757    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582799    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582824    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582858    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582900    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582930    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.582971    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.583018    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.583035    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.583657 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.583533    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.584899 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.584240    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.584899 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.584487    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.584899 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.584526    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.586308 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.586024    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.586308 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.586262    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.587750 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.586767    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.587750 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.587253    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.587750 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.587428    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.587750 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.587571    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.588289 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.588255    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.589064 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.588771    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.589064 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.589018    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.589241 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.589221    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.589822 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.589774    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.590302 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.590259    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.590983 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.590966    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.590983 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.590974    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.591450 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.591434    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d25s2\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-kube-api-access-d25s2\") pod \"prometheus-k8s-0\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.662056 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.661971    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:06.827009 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:06.826975    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3481d49e-047e-48b7-829a-8aed400c2b9b" path="/var/lib/kubelet/pods/3481d49e-047e-48b7-829a-8aed400c2b9b/volumes"
Jul 30 17:32:07.198336 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.198310    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:32:07.200110 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:32:07.200081    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1815f5_428c_4c58_a7c7_daba6b8f3a92.slice/crio-1bae342d07052f74d498591a6193a357012e9f72f70bb2681b39fa7f46b7b5dd WatchSource:0}: Error finding container 1bae342d07052f74d498591a6193a357012e9f72f70bb2681b39fa7f46b7b5dd: Status 404 returned error can't find the container with id 1bae342d07052f74d498591a6193a357012e9f72f70bb2681b39fa7f46b7b5dd
Jul 30 17:32:07.860003 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.859963    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz" event={"ID":"d9589ec6-83cc-4ecc-b242-cbf95d65f336","Type":"ContainerStarted","Data":"094afd9a6e4cdb9f369b596b08efb65c06e750892c3aef2f2a4e5a4a26cb74c7"}
Jul 30 17:32:07.860207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.860129    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:07.861803 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.861773    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz" event={"ID":"5e8677d2-977b-445f-9898-a9b71f2963a2","Type":"ContainerStarted","Data":"396874a61415d80938650106d9e654a86cdcb3e3d9b37d89146718cf1e5a38ee"}
Jul 30 17:32:07.863248 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.863224    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"1bae342d07052f74d498591a6193a357012e9f72f70bb2681b39fa7f46b7b5dd"}
Jul 30 17:32:07.869361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.866637    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz"
Jul 30 17:32:07.879761 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.879716    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-895qz" podStartSLOduration=2.039371531 podStartE2EDuration="3.879704211s" totalImagesPullingTime="1.84033268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:07.878741707 +0000 UTC m=+309.604425980" watchObservedRunningTime="2026-07-30 17:32:07.879704211 +0000 UTC m=+309.605388490"
Jul 30 17:32:07.898854 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:07.898807    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz" podStartSLOduration=1.855246671 podStartE2EDuration="3.898795694s" totalImagesPullingTime="2.043549023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:07.897747517 +0000 UTC m=+309.623431798" watchObservedRunningTime="2026-07-30 17:32:07.898795694 +0000 UTC m=+309.624479974"
Jul 30 17:32:08.868113 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:08.868075    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c" exitCode=0
Jul 30 17:32:08.868548 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:08.868173    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"}
Jul 30 17:32:10.820711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.820681    2538 scope.go:117] "RemoveContainer" containerID="df864f088ff795cc26fc419b61513e2c58c7f9508ef41eea87ce382f84261e09"
Jul 30 17:32:10.878334 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.878310    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:32:10.878446 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.878368    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" event={"ID":"914923c1-dbde-401a-97f8-f63444f8fed5","Type":"ContainerStarted","Data":"cff7c8900c2023bfd482349b3a897b9af65789874fc9c44388a1f62c0eb922cf"}
Jul 30 17:32:10.878700 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.878587    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:32:10.880100 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.880069    2538 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-l4bg4 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.15:8443/readyz\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body=
Jul 30 17:32:10.880211 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.880106    2538 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podUID="914923c1-dbde-401a-97f8-f63444f8fed5" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.15:8443/readyz\": dial tcp 10.133.0.15:8443: connect: connection refused"
Jul 30 17:32:10.898005 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:10.897938    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4" podStartSLOduration=55.922258279 podStartE2EDuration="58.897923396s" totalImagesPullingTime="2.975665117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:10.896840703 +0000 UTC m=+312.622524981" watchObservedRunningTime="2026-07-30 17:32:10.897923396 +0000 UTC m=+312.623607732"
Jul 30 17:32:11.887790 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:11.887759    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-l4bg4"
Jul 30 17:32:13.894932 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:13.894892    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"}
Jul 30 17:32:13.895344 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:13.894983    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"}
Jul 30 17:32:14.902595 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:14.902564    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"}
Jul 30 17:32:14.902935 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:14.902627    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"}
Jul 30 17:32:15.909720 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:15.909689    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"}
Jul 30 17:32:15.910100 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:15.909750    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerStarted","Data":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"}
Jul 30 17:32:15.943315 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:15.943264    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.291611499 podStartE2EDuration="9.943250816s" totalImagesPullingTime="6.632450304s" totalInitContainerRuntime="19.189013ms" isStatefulPod=false podCreationTimestamp="2026-07-30 17:32:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:32:15.941553555 +0000 UTC m=+317.667237850" watchObservedRunningTime="2026-07-30 17:32:15.943250816 +0000 UTC m=+317.668935096"
Jul 30 17:32:16.663070 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:16.663034    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:32:21.931971 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:21.931941    2538 generic.go:356] "Generic (PLEG): container finished" podID="1d450d29-2fd9-43f9-82be-fe0ba8030a77" containerID="4feb46bed58d83daffaabb58bda4e2dfbbf4ab526136a6e35b89cbd3f42cef4f" exitCode=0
Jul 30 17:32:21.932357 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:21.932016    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6" event={"ID":"1d450d29-2fd9-43f9-82be-fe0ba8030a77","Type":"ContainerDied","Data":"4feb46bed58d83daffaabb58bda4e2dfbbf4ab526136a6e35b89cbd3f42cef4f"}
Jul 30 17:32:21.932357 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:21.932306    2538 scope.go:117] "RemoveContainer" containerID="4feb46bed58d83daffaabb58bda4e2dfbbf4ab526136a6e35b89cbd3f42cef4f"
Jul 30 17:32:22.937309 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:22.937272    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6" event={"ID":"1d450d29-2fd9-43f9-82be-fe0ba8030a77","Type":"ContainerStarted","Data":"4f960a8b45e62d46e05eb772ca72bbfe2d042fff8fbc789e44f0edd14c54c9ba"}
Jul 30 17:32:24.865539 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:24.865493    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:24.866051 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:24.865565    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:37.363297 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:37.363264    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlrgr_0f006530-aef1-40cf-8922-26ad8c96bc1b/serve-healthcheck-canary/0.log"
Jul 30 17:32:44.871424 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:44.871394    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:44.875117 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:44.875093    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58fb575bcc-7qjmz"
Jul 30 17:32:48.032344 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:48.032311    2538 generic.go:356] "Generic (PLEG): container finished" podID="c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3" containerID="7336a3a560a3048b09e8ff18eb9a0b763493be8121d731b879090c7dff335f7b" exitCode=0
Jul 30 17:32:48.032731 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:48.032354    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl" event={"ID":"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3","Type":"ContainerDied","Data":"7336a3a560a3048b09e8ff18eb9a0b763493be8121d731b879090c7dff335f7b"}
Jul 30 17:32:48.032813 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:48.032792    2538 scope.go:117] "RemoveContainer" containerID="7336a3a560a3048b09e8ff18eb9a0b763493be8121d731b879090c7dff335f7b"
Jul 30 17:32:49.038352 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:32:49.038317    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-prbgl" event={"ID":"c4c630ea-6a7d-4a49-b6d4-8c032cf0efc3","Type":"ContainerStarted","Data":"38e9bcd8b221ce5b4e5f2596378d1205ad3ad1ec3e010757a4d0aa2517c5c7c9"}
Jul 30 17:33:06.662775 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:06.662724    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:06.682313 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:06.682282    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:07.127575 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:07.127543    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:12.644672 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:12.644636    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:33:12.646987 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:12.646960    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8257104-65fb-40c9-817d-51d1aa9987b0-metrics-certs\") pod \"network-metrics-daemon-spq6s\" (UID: \"d8257104-65fb-40c9-817d-51d1aa9987b0\") " pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:33:12.925373 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:12.925279    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fjwv8\""
Jul 30 17:33:12.931820 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:12.931793    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-spq6s"
Jul 30 17:33:13.070488 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:13.070461    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-spq6s"]
Jul 30 17:33:13.072579 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:33:13.072533    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8257104_65fb_40c9_817d_51d1aa9987b0.slice/crio-ee7dfed216be047601c2988d1bfbd6b1e81d4b4ff568681e3a966dfdef5756ea WatchSource:0}: Error finding container ee7dfed216be047601c2988d1bfbd6b1e81d4b4ff568681e3a966dfdef5756ea: Status 404 returned error can't find the container with id ee7dfed216be047601c2988d1bfbd6b1e81d4b4ff568681e3a966dfdef5756ea
Jul 30 17:33:13.136737 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:13.136695    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spq6s" event={"ID":"d8257104-65fb-40c9-817d-51d1aa9987b0","Type":"ContainerStarted","Data":"ee7dfed216be047601c2988d1bfbd6b1e81d4b4ff568681e3a966dfdef5756ea"}
Jul 30 17:33:14.142351 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:14.142315    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spq6s" event={"ID":"d8257104-65fb-40c9-817d-51d1aa9987b0","Type":"ContainerStarted","Data":"22eaccf411ff18fefa847b683613d7f1f1083ea6513241a7e8c4645c7b528609"}
Jul 30 17:33:14.142968 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:14.142375    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-spq6s" event={"ID":"d8257104-65fb-40c9-817d-51d1aa9987b0","Type":"ContainerStarted","Data":"0657ad7ac93079e053c7ed9fac1e902f903a922f01cee97ea6463cac5657a19c"}
Jul 30 17:33:14.160711 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:14.160658    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-spq6s" podStartSLOduration=374.27305463 podStartE2EDuration="6m15.160642956s" totalImagesPullingTime="887.588326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:33:14.160401003 +0000 UTC m=+375.886085284" watchObservedRunningTime="2026-07-30 17:33:14.160642956 +0000 UTC m=+375.886327236"
Jul 30 17:33:24.803341 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803302    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:33:24.803749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803640    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="prometheus" containerID="cri-o://8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49" gracePeriod=600
Jul 30 17:33:24.803749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803650    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af" gracePeriod=600
Jul 30 17:33:24.803749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803655    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="thanos-sidecar" containerID="cri-o://56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe" gracePeriod=600
Jul 30 17:33:24.803749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803680    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="config-reloader" containerID="cri-o://4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d" gracePeriod=600
Jul 30 17:33:24.803749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803704    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy" containerID="cri-o://bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f" gracePeriod=600
Jul 30 17:33:24.803995 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:24.803661    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-web" containerID="cri-o://2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1" gracePeriod=600
Jul 30 17:33:25.048090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.048060    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.154844 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.154750    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-tls\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.154844 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.154793    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-tls-assets\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.154844 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.154811    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-metrics-client-certs\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.154844 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.154834    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-2\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155001    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155069    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-web-config\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155102    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-metrics-client-ca\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155129    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-db\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155154    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-trusted-ca-bundle\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155181    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-thanos-prometheus-http-client-file\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155553 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155250    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.155615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155545    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.155615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155598    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-grpc-tls\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155633    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config-out\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155672    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155700    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-kubelet-serving-ca-bundle\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155863 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155730    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-serving-certs-ca-bundle\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155863 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155757    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-0\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155863 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155805    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d25s2\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-kube-api-access-d25s2\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.155863 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155837    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-kube-rbac-proxy\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.156090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155866    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.156090 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.155920    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-1\") pod \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\" (UID: \"ac1815f5-428c-4c58-a7c7-daba6b8f3a92\") "
Jul 30 17:33:25.156219 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.156189    2538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.156219 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.156213    2538 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-metrics-client-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.157137 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.156609    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:33:25.157137 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.156635    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.157137 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.156863    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.157137 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.157008    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.158428 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.157752    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.158557 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.158492    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:33:25.158557 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.158490    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.158557 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.158542    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.158713 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.158584    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.159464 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.159429    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 17:33:25.159759 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.159725    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config-out" (OuterVolumeSpecName: "config-out") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:33:25.159869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.159822    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.159869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.159847    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config" (OuterVolumeSpecName: "config") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.160042 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.160019    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.160183 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.160152    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.160921 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.160895    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-kube-api-access-d25s2" (OuterVolumeSpecName: "kube-api-access-d25s2") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "kube-api-access-d25s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:33:25.161222 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.161197    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.168906 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.168859    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-web-config" (OuterVolumeSpecName: "web-config") pod "ac1815f5-428c-4c58-a7c7-daba6b8f3a92" (UID: "ac1815f5-428c-4c58-a7c7-daba6b8f3a92"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:33:25.188615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188581    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af" exitCode=0
Jul 30 17:33:25.188615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188608    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f" exitCode=0
Jul 30 17:33:25.188615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188617    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1" exitCode=0
Jul 30 17:33:25.188615 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188623    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe" exitCode=0
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188629    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d" exitCode=0
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188635    2538 generic.go:356] "Generic (PLEG): container finished" podID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49" exitCode=0
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188653    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188662    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"}
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188749    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"}
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188792    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"}
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188812    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188834    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"}
Jul 30 17:33:25.188970 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188892    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"}
Jul 30 17:33:25.189305 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.188976    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"}
Jul 30 17:33:25.189305 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.189018    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac1815f5-428c-4c58-a7c7-daba6b8f3a92","Type":"ContainerDied","Data":"1bae342d07052f74d498591a6193a357012e9f72f70bb2681b39fa7f46b7b5dd"}
Jul 30 17:33:25.196620 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.196482    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.204021 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.204001    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.211410 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.211389    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.215923 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.215892    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:33:25.218749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.218733    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.225810 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.225785    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:33:25.226238 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.226215    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.233526 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.233502    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.240477 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.240459    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.240777 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.240757    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.240845 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.240792    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"} err="failed to get container status \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist"
Jul 30 17:33:25.240845 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.240820    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.241083 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.241065    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.241116 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241089    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"} err="failed to get container status \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist"
Jul 30 17:33:25.241116 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241105    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.241316 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.241299    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.241354 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241319    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"} err="failed to get container status \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist"
Jul 30 17:33:25.241354 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241333    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.241535 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.241520    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.241575 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241539    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"} err="failed to get container status \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist"
Jul 30 17:33:25.241575 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241550    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.241741 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.241721    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.241834 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241744    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"} err="failed to get container status \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist"
Jul 30 17:33:25.241834 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.241758    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.242022 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.242002    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.242086 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242029    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"} err="failed to get container status \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist"
Jul 30 17:33:25.242086 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242050    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.242301 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:33:25.242283    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.242346 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242307    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"} err="failed to get container status \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist"
Jul 30 17:33:25.242346 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242320    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.242547 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242517    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"} err="failed to get container status \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist"
Jul 30 17:33:25.242595 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242547    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.242734 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242718    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"} err="failed to get container status \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist"
Jul 30 17:33:25.242734 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242733    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.242923 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242906    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"} err="failed to get container status \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist"
Jul 30 17:33:25.242972 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.242923    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.243091 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243076    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"} err="failed to get container status \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist"
Jul 30 17:33:25.243129 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243091    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.243278 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243263    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"} err="failed to get container status \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist"
Jul 30 17:33:25.243319 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243278    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.243456 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243441    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"} err="failed to get container status \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist"
Jul 30 17:33:25.243501 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243456    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.243635 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243617    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"} err="failed to get container status \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist"
Jul 30 17:33:25.243677 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243637    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.243809 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243793    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"} err="failed to get container status \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist"
Jul 30 17:33:25.243850 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.243811    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.244040 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244023    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"} err="failed to get container status \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist"
Jul 30 17:33:25.244104 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244041    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.244228 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244211    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"} err="failed to get container status \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist"
Jul 30 17:33:25.244279 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244229    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.244412 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244382    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"} err="failed to get container status \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist"
Jul 30 17:33:25.244495 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244413    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.244654 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244637    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"} err="failed to get container status \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist"
Jul 30 17:33:25.244690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244655    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.244894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244855    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"} err="failed to get container status \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist"
Jul 30 17:33:25.244894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.244890    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.245109 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245093    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"} err="failed to get container status \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist"
Jul 30 17:33:25.245109 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245109    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.245316 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245300    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"} err="failed to get container status \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist"
Jul 30 17:33:25.245358 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245317    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.245487 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245469    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"} err="failed to get container status \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist"
Jul 30 17:33:25.245539 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245489    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.245696 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245679    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"} err="failed to get container status \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist"
Jul 30 17:33:25.245749 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.245695    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.246071 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246052    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"} err="failed to get container status \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist"
Jul 30 17:33:25.246071 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246071    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.246305 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246285    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"} err="failed to get container status \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist"
Jul 30 17:33:25.246359 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246307    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.246560 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246536    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"} err="failed to get container status \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist"
Jul 30 17:33:25.246560 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246558    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.246764 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246734    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"} err="failed to get container status \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist"
Jul 30 17:33:25.246827 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246767    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.246999 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246983    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"} err="failed to get container status \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist"
Jul 30 17:33:25.247048 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.246999    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.247210 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247193    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"} err="failed to get container status \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist"
Jul 30 17:33:25.247251 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247211    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.247397 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247383    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"} err="failed to get container status \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist"
Jul 30 17:33:25.247439 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247397    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.247598 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247580    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"} err="failed to get container status \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist"
Jul 30 17:33:25.247639 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247598    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.247782 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247767    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"} err="failed to get container status \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist"
Jul 30 17:33:25.247823 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247782    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.247969 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247954    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"} err="failed to get container status \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist"
Jul 30 17:33:25.248022 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.247970    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.248207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248186    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"} err="failed to get container status \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist"
Jul 30 17:33:25.248277 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248209    2538 scope.go:117] "RemoveContainer" containerID="3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"
Jul 30 17:33:25.248417 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248400    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af"} err="failed to get container status \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": rpc error: code = NotFound desc = could not find container \"3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af\": container with ID starting with 3e77f6d2ff6eee99b479138732649b1033c15226561aa7eb353497843bf206af not found: ID does not exist"
Jul 30 17:33:25.248465 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248417    2538 scope.go:117] "RemoveContainer" containerID="bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"
Jul 30 17:33:25.248617 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248599    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f"} err="failed to get container status \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": rpc error: code = NotFound desc = could not find container \"bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f\": container with ID starting with bd3675d24c17ccb249a5e382bf2115747b99626089f8bf129b92ac1cefc2fe0f not found: ID does not exist"
Jul 30 17:33:25.248660 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248618    2538 scope.go:117] "RemoveContainer" containerID="2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"
Jul 30 17:33:25.248821 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248806    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1"} err="failed to get container status \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": rpc error: code = NotFound desc = could not find container \"2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1\": container with ID starting with 2cb0115f257fd767a1d103db8ce8747a9dd1a711feb4205fb11aec543be95ff1 not found: ID does not exist"
Jul 30 17:33:25.248863 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.248820    2538 scope.go:117] "RemoveContainer" containerID="56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"
Jul 30 17:33:25.249043 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249025    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe"} err="failed to get container status \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": rpc error: code = NotFound desc = could not find container \"56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe\": container with ID starting with 56a8bf24cbe330495e0240c4cc95746fd011cb03f183842557c9b726138b03fe not found: ID does not exist"
Jul 30 17:33:25.249086 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249043    2538 scope.go:117] "RemoveContainer" containerID="4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"
Jul 30 17:33:25.249235 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249217    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d"} err="failed to get container status \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": rpc error: code = NotFound desc = could not find container \"4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d\": container with ID starting with 4f0508e2902426d1eab581855fa62e21902cf80ac0109323676c654f1f77b53d not found: ID does not exist"
Jul 30 17:33:25.249277 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249240    2538 scope.go:117] "RemoveContainer" containerID="8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"
Jul 30 17:33:25.249478 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249458    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49"} err="failed to get container status \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": rpc error: code = NotFound desc = could not find container \"8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49\": container with ID starting with 8d1ab69d80bbefc307472fa7e953d0f08e7b49f3a576602ab22b1c2b7becbf49 not found: ID does not exist"
Jul 30 17:33:25.249478 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249477    2538 scope.go:117] "RemoveContainer" containerID="4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"
Jul 30 17:33:25.249679 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.249662    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c"} err="failed to get container status \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": rpc error: code = NotFound desc = could not find container \"4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c\": container with ID starting with 4cc7c5d5814ad39a74e9dc6dc2cde3cd2dcf26779195782865fd6942ad75d19c not found: ID does not exist"
Jul 30 17:33:25.256120 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256096    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:33:25.256378 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256365    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="init-config-reloader"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256379    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="init-config-reloader"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256390    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="thanos-sidecar"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256396    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="thanos-sidecar"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256401    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-thanos"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256407    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-thanos"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256413    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256417    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy"
Jul 30 17:33:25.256426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256427    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="config-reloader"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256433    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="config-reloader"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256440    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-web"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256445    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-web"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256455    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="prometheus"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256460    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="prometheus"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256503    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="config-reloader"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256510    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-web"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256518    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="prometheus"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256523    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="thanos-sidecar"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256527    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy-thanos"
Jul 30 17:33:25.256690 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.256533    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" containerName="kube-rbac-proxy"
Jul 30 17:33:25.257466 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257450    2538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257501 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257469    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d25s2\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-kube-api-access-d25s2\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257501 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257479    2538 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-kube-rbac-proxy\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257501 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257489    2538 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257501 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257499    2538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257508    2538 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257518    2538 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-tls-assets\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257527    2538 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-metrics-client-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257535    2538 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257543    2538 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-web-config\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257551    2538 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-k8s-db\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257559    2538 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257568    2538 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257576    2538 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-grpc-tls\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257585    2538 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-config-out\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257593    2538 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257601    2538 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.257614 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.257609    2538 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac1815f5-428c-4c58-a7c7-daba6b8f3a92-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:33:25.260367 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.260352    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.263665 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.263645    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 17:33:25.263806 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.263667    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 17:33:25.263806 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.263646    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 17:33:25.264259 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264235    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 17:33:25.264355 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264294    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264504    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264522    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264531    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264579    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264613    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-btlk6\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264613    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-au40itkdj30e9\""
Jul 30 17:33:25.264721 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264633    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 17:33:25.265016 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264893    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 17:33:25.265016 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.264933    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 17:33:25.268718 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.268695    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 17:33:25.270194 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.270178    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 17:33:25.280798 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.280771    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:33:25.459372 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459339    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c1232e94-68f7-45b9-b870-d7f03c45ac02-config-out\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459378    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8qxj\" (UniqueName: \"kubernetes.io/projected/c1232e94-68f7-45b9-b870-d7f03c45ac02-kube-api-access-q8qxj\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459402    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-config\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459452    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459490    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459508    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459692 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459565    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459692 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459591    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-web-config\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459692 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459619    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459692 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459664    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c1232e94-68f7-45b9-b870-d7f03c45ac02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459811 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459698    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459811 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459722    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459811 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459750    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459811 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459778    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459811 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459797    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459998 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459813    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459998 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459840    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459998 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459861    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459998 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459911    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.459998 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.459929    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560273 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560232    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c1232e94-68f7-45b9-b870-d7f03c45ac02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560273 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560274    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560290    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560312    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560328    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560343    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560359    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560390    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560411    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560436    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560462    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.560514 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560503    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c1232e94-68f7-45b9-b870-d7f03c45ac02-config-out\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560527    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8qxj\" (UniqueName: \"kubernetes.io/projected/c1232e94-68f7-45b9-b870-d7f03c45ac02-kube-api-access-q8qxj\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560560    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-config\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560582    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560607    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560631    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560666    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560699    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-web-config\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560740    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561002 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.560744    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561417 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.561301    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561417 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.561323    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.561771 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.561723    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.562294 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.562267    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.563134 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.563111    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.563549 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.563522    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.563651 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.563614    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.563712 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.563643    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.563773 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.563751    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-config\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.564378 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.564085    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.564467 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.564090    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c1232e94-68f7-45b9-b870-d7f03c45ac02-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.564557 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.564480    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.564688 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.564665    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c1232e94-68f7-45b9-b870-d7f03c45ac02-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.565718 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.565697    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.565844 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.565827    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c1232e94-68f7-45b9-b870-d7f03c45ac02-config-out\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.566247 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.566227    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-web-config\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.566332 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.566288    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.566395 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.566373    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c1232e94-68f7-45b9-b870-d7f03c45ac02-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.573984 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.573964    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8qxj\" (UniqueName: \"kubernetes.io/projected/c1232e94-68f7-45b9-b870-d7f03c45ac02-kube-api-access-q8qxj\") pod \"prometheus-k8s-0\" (UID: \"c1232e94-68f7-45b9-b870-d7f03c45ac02\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:25.870726 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:25.870678    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:33:26.013869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:26.013840    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 17:33:26.014652 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:33:26.014618    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1232e94_68f7_45b9_b870_d7f03c45ac02.slice/crio-a1104a3f306babfc05c439aef9eff9d6613263c73fa9f137dff1934761589181 WatchSource:0}: Error finding container a1104a3f306babfc05c439aef9eff9d6613263c73fa9f137dff1934761589181: Status 404 returned error can't find the container with id a1104a3f306babfc05c439aef9eff9d6613263c73fa9f137dff1934761589181
Jul 30 17:33:26.194846 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:26.194810    2538 generic.go:356] "Generic (PLEG): container finished" podID="c1232e94-68f7-45b9-b870-d7f03c45ac02" containerID="68e1dcb80a991146e5501eedddff78dab1d54f50f6bbf42c68e560e93c745caf" exitCode=0
Jul 30 17:33:26.195064 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:26.194906    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerDied","Data":"68e1dcb80a991146e5501eedddff78dab1d54f50f6bbf42c68e560e93c745caf"}
Jul 30 17:33:26.195064 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:26.195025    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"a1104a3f306babfc05c439aef9eff9d6613263c73fa9f137dff1934761589181"}
Jul 30 17:33:26.826748 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:26.826713    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac1815f5-428c-4c58-a7c7-daba6b8f3a92" path="/var/lib/kubelet/pods/ac1815f5-428c-4c58-a7c7-daba6b8f3a92/volumes"
Jul 30 17:33:27.203662 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.203632    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"2ab569bcbe805e2fd58f39289ead3f7fc54b3a06f2b5053ac75bfeb183338924"}
Jul 30 17:33:27.204085 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.203697    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"b6d4d7cdaeed5f6a034d446aca957c9e0f2983f59a0fec71c5ede8314ec3f785"}
Jul 30 17:33:27.204085 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.203723    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"e796f9447e4bcc4c19982c9afe1b4cfde9aeeadddc6ea3312a9802b8049f05cf"}
Jul 30 17:33:27.204085 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.203747    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"678a78f085a9fb626aa47860d5ec7f4d4910acdcabcc639d06cd77aed81b1044"}
Jul 30 17:33:27.204085 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.203770    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"c180e0e65c162913a8b84d87fe853e20f8bd880713b97b19ec7226beaf8521f6"}
Jul 30 17:33:27.204085 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.203795    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c1232e94-68f7-45b9-b870-d7f03c45ac02","Type":"ContainerStarted","Data":"784800a6b38a95683286447f0f3e3edeecb13ff63f5afd89a6d3f99e4022fc3f"}
Jul 30 17:33:27.233061 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:27.232996    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.214065641 podStartE2EDuration="2.232969937s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.904296ms" isStatefulPod=false podCreationTimestamp="2026-07-30 17:33:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:33:27.231320357 +0000 UTC m=+388.957004639" watchObservedRunningTime="2026-07-30 17:33:27.232969937 +0000 UTC m=+388.958654217"
Jul 30 17:33:30.870965 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:33:30.870931    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:34:25.871196 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:34:25.871107    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:34:25.886223 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:34:25.886196    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:34:26.437512 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:34:26.437489    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 17:36:30.368799 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.368761    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"]
Jul 30 17:36:30.371977 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.371959    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.374714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.374684    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 17:36:30.374839 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.374742    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 17:36:30.374839 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.374744    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-clv8c\""
Jul 30 17:36:30.380718 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.380699    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"]
Jul 30 17:36:30.462421 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.462382    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3db214-b188-4e3b-a1f1-5d8ca72e8521-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f6s6m\" (UID: \"7c3db214-b188-4e3b-a1f1-5d8ca72e8521\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.462590 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.462459    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjzh5\" (UniqueName: \"kubernetes.io/projected/7c3db214-b188-4e3b-a1f1-5d8ca72e8521-kube-api-access-rjzh5\") pod \"openshift-lws-operator-fd8ccff4c-f6s6m\" (UID: \"7c3db214-b188-4e3b-a1f1-5d8ca72e8521\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.562816 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.562784    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjzh5\" (UniqueName: \"kubernetes.io/projected/7c3db214-b188-4e3b-a1f1-5d8ca72e8521-kube-api-access-rjzh5\") pod \"openshift-lws-operator-fd8ccff4c-f6s6m\" (UID: \"7c3db214-b188-4e3b-a1f1-5d8ca72e8521\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.563032 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.562827    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3db214-b188-4e3b-a1f1-5d8ca72e8521-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f6s6m\" (UID: \"7c3db214-b188-4e3b-a1f1-5d8ca72e8521\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.563255 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.563233    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c3db214-b188-4e3b-a1f1-5d8ca72e8521-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f6s6m\" (UID: \"7c3db214-b188-4e3b-a1f1-5d8ca72e8521\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.571301 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.571278    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjzh5\" (UniqueName: \"kubernetes.io/projected/7c3db214-b188-4e3b-a1f1-5d8ca72e8521-kube-api-access-rjzh5\") pod \"openshift-lws-operator-fd8ccff4c-f6s6m\" (UID: \"7c3db214-b188-4e3b-a1f1-5d8ca72e8521\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.681519 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.681438    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"
Jul 30 17:36:30.807905 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.807867    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m"]
Jul 30 17:36:30.810288 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:36:30.810254    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c3db214_b188_4e3b_a1f1_5d8ca72e8521.slice/crio-5f21957baf0500e8bd1882fdb2868a403ebac6423a22377a1b9b94e8d162a2b9 WatchSource:0}: Error finding container 5f21957baf0500e8bd1882fdb2868a403ebac6423a22377a1b9b94e8d162a2b9: Status 404 returned error can't find the container with id 5f21957baf0500e8bd1882fdb2868a403ebac6423a22377a1b9b94e8d162a2b9
Jul 30 17:36:30.880897 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:30.880841    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m" event={"ID":"7c3db214-b188-4e3b-a1f1-5d8ca72e8521","Type":"ContainerStarted","Data":"5f21957baf0500e8bd1882fdb2868a403ebac6423a22377a1b9b94e8d162a2b9"}
Jul 30 17:36:33.897295 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:33.897258    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m" event={"ID":"7c3db214-b188-4e3b-a1f1-5d8ca72e8521","Type":"ContainerStarted","Data":"77dd0efd9fa70c9b555502ae2e580609efc9b23cf30739260f655facde0439e9"}
Jul 30 17:36:33.915765 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:33.915709    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f6s6m" podStartSLOduration=1.597240037 podStartE2EDuration="3.915695342s" totalImagesPullingTime="2.318455305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:36:33.913413456 +0000 UTC m=+575.639097737" watchObservedRunningTime="2026-07-30 17:36:33.915695342 +0000 UTC m=+575.641379621"
Jul 30 17:36:49.598350 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.598308    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"]
Jul 30 17:36:49.604674 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.604656    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.607294 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.607272    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 17:36:49.607462 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.607326    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-thdx9\""
Jul 30 17:36:49.607671 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.607651    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 17:36:49.607868 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.607847    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 17:36:49.607957 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.607854    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 17:36:49.630198 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.630170    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"]
Jul 30 17:36:49.713929 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.713898    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-manifests\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.714104 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.713944    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.714104 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.713967    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67tmj\" (UniqueName: \"kubernetes.io/projected/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-kube-api-access-67tmj\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.714104 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.714061    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.714244 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.714106    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-tmp\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.815322 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.815292    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.815459 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.815331    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67tmj\" (UniqueName: \"kubernetes.io/projected/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-kube-api-access-67tmj\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.815523 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.815452    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.815523 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.815503    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-tmp\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.815623 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.815560    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-manifests\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.815999 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.815978    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-manifests\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.817631 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.817601    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-tmp\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.817773 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.817753    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.817832 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.817816    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.823107 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.823085    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67tmj\" (UniqueName: \"kubernetes.io/projected/bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5-kube-api-access-67tmj\") pod \"opendatahub-operator-controller-manager-975dfc96f-jqnnm\" (UID: \"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5\") " pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:49.914789 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:49.914729    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:50.055373 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:50.055350    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"]
Jul 30 17:36:50.057647 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:36:50.057612    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf065dd6_d6ce_4bb1_85fe_75fdf14a14a5.slice/crio-d61924f47e0afafe51dfbc781bc7dd4fb0ec3252136209861f18848226064d8b WatchSource:0}: Error finding container d61924f47e0afafe51dfbc781bc7dd4fb0ec3252136209861f18848226064d8b: Status 404 returned error can't find the container with id d61924f47e0afafe51dfbc781bc7dd4fb0ec3252136209861f18848226064d8b
Jul 30 17:36:50.964416 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:50.964364    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm" event={"ID":"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5","Type":"ContainerStarted","Data":"d61924f47e0afafe51dfbc781bc7dd4fb0ec3252136209861f18848226064d8b"}
Jul 30 17:36:53.979752 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:53.979719    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm" event={"ID":"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5","Type":"ContainerStarted","Data":"88b7330e02b451444051d1f478a8070f47f6689fb30bd69ed8bb386cd62d62ab"}
Jul 30 17:36:54.985136 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:54.985100    2538 generic.go:356] "Generic (PLEG): container finished" podID="bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5" containerID="88b7330e02b451444051d1f478a8070f47f6689fb30bd69ed8bb386cd62d62ab" exitCode=0
Jul 30 17:36:54.985581 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:54.985166    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm" event={"ID":"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5","Type":"ContainerDied","Data":"88b7330e02b451444051d1f478a8070f47f6689fb30bd69ed8bb386cd62d62ab"}
Jul 30 17:36:55.990949 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:55.990913    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm" event={"ID":"bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5","Type":"ContainerStarted","Data":"0db9ff87f227fdeee87ba3e03e45d8e6a871079bcb6355dd0dedc83827aedd75"}
Jul 30 17:36:55.991410 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:55.991013    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:36:56.016362 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:56.016317    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm" podStartSLOduration=2.758096967 podStartE2EDuration="7.016304569s" totalImagesPullingTime="3.251214192s" totalInitContainerRuntime="1.00699341s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:36:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:36:56.014365261 +0000 UTC m=+597.740049540" watchObservedRunningTime="2026-07-30 17:36:56.016304569 +0000 UTC m=+597.741988849"
Jul 30 17:36:58.672713 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:58.672681    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:36:58.673257 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:36:58.673121    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:37:06.997362 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:06.997331    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-975dfc96f-jqnnm"
Jul 30 17:37:09.480399 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.480361    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"]
Jul 30 17:37:09.483799 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.483779    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.487437 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.487414    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 17:37:09.487541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.487453    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 17:37:09.487541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.487468    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rk2zb\""
Jul 30 17:37:09.487541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.487455    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 17:37:09.493649 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.493629    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"]
Jul 30 17:37:09.506470 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.506444    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"]
Jul 30 17:37:09.509474 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.509460    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.512190 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.512172    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 17:37:09.512281 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.512193    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-89m26\""
Jul 30 17:37:09.512281 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.512223    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 17:37:09.512506 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.512484    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 17:37:09.513820 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.513802    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 17:37:09.521210 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.521189    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"]
Jul 30 17:37:09.581714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.581677    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/775e67db-22a6-4135-9cd5-a7d2378b0802-metrics-cert\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.581714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.581716    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/775e67db-22a6-4135-9cd5-a7d2378b0802-cert\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.581966 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.581755    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/775e67db-22a6-4135-9cd5-a7d2378b0802-manager-config\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.581966 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.581799    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc2qz\" (UniqueName: \"kubernetes.io/projected/775e67db-22a6-4135-9cd5-a7d2378b0802-kube-api-access-rc2qz\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.683185 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683152    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/775e67db-22a6-4135-9cd5-a7d2378b0802-manager-config\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.683348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683192    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc2qz\" (UniqueName: \"kubernetes.io/projected/775e67db-22a6-4135-9cd5-a7d2378b0802-kube-api-access-rc2qz\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.683348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683217    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hn9\" (UniqueName: \"kubernetes.io/projected/0e0bd348-db23-4d8a-b00e-26f19951337f-kube-api-access-59hn9\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.683348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683245    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e0bd348-db23-4d8a-b00e-26f19951337f-tls-certs\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.683348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683277    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e0bd348-db23-4d8a-b00e-26f19951337f-tmp\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.683348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683296    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/775e67db-22a6-4135-9cd5-a7d2378b0802-metrics-cert\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.683348 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.683313    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/775e67db-22a6-4135-9cd5-a7d2378b0802-cert\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.684051 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.684032    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/775e67db-22a6-4135-9cd5-a7d2378b0802-manager-config\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.685646 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.685616    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/775e67db-22a6-4135-9cd5-a7d2378b0802-metrics-cert\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.685742 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.685654    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/775e67db-22a6-4135-9cd5-a7d2378b0802-cert\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.698826 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.698802    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc2qz\" (UniqueName: \"kubernetes.io/projected/775e67db-22a6-4135-9cd5-a7d2378b0802-kube-api-access-rc2qz\") pod \"lws-controller-manager-5cdfbb974d-fzl5q\" (UID: \"775e67db-22a6-4135-9cd5-a7d2378b0802\") " pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.784466 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.784382    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e0bd348-db23-4d8a-b00e-26f19951337f-tls-certs\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.784466 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.784442    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e0bd348-db23-4d8a-b00e-26f19951337f-tmp\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.784681 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.784518    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hn9\" (UniqueName: \"kubernetes.io/projected/0e0bd348-db23-4d8a-b00e-26f19951337f-kube-api-access-59hn9\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.784681 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:37:09.784528    2538 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 30 17:37:09.784681 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:37:09.784600    2538 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0bd348-db23-4d8a-b00e-26f19951337f-tls-certs podName:0e0bd348-db23-4d8a-b00e-26f19951337f nodeName:}" failed. No retries permitted until 2026-07-30 17:37:10.284582772 +0000 UTC m=+612.010267031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0e0bd348-db23-4d8a-b00e-26f19951337f-tls-certs") pod "kube-auth-proxy-6ff87f57bc-fgzpz" (UID: "0e0bd348-db23-4d8a-b00e-26f19951337f") : secret "kube-auth-proxy-tls" not found
Jul 30 17:37:09.786534 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.786514    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e0bd348-db23-4d8a-b00e-26f19951337f-tmp\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.793575 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.793551    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:09.804377 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.804354    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hn9\" (UniqueName: \"kubernetes.io/projected/0e0bd348-db23-4d8a-b00e-26f19951337f-kube-api-access-59hn9\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:09.929696 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.929598    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"]
Jul 30 17:37:09.932304 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:37:09.932275    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775e67db_22a6_4135_9cd5_a7d2378b0802.slice/crio-221d17344cda7a8daabf08b425ac0fdf053c724126bd965fcef646b4b2de6441 WatchSource:0}: Error finding container 221d17344cda7a8daabf08b425ac0fdf053c724126bd965fcef646b4b2de6441: Status 404 returned error can't find the container with id 221d17344cda7a8daabf08b425ac0fdf053c724126bd965fcef646b4b2de6441
Jul 30 17:37:09.934245 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:09.934232    2538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:37:10.050426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:10.050346    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q" event={"ID":"775e67db-22a6-4135-9cd5-a7d2378b0802","Type":"ContainerStarted","Data":"221d17344cda7a8daabf08b425ac0fdf053c724126bd965fcef646b4b2de6441"}
Jul 30 17:37:10.288741 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:10.288709    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e0bd348-db23-4d8a-b00e-26f19951337f-tls-certs\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:10.290993 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:10.290971    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e0bd348-db23-4d8a-b00e-26f19951337f-tls-certs\") pod \"kube-auth-proxy-6ff87f57bc-fgzpz\" (UID: \"0e0bd348-db23-4d8a-b00e-26f19951337f\") " pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:10.419364 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:10.419298    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"
Jul 30 17:37:10.560150 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:10.560117    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz"]
Jul 30 17:37:10.562560 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:37:10.562535    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0bd348_db23_4d8a_b00e_26f19951337f.slice/crio-724e2573c405b0b709bff7566864e30d10808b8e4b187ad4c53b144df475d517 WatchSource:0}: Error finding container 724e2573c405b0b709bff7566864e30d10808b8e4b187ad4c53b144df475d517: Status 404 returned error can't find the container with id 724e2573c405b0b709bff7566864e30d10808b8e4b187ad4c53b144df475d517
Jul 30 17:37:11.056943 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:11.056897    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz" event={"ID":"0e0bd348-db23-4d8a-b00e-26f19951337f","Type":"ContainerStarted","Data":"724e2573c405b0b709bff7566864e30d10808b8e4b187ad4c53b144df475d517"}
Jul 30 17:37:12.068682 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:12.068587    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q" event={"ID":"775e67db-22a6-4135-9cd5-a7d2378b0802","Type":"ContainerStarted","Data":"f58c1845cfffbda136a3595d598fbf2ac5094598a8828207a11a7a4631f2bcda"}
Jul 30 17:37:12.069139 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:12.068697    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:37:12.086338 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:12.086287    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q" podStartSLOduration=1.275548827 podStartE2EDuration="3.086273415s" totalImagesPullingTime="1.810724588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:37:12.08538048 +0000 UTC m=+613.811064762" watchObservedRunningTime="2026-07-30 17:37:12.086273415 +0000 UTC m=+613.811957695"
Jul 30 17:37:14.081518 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:14.081481    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz" event={"ID":"0e0bd348-db23-4d8a-b00e-26f19951337f","Type":"ContainerStarted","Data":"a5c8b50fba96fd36e1204a5b28ac5ed3d9d2878fcc77d8beaea25c11e525e6c8"}
Jul 30 17:37:14.099430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:14.099382    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6ff87f57bc-fgzpz" podStartSLOduration=2.50920222 podStartE2EDuration="5.099367633s" totalImagesPullingTime="2.590165413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:37:14.098983398 +0000 UTC m=+615.824667680" watchObservedRunningTime="2026-07-30 17:37:14.099367633 +0000 UTC m=+615.825051913"
Jul 30 17:37:23.077769 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:37:23.077687    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cdfbb974d-fzl5q"
Jul 30 17:38:47.750242 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.750204    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"]
Jul 30 17:38:47.753499 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.753482    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.756379 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.756353    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 17:38:47.757740 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.757715    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wcchl\""
Jul 30 17:38:47.757860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.757767    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 30 17:38:47.757957 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.757861    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 17:38:47.757957 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.757864    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 30 17:38:47.764926 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.764906    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"]
Jul 30 17:38:47.861074 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.861038    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8efe4d-847c-4094-9525-93c872be4d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.861242 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.861088    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frx6n\" (UniqueName: \"kubernetes.io/projected/ca8efe4d-847c-4094-9525-93c872be4d72-kube-api-access-frx6n\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.861242 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.861188    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca8efe4d-847c-4094-9525-93c872be4d72-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.962426 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.962391    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frx6n\" (UniqueName: \"kubernetes.io/projected/ca8efe4d-847c-4094-9525-93c872be4d72-kube-api-access-frx6n\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.962608 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.962465    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca8efe4d-847c-4094-9525-93c872be4d72-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.962608 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.962499    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8efe4d-847c-4094-9525-93c872be4d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.963158 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.963129    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ca8efe4d-847c-4094-9525-93c872be4d72-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.964781 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.964757    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca8efe4d-847c-4094-9525-93c872be4d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:47.981185 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:47.981162    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frx6n\" (UniqueName: \"kubernetes.io/projected/ca8efe4d-847c-4094-9525-93c872be4d72-kube-api-access-frx6n\") pod \"kuadrant-console-plugin-66b5774985-rw2v5\" (UID: \"ca8efe4d-847c-4094-9525-93c872be4d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:48.062430 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:48.062355    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"
Jul 30 17:38:48.207328 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:48.207287    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5"]
Jul 30 17:38:48.209540 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:38:48.209508    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca8efe4d_847c_4094_9525_93c872be4d72.slice/crio-4e50499f92256516cd0b9f902375c818245c691e07177b274a99315af6d1ed90 WatchSource:0}: Error finding container 4e50499f92256516cd0b9f902375c818245c691e07177b274a99315af6d1ed90: Status 404 returned error can't find the container with id 4e50499f92256516cd0b9f902375c818245c691e07177b274a99315af6d1ed90
Jul 30 17:38:48.490407 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:48.490376    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5" event={"ID":"ca8efe4d-847c-4094-9525-93c872be4d72","Type":"ContainerStarted","Data":"4e50499f92256516cd0b9f902375c818245c691e07177b274a99315af6d1ed90"}
Jul 30 17:38:57.817717 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:57.817680    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"]
Jul 30 17:38:57.827924 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:57.827895    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:57.831297 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:57.831149    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lw975\""
Jul 30 17:38:57.836327 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:57.836285    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"]
Jul 30 17:38:57.956727 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:57.956684    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08549e68-e7b2-40a6-b3b5-90015e5a053f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4btz9\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:57.956938 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:57.956785    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prbd4\" (UniqueName: \"kubernetes.io/projected/08549e68-e7b2-40a6-b3b5-90015e5a053f-kube-api-access-prbd4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4btz9\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:58.058057 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:58.057847    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08549e68-e7b2-40a6-b3b5-90015e5a053f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4btz9\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:58.058057 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:58.057943    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbd4\" (UniqueName: \"kubernetes.io/projected/08549e68-e7b2-40a6-b3b5-90015e5a053f-kube-api-access-prbd4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4btz9\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:58.058300 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:58.058276    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08549e68-e7b2-40a6-b3b5-90015e5a053f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4btz9\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:58.067995 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:58.067918    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prbd4\" (UniqueName: \"kubernetes.io/projected/08549e68-e7b2-40a6-b3b5-90015e5a053f-kube-api-access-prbd4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4btz9\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:38:58.143351 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:38:58.143298    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:39:10.005784 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:10.005745    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"]
Jul 30 17:39:11.477274 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:11.477241    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"]
Jul 30 17:39:11.477793 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:39:11.477768    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08549e68_e7b2_40a6_b3b5_90015e5a053f.slice/crio-986ba1e47b63405c927a2e5ea647fbabe9694dae5c75cdb68ffa5ebdff69e6f9 WatchSource:0}: Error finding container 986ba1e47b63405c927a2e5ea647fbabe9694dae5c75cdb68ffa5ebdff69e6f9: Status 404 returned error can't find the container with id 986ba1e47b63405c927a2e5ea647fbabe9694dae5c75cdb68ffa5ebdff69e6f9
Jul 30 17:39:11.604638 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:11.604562    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9" event={"ID":"08549e68-e7b2-40a6-b3b5-90015e5a053f","Type":"ContainerStarted","Data":"986ba1e47b63405c927a2e5ea647fbabe9694dae5c75cdb68ffa5ebdff69e6f9"}
Jul 30 17:39:12.611126 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:12.611093    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5" event={"ID":"ca8efe4d-847c-4094-9525-93c872be4d72","Type":"ContainerStarted","Data":"c68640226722c81190b8b33729cfefa9ac891b2d89bc0122c14f44000a436d77"}
Jul 30 17:39:12.629040 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:12.628932    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rw2v5" podStartSLOduration=1.801023687 podStartE2EDuration="25.628911142s" totalImagesPullingTime="23.827887455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:39:12.627270884 +0000 UTC m=+734.352955173" watchObservedRunningTime="2026-07-30 17:39:12.628911142 +0000 UTC m=+734.354595419"
Jul 30 17:39:15.626914 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:15.626865    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9" event={"ID":"08549e68-e7b2-40a6-b3b5-90015e5a053f","Type":"ContainerStarted","Data":"3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4"}
Jul 30 17:39:15.627352 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:15.626946    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9" podUID="08549e68-e7b2-40a6-b3b5-90015e5a053f" containerName="manager" containerID="cri-o://3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4" gracePeriod=10
Jul 30 17:39:15.627352 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:15.627004    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:39:15.650889 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:15.650813    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9" podStartSLOduration=14.614562396 podStartE2EDuration="18.650792173s" totalImagesPullingTime="4.036229777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:39:15.648555527 +0000 UTC m=+737.374239808" watchObservedRunningTime="2026-07-30 17:39:15.650792173 +0000 UTC m=+737.376476455"
Jul 30 17:39:25.629839 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:25.629807    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:39:25.813624 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:25.813598    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:39:25.899812 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:25.899736    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08549e68-e7b2-40a6-b3b5-90015e5a053f-extensions-socket-volume\") pod \"08549e68-e7b2-40a6-b3b5-90015e5a053f\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") "
Jul 30 17:39:25.899812 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:25.899793    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prbd4\" (UniqueName: \"kubernetes.io/projected/08549e68-e7b2-40a6-b3b5-90015e5a053f-kube-api-access-prbd4\") pod \"08549e68-e7b2-40a6-b3b5-90015e5a053f\" (UID: \"08549e68-e7b2-40a6-b3b5-90015e5a053f\") "
Jul 30 17:39:25.900306 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:25.900277    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08549e68-e7b2-40a6-b3b5-90015e5a053f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "08549e68-e7b2-40a6-b3b5-90015e5a053f" (UID: "08549e68-e7b2-40a6-b3b5-90015e5a053f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:39:25.901841 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:25.901820    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08549e68-e7b2-40a6-b3b5-90015e5a053f-kube-api-access-prbd4" (OuterVolumeSpecName: "kube-api-access-prbd4") pod "08549e68-e7b2-40a6-b3b5-90015e5a053f" (UID: "08549e68-e7b2-40a6-b3b5-90015e5a053f"). InnerVolumeSpecName "kube-api-access-prbd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:39:26.001080 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.001046    2538 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08549e68-e7b2-40a6-b3b5-90015e5a053f-extensions-socket-volume\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:39:26.001080 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.001074    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prbd4\" (UniqueName: \"kubernetes.io/projected/08549e68-e7b2-40a6-b3b5-90015e5a053f-kube-api-access-prbd4\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:39:26.677266 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.677230    2538 generic.go:356] "Generic (PLEG): container finished" podID="08549e68-e7b2-40a6-b3b5-90015e5a053f" containerID="3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4" exitCode=137
Jul 30 17:39:26.677677 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.677271    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"
Jul 30 17:39:26.677677 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.677321    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9" event={"ID":"08549e68-e7b2-40a6-b3b5-90015e5a053f","Type":"ContainerDied","Data":"3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4"}
Jul 30 17:39:26.677677 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.677369    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9" event={"ID":"08549e68-e7b2-40a6-b3b5-90015e5a053f","Type":"ContainerDied","Data":"986ba1e47b63405c927a2e5ea647fbabe9694dae5c75cdb68ffa5ebdff69e6f9"}
Jul 30 17:39:26.677677 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.677392    2538 scope.go:117] "RemoveContainer" containerID="3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4"
Jul 30 17:39:26.686071 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.686054    2538 scope.go:117] "RemoveContainer" containerID="3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4"
Jul 30 17:39:26.686333 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:39:26.686311    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4\": container with ID starting with 3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4 not found: ID does not exist" containerID="3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4"
Jul 30 17:39:26.686392 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.686342    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4"} err="failed to get container status \"3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4\": rpc error: code = NotFound desc = could not find container \"3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4\": container with ID starting with 3f08f9baacd56cfcdfab7c6408305e3f385c4fb2c6ee7839375ed1e1db5cb5d4 not found: ID does not exist"
Jul 30 17:39:26.710247 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.710216    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"]
Jul 30 17:39:26.714258 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.714232    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4btz9"]
Jul 30 17:39:26.826328 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:26.826296    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08549e68-e7b2-40a6-b3b5-90015e5a053f" path="/var/lib/kubelet/pods/08549e68-e7b2-40a6-b3b5-90015e5a053f/volumes"
Jul 30 17:39:29.253337 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.253300    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:39:29.253743 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.253605    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08549e68-e7b2-40a6-b3b5-90015e5a053f" containerName="manager"
Jul 30 17:39:29.253743 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.253615    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="08549e68-e7b2-40a6-b3b5-90015e5a053f" containerName="manager"
Jul 30 17:39:29.253743 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.253681    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="08549e68-e7b2-40a6-b3b5-90015e5a053f" containerName="manager"
Jul 30 17:39:29.256268 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.256252    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.260658 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.260636    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 17:39:29.267132 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.267109    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:39:29.282807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.282782    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:39:29.325577 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.325546    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z4x7\" (UniqueName: \"kubernetes.io/projected/75d1665e-e96a-4ffd-bf64-1717f8b5fe01-kube-api-access-5z4x7\") pod \"limitador-limitador-54d6d988d5-bsw46\" (UID: \"75d1665e-e96a-4ffd-bf64-1717f8b5fe01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.325745 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.325614    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/75d1665e-e96a-4ffd-bf64-1717f8b5fe01-config-file\") pod \"limitador-limitador-54d6d988d5-bsw46\" (UID: \"75d1665e-e96a-4ffd-bf64-1717f8b5fe01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.426850 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.426820    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z4x7\" (UniqueName: \"kubernetes.io/projected/75d1665e-e96a-4ffd-bf64-1717f8b5fe01-kube-api-access-5z4x7\") pod \"limitador-limitador-54d6d988d5-bsw46\" (UID: \"75d1665e-e96a-4ffd-bf64-1717f8b5fe01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.427032 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.426934    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/75d1665e-e96a-4ffd-bf64-1717f8b5fe01-config-file\") pod \"limitador-limitador-54d6d988d5-bsw46\" (UID: \"75d1665e-e96a-4ffd-bf64-1717f8b5fe01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.427516 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.427498    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/75d1665e-e96a-4ffd-bf64-1717f8b5fe01-config-file\") pod \"limitador-limitador-54d6d988d5-bsw46\" (UID: \"75d1665e-e96a-4ffd-bf64-1717f8b5fe01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.436851 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.436821    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z4x7\" (UniqueName: \"kubernetes.io/projected/75d1665e-e96a-4ffd-bf64-1717f8b5fe01-kube-api-access-5z4x7\") pod \"limitador-limitador-54d6d988d5-bsw46\" (UID: \"75d1665e-e96a-4ffd-bf64-1717f8b5fe01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.566672 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.566578    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:29.600616 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.600583    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vltlm"]
Jul 30 17:39:29.602916 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.602893    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:39:29.605935 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.605914    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d8xl2\""
Jul 30 17:39:29.612627 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.612598    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vltlm"]
Jul 30 17:39:29.627787 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.627760    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bx88\" (UniqueName: \"kubernetes.io/projected/6c50f989-19f1-47ff-b3a4-8eab8618d89c-kube-api-access-8bx88\") pod \"authorino-75d556bd77-vltlm\" (UID: \"6c50f989-19f1-47ff-b3a4-8eab8618d89c\") " pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:39:29.701353 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.701328    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:39:29.703169 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:39:29.703144    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d1665e_e96a_4ffd_bf64_1717f8b5fe01.slice/crio-694a16ffd36d031c4cd279cf86f174118c3b4c6311a23e9aa6cfd6e2b6f0d025 WatchSource:0}: Error finding container 694a16ffd36d031c4cd279cf86f174118c3b4c6311a23e9aa6cfd6e2b6f0d025: Status 404 returned error can't find the container with id 694a16ffd36d031c4cd279cf86f174118c3b4c6311a23e9aa6cfd6e2b6f0d025
Jul 30 17:39:29.728197 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.728169    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bx88\" (UniqueName: \"kubernetes.io/projected/6c50f989-19f1-47ff-b3a4-8eab8618d89c-kube-api-access-8bx88\") pod \"authorino-75d556bd77-vltlm\" (UID: \"6c50f989-19f1-47ff-b3a4-8eab8618d89c\") " pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:39:29.737709 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.737682    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bx88\" (UniqueName: \"kubernetes.io/projected/6c50f989-19f1-47ff-b3a4-8eab8618d89c-kube-api-access-8bx88\") pod \"authorino-75d556bd77-vltlm\" (UID: \"6c50f989-19f1-47ff-b3a4-8eab8618d89c\") " pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:39:29.913648 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:29.913561    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:39:30.036034 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:30.036008    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vltlm"]
Jul 30 17:39:30.038241 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:39:30.038215    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c50f989_19f1_47ff_b3a4_8eab8618d89c.slice/crio-f299c9fdb9e0f7e8ac1b2f212c6470cff75591f96a1e27ae259a301938a18f71 WatchSource:0}: Error finding container f299c9fdb9e0f7e8ac1b2f212c6470cff75591f96a1e27ae259a301938a18f71: Status 404 returned error can't find the container with id f299c9fdb9e0f7e8ac1b2f212c6470cff75591f96a1e27ae259a301938a18f71
Jul 30 17:39:30.702042 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:30.701970    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vltlm" event={"ID":"6c50f989-19f1-47ff-b3a4-8eab8618d89c","Type":"ContainerStarted","Data":"f299c9fdb9e0f7e8ac1b2f212c6470cff75591f96a1e27ae259a301938a18f71"}
Jul 30 17:39:30.704400 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:30.704366    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46" event={"ID":"75d1665e-e96a-4ffd-bf64-1717f8b5fe01","Type":"ContainerStarted","Data":"694a16ffd36d031c4cd279cf86f174118c3b4c6311a23e9aa6cfd6e2b6f0d025"}
Jul 30 17:39:35.731511 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:35.731472    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46" event={"ID":"75d1665e-e96a-4ffd-bf64-1717f8b5fe01","Type":"ContainerStarted","Data":"0a51db393d1b27a940bea426e34673eec6a4a01af8e19ec51f3f30f30dd11cd8"}
Jul 30 17:39:35.732040 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:35.731543    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:39:35.733072 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:35.733046    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vltlm" event={"ID":"6c50f989-19f1-47ff-b3a4-8eab8618d89c","Type":"ContainerStarted","Data":"c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf"}
Jul 30 17:39:35.749682 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:35.749632    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46" podStartSLOduration=1.5209688300000002 podStartE2EDuration="6.749619233s" totalImagesPullingTime="5.228650403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:39:35.749147242 +0000 UTC m=+757.474831534" watchObservedRunningTime="2026-07-30 17:39:35.749619233 +0000 UTC m=+757.475303513"
Jul 30 17:39:35.765380 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:35.765342    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vltlm" podStartSLOduration=1.878680981 podStartE2EDuration="6.765329545s" totalImagesPullingTime="4.886648564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:39:35.763930083 +0000 UTC m=+757.489614363" watchObservedRunningTime="2026-07-30 17:39:35.765329545 +0000 UTC m=+757.491013825"
Jul 30 17:39:46.739870 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:39:46.739837    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bsw46"
Jul 30 17:40:05.341453 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.341418    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vltlm"]
Jul 30 17:40:05.341971 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.341583    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vltlm" podUID="6c50f989-19f1-47ff-b3a4-8eab8618d89c" containerName="authorino" containerID="cri-o://c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf" gracePeriod=30
Jul 30 17:40:05.595254 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.595193    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:40:05.728304 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.728272    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bx88\" (UniqueName: \"kubernetes.io/projected/6c50f989-19f1-47ff-b3a4-8eab8618d89c-kube-api-access-8bx88\") pod \"6c50f989-19f1-47ff-b3a4-8eab8618d89c\" (UID: \"6c50f989-19f1-47ff-b3a4-8eab8618d89c\") "
Jul 30 17:40:05.730343 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.730310    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c50f989-19f1-47ff-b3a4-8eab8618d89c-kube-api-access-8bx88" (OuterVolumeSpecName: "kube-api-access-8bx88") pod "6c50f989-19f1-47ff-b3a4-8eab8618d89c" (UID: "6c50f989-19f1-47ff-b3a4-8eab8618d89c"). InnerVolumeSpecName "kube-api-access-8bx88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:40:05.829782 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.829740    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bx88\" (UniqueName: \"kubernetes.io/projected/6c50f989-19f1-47ff-b3a4-8eab8618d89c-kube-api-access-8bx88\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:40:05.861526 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.861451    2538 generic.go:356] "Generic (PLEG): container finished" podID="6c50f989-19f1-47ff-b3a4-8eab8618d89c" containerID="c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf" exitCode=0
Jul 30 17:40:05.861526 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.861497    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vltlm"
Jul 30 17:40:05.861777 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.861537    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vltlm" event={"ID":"6c50f989-19f1-47ff-b3a4-8eab8618d89c","Type":"ContainerDied","Data":"c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf"}
Jul 30 17:40:05.861777 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.861583    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vltlm" event={"ID":"6c50f989-19f1-47ff-b3a4-8eab8618d89c","Type":"ContainerDied","Data":"f299c9fdb9e0f7e8ac1b2f212c6470cff75591f96a1e27ae259a301938a18f71"}
Jul 30 17:40:05.861777 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.861604    2538 scope.go:117] "RemoveContainer" containerID="c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf"
Jul 30 17:40:05.870221 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.870203    2538 scope.go:117] "RemoveContainer" containerID="c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf"
Jul 30 17:40:05.870491 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:40:05.870474    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf\": container with ID starting with c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf not found: ID does not exist" containerID="c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf"
Jul 30 17:40:05.870561 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.870499    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf"} err="failed to get container status \"c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf\": rpc error: code = NotFound desc = could not find container \"c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf\": container with ID starting with c2c04045a55e10d9b80f6ffe9b8fb67c9ae646f711fb37b7fd828a3a58bb0baf not found: ID does not exist"
Jul 30 17:40:05.881659 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.881628    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vltlm"]
Jul 30 17:40:05.888113 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:05.888089    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vltlm"]
Jul 30 17:40:06.826480 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:06.826449    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c50f989-19f1-47ff-b3a4-8eab8618d89c" path="/var/lib/kubelet/pods/6c50f989-19f1-47ff-b3a4-8eab8618d89c/volumes"
Jul 30 17:40:47.261598 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:40:47.261561    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:04.914869 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:04.914834    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:13.208705 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.208657    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"]
Jul 30 17:41:13.209199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.209160    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c50f989-19f1-47ff-b3a4-8eab8618d89c" containerName="authorino"
Jul 30 17:41:13.209199 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.209177    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c50f989-19f1-47ff-b3a4-8eab8618d89c" containerName="authorino"
Jul 30 17:41:13.209310 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.209253    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c50f989-19f1-47ff-b3a4-8eab8618d89c" containerName="authorino"
Jul 30 17:41:13.213736 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.213713    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.217435 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.217411    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 17:41:13.217688 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.217673    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lr279\""
Jul 30 17:41:13.217794 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.217776    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 17:41:13.217918 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.217904    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 30 17:41:13.222527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.222502    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"]
Jul 30 17:41:13.392081 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.392044    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8cg4\" (UniqueName: \"kubernetes.io/projected/2cb72f7a-33dd-4551-8d43-e95e3529932d-kube-api-access-f8cg4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.392251 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.392093    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.392251 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.392169    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.392251 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.392242    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cb72f7a-33dd-4551-8d43-e95e3529932d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.392360 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.392291    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.392360 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.392309    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493424 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493332    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493424 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493394    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493435    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8cg4\" (UniqueName: \"kubernetes.io/projected/2cb72f7a-33dd-4551-8d43-e95e3529932d-kube-api-access-f8cg4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493457    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493495    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493655 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493537    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cb72f7a-33dd-4551-8d43-e95e3529932d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493648    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493858    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.493950 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.493908    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.495579 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.495550    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cb72f7a-33dd-4551-8d43-e95e3529932d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.495901 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.495859    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cb72f7a-33dd-4551-8d43-e95e3529932d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.501702 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.501680    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8cg4\" (UniqueName: \"kubernetes.io/projected/2cb72f7a-33dd-4551-8d43-e95e3529932d-kube-api-access-f8cg4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqgxz\" (UID: \"2cb72f7a-33dd-4551-8d43-e95e3529932d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.525626 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.525596    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:13.653894 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:13.653851    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"]
Jul 30 17:41:13.656002 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:41:13.655972    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb72f7a_33dd_4551_8d43_e95e3529932d.slice/crio-172afe02625421045ae776f7285659766689518b17d726ca7905394688bc3046 WatchSource:0}: Error finding container 172afe02625421045ae776f7285659766689518b17d726ca7905394688bc3046: Status 404 returned error can't find the container with id 172afe02625421045ae776f7285659766689518b17d726ca7905394688bc3046
Jul 30 17:41:14.020310 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:14.020279    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:14.156082 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:14.156026    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz" event={"ID":"2cb72f7a-33dd-4551-8d43-e95e3529932d","Type":"ContainerStarted","Data":"172afe02625421045ae776f7285659766689518b17d726ca7905394688bc3046"}
Jul 30 17:41:15.161953 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:15.161911    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz" event={"ID":"2cb72f7a-33dd-4551-8d43-e95e3529932d","Type":"ContainerStarted","Data":"45735aff5d6e6ab8ffd3799bf593016ebe6159f4c35f0c7bad4f8e85dd2eab6c"}
Jul 30 17:41:15.183888 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:15.183823    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz" podStartSLOduration=1.192290254 podStartE2EDuration="2.183807098s" totalImagesPullingTime="991.516844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:41:15.182625782 +0000 UTC m=+856.908310062" watchObservedRunningTime="2026-07-30 17:41:15.183807098 +0000 UTC m=+856.909491378"
Jul 30 17:41:22.312630 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:22.312594    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:23.526572 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:23.526517    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:23.527098 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:23.526619    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:23.539217 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:23.539193    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:24.210991 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:24.210963    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqgxz"
Jul 30 17:41:31.519472 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:31.519435    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:39.312018 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:39.311980    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:50.215545 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.215509    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"]
Jul 30 17:41:50.221452 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.221433    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.224986 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.224958    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 17:41:50.228167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.228142    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"]
Jul 30 17:41:50.282555 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.282522    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.282679 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.282558    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633f6680-958b-4e85-896a-14fbe50e0ef7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.282679 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.282578    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcj6b\" (UniqueName: \"kubernetes.io/projected/633f6680-958b-4e85-896a-14fbe50e0ef7-kube-api-access-hcj6b\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.282679 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.282627    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.282679 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.282676    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.282938 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.282719    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.383571 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.383498    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.383571 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.383544    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.383760 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.383579    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.383760 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.383620    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.383760 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.383646    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633f6680-958b-4e85-896a-14fbe50e0ef7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.383760 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.383667    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcj6b\" (UniqueName: \"kubernetes.io/projected/633f6680-958b-4e85-896a-14fbe50e0ef7-kube-api-access-hcj6b\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.384104 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.384072    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.384222 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.384097    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.384222 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.384145    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.385743 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.385719    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633f6680-958b-4e85-896a-14fbe50e0ef7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.386092 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.386073    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633f6680-958b-4e85-896a-14fbe50e0ef7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.395021 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.395002    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcj6b\" (UniqueName: \"kubernetes.io/projected/633f6680-958b-4e85-896a-14fbe50e0ef7-kube-api-access-hcj6b\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vd948\" (UID: \"633f6680-958b-4e85-896a-14fbe50e0ef7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.549070 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.549000    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:41:50.698253 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:50.698228    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"]
Jul 30 17:41:50.699932 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:41:50.699905    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod633f6680_958b_4e85_896a_14fbe50e0ef7.slice/crio-fe3f99a0d21612884bd8d7d305302aac67ee0a86c8f26068db33d726454289c9 WatchSource:0}: Error finding container fe3f99a0d21612884bd8d7d305302aac67ee0a86c8f26068db33d726454289c9: Status 404 returned error can't find the container with id fe3f99a0d21612884bd8d7d305302aac67ee0a86c8f26068db33d726454289c9
Jul 30 17:41:51.316744 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:51.316712    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948" event={"ID":"633f6680-958b-4e85-896a-14fbe50e0ef7","Type":"ContainerStarted","Data":"e607cd519ad1bf195f898d90f7210f2107aee8829ccc4ae08229efc529c059a3"}
Jul 30 17:41:51.317129 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:51.316753    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948" event={"ID":"633f6680-958b-4e85-896a-14fbe50e0ef7","Type":"ContainerStarted","Data":"fe3f99a0d21612884bd8d7d305302aac67ee0a86c8f26068db33d726454289c9"}
Jul 30 17:41:51.336714 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:51.336659    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948" podStartSLOduration=1.172886404 podStartE2EDuration="1.33663771s" totalImagesPullingTime="163.751306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:41:51.335617692 +0000 UTC m=+893.061301972" watchObservedRunningTime="2026-07-30 17:41:51.33663771 +0000 UTC m=+893.062321990"
Jul 30 17:41:53.628120 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:53.628084    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:41:58.703264 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:58.703235    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:41:58.705496 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:41:58.705475    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:42:00.549598 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:42:00.549562    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:42:00.550031 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:42:00.549621    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:42:00.562023 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:42:00.562000    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:42:01.375129 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:42:01.375102    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vd948"
Jul 30 17:43:20.249353 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.249313    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-988fbf677-xwmz2"]
Jul 30 17:43:20.252546 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.252529    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.256136 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.256111    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d8xl2\""
Jul 30 17:43:20.256807 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.256785    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 17:43:20.262796 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.262775    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-988fbf677-xwmz2"]
Jul 30 17:43:20.333973 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.333905    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7znbq\" (UniqueName: \"kubernetes.io/projected/114d6a7b-721a-4afe-9e65-baed75cdac37-kube-api-access-7znbq\") pod \"authorino-988fbf677-xwmz2\" (UID: \"114d6a7b-721a-4afe-9e65-baed75cdac37\") " pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.333973 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.333955    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/114d6a7b-721a-4afe-9e65-baed75cdac37-tls-cert\") pod \"authorino-988fbf677-xwmz2\" (UID: \"114d6a7b-721a-4afe-9e65-baed75cdac37\") " pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.434779 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.434745    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7znbq\" (UniqueName: \"kubernetes.io/projected/114d6a7b-721a-4afe-9e65-baed75cdac37-kube-api-access-7znbq\") pod \"authorino-988fbf677-xwmz2\" (UID: \"114d6a7b-721a-4afe-9e65-baed75cdac37\") " pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.434952 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.434807    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/114d6a7b-721a-4afe-9e65-baed75cdac37-tls-cert\") pod \"authorino-988fbf677-xwmz2\" (UID: \"114d6a7b-721a-4afe-9e65-baed75cdac37\") " pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.437260 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.437233    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/114d6a7b-721a-4afe-9e65-baed75cdac37-tls-cert\") pod \"authorino-988fbf677-xwmz2\" (UID: \"114d6a7b-721a-4afe-9e65-baed75cdac37\") " pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.443011 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.442989    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7znbq\" (UniqueName: \"kubernetes.io/projected/114d6a7b-721a-4afe-9e65-baed75cdac37-kube-api-access-7znbq\") pod \"authorino-988fbf677-xwmz2\" (UID: \"114d6a7b-721a-4afe-9e65-baed75cdac37\") " pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.560954 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.560869    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-988fbf677-xwmz2"
Jul 30 17:43:20.687561 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.687537    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-988fbf677-xwmz2"]
Jul 30 17:43:20.689929 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:43:20.689900    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod114d6a7b_721a_4afe_9e65_baed75cdac37.slice/crio-db318c0be1db09d955a5eddfac733e9ac04215b2cf73df55320afa796bb3da82 WatchSource:0}: Error finding container db318c0be1db09d955a5eddfac733e9ac04215b2cf73df55320afa796bb3da82: Status 404 returned error can't find the container with id db318c0be1db09d955a5eddfac733e9ac04215b2cf73df55320afa796bb3da82
Jul 30 17:43:20.691227 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.691209    2538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 17:43:20.736597 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:20.736569    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-988fbf677-xwmz2" event={"ID":"114d6a7b-721a-4afe-9e65-baed75cdac37","Type":"ContainerStarted","Data":"db318c0be1db09d955a5eddfac733e9ac04215b2cf73df55320afa796bb3da82"}
Jul 30 17:43:21.743510 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:21.743466    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-988fbf677-xwmz2" event={"ID":"114d6a7b-721a-4afe-9e65-baed75cdac37","Type":"ContainerStarted","Data":"cb35d287a78e9a6eb8bbaa6e4e3ca26b41389df3a1355d7b2bf13fd12cf562b7"}
Jul 30 17:43:21.766679 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:21.766623    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-988fbf677-xwmz2" podStartSLOduration=1.423839158 podStartE2EDuration="1.76660688s" totalImagesPullingTime="342.767722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:43:21.764871254 +0000 UTC m=+983.490567152" watchObservedRunningTime="2026-07-30 17:43:21.76660688 +0000 UTC m=+983.492291160"
Jul 30 17:43:53.719218 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:43:53.719178    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:44:03.219207 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:44:03.219165    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:44:13.234053 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:44:13.234016    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:45:57.619146 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:45:57.619108    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:46:05.915080 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:46:05.915041    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:46:58.119403 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:46:58.119368    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:46:58.732410 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:46:58.732382    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:46:58.736627 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:46:58.736599    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:47:07.823744 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:47:07.823707    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:47:33.628664 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:47:33.628621    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:47:42.721417 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:47:42.721380    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:47:53.231239 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:47:53.231161    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:48:05.026735 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:48:05.026689    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:48:15.914617 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:48:15.914583    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:48:25.421012 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:48:25.420977    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:48:48.121570 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:48:48.121531    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:49:02.917525 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:49:02.917489    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:49:22.042298 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:49:22.042198    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:49:44.618834 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:49:44.618800    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:50:00.324838 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:50:00.324799    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:50:21.112399 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:50:21.112363    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:50:35.716940 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:50:35.716898    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:50:51.322238 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:50:51.322201    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:51:05.221730 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:05.221691    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:51:14.416563 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:14.416525    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:51:37.023652 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:37.023617    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:51:46.029990 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:46.029951    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:51:56.510381 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:56.510341    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:51:58.764857 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:58.764823    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:51:58.767433 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:51:58.767409    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:54:07.619533 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:54:07.619495    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:54:17.427832 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:54:17.427792    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:54:40.027480 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:54:40.027443    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:54:58.820082 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:54:58.820044    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:55:07.420209 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:55:07.420174    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:55:17.010410 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:55:17.010376    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:55:26.718179 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:55:26.718092    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:55:36.226339 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:55:36.226297    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:55:45.710234 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:55:45.710196    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:55:57.612313 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:55:57.612274    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:56:10.024733 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:56:10.024696    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:56:19.423267 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:56:19.423226    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:56:45.624906 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:56:45.624852    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:56:53.021011 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:56:53.020930    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:56:58.794662 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:56:58.794634    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:56:58.797166 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:56:58.797141    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 17:57:01.627188 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.627150    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"]
Jul 30 17:57:01.630316 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.630296    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.633018 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.632997    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-215b0c63-kserve-self-signed-certs\""
Jul 30 17:57:01.646534 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.646511    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"]
Jul 30 17:57:01.716433 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.716400    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tls-certs\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.716433 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.716432    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tmp-dir\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.716629 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.716477    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-home\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.716629 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.716567    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkk56\" (UniqueName: \"kubernetes.io/projected/3ef9679e-a6f5-4c31-82e1-e6cae6405525-kube-api-access-dkk56\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.716629 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.716610    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-dshm\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.716739 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.716643    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-model-cache\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.817782 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.817754    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-dshm\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.817926 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.817786    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-model-cache\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.817926 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.817812    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tls-certs\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.817926 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.817837    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tmp-dir\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.817926 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.817915    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-home\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.818376 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.817969    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkk56\" (UniqueName: \"kubernetes.io/projected/3ef9679e-a6f5-4c31-82e1-e6cae6405525-kube-api-access-dkk56\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.818376 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.818265    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-model-cache\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.818482 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.818399    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tmp-dir\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.818482 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.818423    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-home\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.819975 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.819951    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-dshm\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.820278 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.820263    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tls-certs\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.826752 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.826733    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkk56\" (UniqueName: \"kubernetes.io/projected/3ef9679e-a6f5-4c31-82e1-e6cae6405525-kube-api-access-dkk56\") pod \"e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") " pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:01.939527 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:01.939448    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:02.071499 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:02.071474    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"]
Jul 30 17:57:02.073318 ip-10-0-137-250 kubenswrapper[2538]: W0730 17:57:02.073287    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ef9679e_a6f5_4c31_82e1_e6cae6405525.slice/crio-e6ad007215ab147c90a5d7637d1ab619c0614b1957f334ea35bda36494ea8f58 WatchSource:0}: Error finding container e6ad007215ab147c90a5d7637d1ab619c0614b1957f334ea35bda36494ea8f58: Status 404 returned error can't find the container with id e6ad007215ab147c90a5d7637d1ab619c0614b1957f334ea35bda36494ea8f58
Jul 30 17:57:02.457182 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:02.457136    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg" event={"ID":"3ef9679e-a6f5-4c31-82e1-e6cae6405525","Type":"ContainerStarted","Data":"c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e"}
Jul 30 17:57:02.457349 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:02.457190    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg" event={"ID":"3ef9679e-a6f5-4c31-82e1-e6cae6405525","Type":"ContainerStarted","Data":"e6ad007215ab147c90a5d7637d1ab619c0614b1957f334ea35bda36494ea8f58"}
Jul 30 17:57:02.476634 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:02.476579    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg" podStartSLOduration=1.476560311 podStartE2EDuration="1.476560311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 17:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 17:57:02.475639662 +0000 UTC m=+1804.201323941" watchObservedRunningTime="2026-07-30 17:57:02.476560311 +0000 UTC m=+1804.202244594"
Jul 30 17:57:05.228457 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:05.228415    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:57:11.940566 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:11.940471    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:11.940566 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:11.940523    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:11.953414 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:11.953389    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:12.515805 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:12.515770    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:22.239508 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:22.239472    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:57:42.235595 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:42.235553    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"]
Jul 30 17:57:45.925918 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:45.925868    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:57:57.256439 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.256364    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg" podUID="3ef9679e-a6f5-4c31-82e1-e6cae6405525" containerName="main" containerID="cri-o://c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e" gracePeriod=45
Jul 30 17:57:57.515096 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.515017    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:57.632923 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.632855    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-home\") pod \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") "
Jul 30 17:57:57.633127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.632939    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tls-certs\") pod \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") "
Jul 30 17:57:57.633127 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.632986    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tmp-dir\") pod \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") "
Jul 30 17:57:57.633246 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633141    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-home" (OuterVolumeSpecName: "home") pod "3ef9679e-a6f5-4c31-82e1-e6cae6405525" (UID: "3ef9679e-a6f5-4c31-82e1-e6cae6405525"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:57:57.633246 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633174    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-dshm\") pod \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") "
Jul 30 17:57:57.633246 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633215    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-model-cache\") pod \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") "
Jul 30 17:57:57.633386 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633265    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkk56\" (UniqueName: \"kubernetes.io/projected/3ef9679e-a6f5-4c31-82e1-e6cae6405525-kube-api-access-dkk56\") pod \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\" (UID: \"3ef9679e-a6f5-4c31-82e1-e6cae6405525\") "
Jul 30 17:57:57.633386 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633296    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ef9679e-a6f5-4c31-82e1-e6cae6405525" (UID: "3ef9679e-a6f5-4c31-82e1-e6cae6405525"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:57:57.633482 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633471    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:57:57.633541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633483    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:57:57.633541 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.633493    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ef9679e-a6f5-4c31-82e1-e6cae6405525" (UID: "3ef9679e-a6f5-4c31-82e1-e6cae6405525"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:57:57.635405 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.635377    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef9679e-a6f5-4c31-82e1-e6cae6405525-kube-api-access-dkk56" (OuterVolumeSpecName: "kube-api-access-dkk56") pod "3ef9679e-a6f5-4c31-82e1-e6cae6405525" (UID: "3ef9679e-a6f5-4c31-82e1-e6cae6405525"). InnerVolumeSpecName "kube-api-access-dkk56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 17:57:57.635405 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.635377    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ef9679e-a6f5-4c31-82e1-e6cae6405525" (UID: "3ef9679e-a6f5-4c31-82e1-e6cae6405525"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 17:57:57.635543 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.635377    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-dshm" (OuterVolumeSpecName: "dshm") pod "3ef9679e-a6f5-4c31-82e1-e6cae6405525" (UID: "3ef9679e-a6f5-4c31-82e1-e6cae6405525"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 17:57:57.710602 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.710567    2538 generic.go:356] "Generic (PLEG): container finished" podID="3ef9679e-a6f5-4c31-82e1-e6cae6405525" containerID="c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e" exitCode=0
Jul 30 17:57:57.710833 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.710610    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"
Jul 30 17:57:57.710833 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.710649    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg" event={"ID":"3ef9679e-a6f5-4c31-82e1-e6cae6405525","Type":"ContainerDied","Data":"c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e"}
Jul 30 17:57:57.710833 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.710692    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg" event={"ID":"3ef9679e-a6f5-4c31-82e1-e6cae6405525","Type":"ContainerDied","Data":"e6ad007215ab147c90a5d7637d1ab619c0614b1957f334ea35bda36494ea8f58"}
Jul 30 17:57:57.710833 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.710709    2538 scope.go:117] "RemoveContainer" containerID="c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e"
Jul 30 17:57:57.719998 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.719976    2538 scope.go:117] "RemoveContainer" containerID="c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e"
Jul 30 17:57:57.720270 ip-10-0-137-250 kubenswrapper[2538]: E0730 17:57:57.720247    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e\": container with ID starting with c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e not found: ID does not exist" containerID="c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e"
Jul 30 17:57:57.720310 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.720281    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e"} err="failed to get container status \"c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e\": rpc error: code = NotFound desc = could not find container \"c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e\": container with ID starting with c8f772c343359635d6191f6902bc416cdd2a28a95b3bda4c6bd3d109339a389e not found: ID does not exist"
Jul 30 17:57:57.732563 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.732538    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"]
Jul 30 17:57:57.734266 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.734249    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:57:57.734361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.734269    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef9679e-a6f5-4c31-82e1-e6cae6405525-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:57:57.734361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.734282    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkk56\" (UniqueName: \"kubernetes.io/projected/3ef9679e-a6f5-4c31-82e1-e6cae6405525-kube-api-access-dkk56\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:57:57.734361 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.734297    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ef9679e-a6f5-4c31-82e1-e6cae6405525-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 17:57:57.737179 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:57.737156    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-215b0c63-kserve-568ff9b6cf-7g6sg"]
Jul 30 17:57:58.826167 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:57:58.826144    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ef9679e-a6f5-4c31-82e1-e6cae6405525" path="/var/lib/kubelet/pods/3ef9679e-a6f5-4c31-82e1-e6cae6405525/volumes"
Jul 30 17:58:00.631075 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:58:00.631041    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:58:10.828928 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:58:10.828894    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:58:23.624860 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:58:23.624775    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:58:39.023703 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:58:39.023671    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:58:49.725852 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:58:49.725822    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:58:58.724925 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:58:58.724886    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:59:09.130011 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:59:09.129977    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:59:18.517503 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:59:18.517467    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:59:31.430178 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:59:31.430146    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:59:41.238585 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:59:41.238551    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 17:59:51.526387 ip-10-0-137-250 kubenswrapper[2538]: I0730 17:59:51.526301    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:00:01.421715 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:00:01.421674    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:00:14.125973 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:00:14.125934    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:00:23.016544 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:00:23.016506    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:00:45.320596 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:00:45.320563    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:00:57.316035 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:00:57.315997    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:01:13.118420 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:01:13.118384    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:01:28.126210 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:01:28.126133    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:01:37.415104 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:01:37.415072    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:01:50.415900 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:01:50.415833    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:01:58.821696 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:01:58.821666    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:01:58.826248 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:01:58.826223    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:02:05.815504 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:05.815464    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:02:15.223700 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:15.223666    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:02:25.421799 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:25.421765    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:02:37.227438 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:37.227402    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:02:54.668068 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.668030    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"]
Jul 30 18:02:54.668447 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.668384    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef9679e-a6f5-4c31-82e1-e6cae6405525" containerName="main"
Jul 30 18:02:54.668447 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.668396    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef9679e-a6f5-4c31-82e1-e6cae6405525" containerName="main"
Jul 30 18:02:54.668522 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.668468    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef9679e-a6f5-4c31-82e1-e6cae6405525" containerName="main"
Jul 30 18:02:54.671588 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.671573    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:02:54.674303 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.674279    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:02:54.674421 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.674284    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:02:54.678345 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.678300    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"]
Jul 30 18:02:54.733922 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.733869    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72230b6-831c-4c50-b9c0-8f091a3cfd56-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7\" (UID: \"c72230b6-831c-4c50-b9c0-8f091a3cfd56\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:02:54.835169 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.835142    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72230b6-831c-4c50-b9c0-8f091a3cfd56-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7\" (UID: \"c72230b6-831c-4c50-b9c0-8f091a3cfd56\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:02:54.835740 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.835723    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72230b6-831c-4c50-b9c0-8f091a3cfd56-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7\" (UID: \"c72230b6-831c-4c50-b9c0-8f091a3cfd56\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:02:54.982836 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:54.982802    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:02:55.117151 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:55.117127    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"]
Jul 30 18:02:55.119704 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:02:55.119672    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-6203d834af431815c00e40551d9c8a018fee9b7552e2d6a51d921cc40affb111 WatchSource:0}: Error finding container 6203d834af431815c00e40551d9c8a018fee9b7552e2d6a51d921cc40affb111: Status 404 returned error can't find the container with id 6203d834af431815c00e40551d9c8a018fee9b7552e2d6a51d921cc40affb111
Jul 30 18:02:55.121508 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:55.121489    2538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 18:02:56.065395 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:56.065359    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7" event={"ID":"c72230b6-831c-4c50-b9c0-8f091a3cfd56","Type":"ContainerStarted","Data":"6203d834af431815c00e40551d9c8a018fee9b7552e2d6a51d921cc40affb111"}
Jul 30 18:02:59.080577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:59.080540    2538 generic.go:356] "Generic (PLEG): container finished" podID="c72230b6-831c-4c50-b9c0-8f091a3cfd56" containerID="721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340" exitCode=0
Jul 30 18:02:59.081026 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:02:59.080631    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7" event={"ID":"c72230b6-831c-4c50-b9c0-8f091a3cfd56","Type":"ContainerDied","Data":"721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340"}
Jul 30 18:03:00.214275 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:00.214249    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:03:00.281733 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:00.281706    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72230b6-831c-4c50-b9c0-8f091a3cfd56-maas-api-service-ca\") pod \"c72230b6-831c-4c50-b9c0-8f091a3cfd56\" (UID: \"c72230b6-831c-4c50-b9c0-8f091a3cfd56\") "
Jul 30 18:03:00.282055 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:00.282031    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c72230b6-831c-4c50-b9c0-8f091a3cfd56-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c72230b6-831c-4c50-b9c0-8f091a3cfd56" (UID: "c72230b6-831c-4c50-b9c0-8f091a3cfd56"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:03:00.383055 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:00.382987    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c72230b6-831c-4c50-b9c0-8f091a3cfd56-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:03:01.090231 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:01.090157    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"
Jul 30 18:03:01.090231 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:01.090165    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7" event={"ID":"c72230b6-831c-4c50-b9c0-8f091a3cfd56","Type":"ContainerDied","Data":"6203d834af431815c00e40551d9c8a018fee9b7552e2d6a51d921cc40affb111"}
Jul 30 18:03:01.090231 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:01.090208    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6203d834af431815c00e40551d9c8a018fee9b7552e2d6a51d921cc40affb111"
Jul 30 18:03:03.539438 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:03.539403    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:03.539781 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:03.539403    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:05.088517 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:05.088473    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:07.546363 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:07.546325    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:10.915014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:10.914968    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"]
Jul 30 18:03:10.920092 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:10.920066    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a48bf8b-54xm7"]
Jul 30 18:03:12.826517 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:12.826481    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72230b6-831c-4c50-b9c0-8f091a3cfd56" path="/var/lib/kubelet/pods/c72230b6-831c-4c50-b9c0-8f091a3cfd56/volumes"
Jul 30 18:03:14.921064 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:14.921035    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:03:15.132790 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:15.132758    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:22.574380 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:22.574344    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:25.141969 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:25.141932    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:25.528268 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:25.528232    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:03:35.151232 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:35.151194    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:37.562307 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:37.562270    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:39.457964 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.457926    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"]
Jul 30 18:03:39.458347 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.458269    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72230b6-831c-4c50-b9c0-8f091a3cfd56" containerName="revoke-keys"
Jul 30 18:03:39.458347 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.458280    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72230b6-831c-4c50-b9c0-8f091a3cfd56" containerName="revoke-keys"
Jul 30 18:03:39.458347 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.458335    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72230b6-831c-4c50-b9c0-8f091a3cfd56" containerName="revoke-keys"
Jul 30 18:03:39.460453 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.460437    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:39.463278 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.463250    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:03:39.463278 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.463258    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:03:39.468913 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.468854    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"]
Jul 30 18:03:39.616405 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.616374    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f89b24f-1e83-4cf1-baac-c02729453077-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fee844af-f62dr\" (UID: \"1f89b24f-1e83-4cf1-baac-c02729453077\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:39.717716 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.717646    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f89b24f-1e83-4cf1-baac-c02729453077-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fee844af-f62dr\" (UID: \"1f89b24f-1e83-4cf1-baac-c02729453077\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:39.718328 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.718308    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f89b24f-1e83-4cf1-baac-c02729453077-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fee844af-f62dr\" (UID: \"1f89b24f-1e83-4cf1-baac-c02729453077\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:39.771559 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.771518    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:39.899558 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:39.899533    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"]
Jul 30 18:03:39.901438 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:03:39.901410    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f89b24f_1e83_4cf1_baac_c02729453077.slice/crio-39b875c69b7c644858febe0f59fe14ff77b6a1b908a0338ac14fc3ee7af57abb WatchSource:0}: Error finding container 39b875c69b7c644858febe0f59fe14ff77b6a1b908a0338ac14fc3ee7af57abb: Status 404 returned error can't find the container with id 39b875c69b7c644858febe0f59fe14ff77b6a1b908a0338ac14fc3ee7af57abb
Jul 30 18:03:40.269229 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:40.269192    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr" event={"ID":"1f89b24f-1e83-4cf1-baac-c02729453077","Type":"ContainerStarted","Data":"51c38f8ffdd1008064b3ece21b34f42236c87a9ba7baed43dc42ce087f54d46f"}
Jul 30 18:03:40.269333 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:40.269288    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr" event={"ID":"1f89b24f-1e83-4cf1-baac-c02729453077","Type":"ContainerStarted","Data":"39b875c69b7c644858febe0f59fe14ff77b6a1b908a0338ac14fc3ee7af57abb"}
Jul 30 18:03:40.285726 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:40.285685    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr" podStartSLOduration=1.285670737 podStartE2EDuration="1.285670737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:03:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:03:40.284672259 +0000 UTC m=+2202.010356540" watchObservedRunningTime="2026-07-30 18:03:40.285670737 +0000 UTC m=+2202.011355071"
Jul 30 18:03:41.275031 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:41.274995    2538 generic.go:356] "Generic (PLEG): container finished" podID="1f89b24f-1e83-4cf1-baac-c02729453077" containerID="51c38f8ffdd1008064b3ece21b34f42236c87a9ba7baed43dc42ce087f54d46f" exitCode=0
Jul 30 18:03:41.275422 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:41.275072    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr" event={"ID":"1f89b24f-1e83-4cf1-baac-c02729453077","Type":"ContainerDied","Data":"51c38f8ffdd1008064b3ece21b34f42236c87a9ba7baed43dc42ce087f54d46f"}
Jul 30 18:03:42.405921 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:42.405896    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:42.433421 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:42.433396    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f89b24f-1e83-4cf1-baac-c02729453077-maas-api-service-ca\") pod \"1f89b24f-1e83-4cf1-baac-c02729453077\" (UID: \"1f89b24f-1e83-4cf1-baac-c02729453077\") "
Jul 30 18:03:42.433695 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:42.433674    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f89b24f-1e83-4cf1-baac-c02729453077-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f89b24f-1e83-4cf1-baac-c02729453077" (UID: "1f89b24f-1e83-4cf1-baac-c02729453077"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:03:42.534034 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:42.533963    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f89b24f-1e83-4cf1-baac-c02729453077-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:03:43.285805 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:43.285774    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"
Jul 30 18:03:43.285979 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:43.285815    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr" event={"ID":"1f89b24f-1e83-4cf1-baac-c02729453077","Type":"ContainerDied","Data":"39b875c69b7c644858febe0f59fe14ff77b6a1b908a0338ac14fc3ee7af57abb"}
Jul 30 18:03:43.285979 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:43.285868    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39b875c69b7c644858febe0f59fe14ff77b6a1b908a0338ac14fc3ee7af57abb"
Jul 30 18:03:45.194094 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:45.194063    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:46.124308 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:46.124267    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"]
Jul 30 18:03:46.128571 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:46.128537    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fee844af-f62dr"]
Jul 30 18:03:46.826293 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:46.826264    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f89b24f-1e83-4cf1-baac-c02729453077" path="/var/lib/kubelet/pods/1f89b24f-1e83-4cf1-baac-c02729453077/volumes"
Jul 30 18:03:49.940648 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:03:49.940610    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:03:52.590545 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:52.590512    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:03:55.203302 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:03:55.203267    2538 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72230b6_831c_4c50_b9c0_8f091a3cfd56.slice/crio-721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340.scope\": RecentStats: unable to find data in memory cache]"
Jul 30 18:04:00.326531 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:00.326497    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:04:15.350092 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.350060    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"]
Jul 30 18:04:15.350552 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.350376    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f89b24f-1e83-4cf1-baac-c02729453077" containerName="revoke-keys"
Jul 30 18:04:15.350552 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.350387    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f89b24f-1e83-4cf1-baac-c02729453077" containerName="revoke-keys"
Jul 30 18:04:15.350552 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.350444    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f89b24f-1e83-4cf1-baac-c02729453077" containerName="revoke-keys"
Jul 30 18:04:15.352324 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.352307    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:15.355073 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.355050    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:04:15.355073 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.355064    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:04:15.360817 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.360794    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"]
Jul 30 18:04:15.509777 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.509745    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd53a78-f025-4f68-bebb-4d8fc6c4610e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq\" (UID: \"cfd53a78-f025-4f68-bebb-4d8fc6c4610e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:15.611143 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.611065    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd53a78-f025-4f68-bebb-4d8fc6c4610e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq\" (UID: \"cfd53a78-f025-4f68-bebb-4d8fc6c4610e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:15.611656 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.611634    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd53a78-f025-4f68-bebb-4d8fc6c4610e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq\" (UID: \"cfd53a78-f025-4f68-bebb-4d8fc6c4610e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:15.663331 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.663302    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:15.788234 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:15.788210    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"]
Jul 30 18:04:15.790122 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:04:15.790088    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd53a78_f025_4f68_bebb_4d8fc6c4610e.slice/crio-e72a70bfe9d8f15ea9f2fed25198c2602cf14d7f91a110d6dccff2e581416637 WatchSource:0}: Error finding container e72a70bfe9d8f15ea9f2fed25198c2602cf14d7f91a110d6dccff2e581416637: Status 404 returned error can't find the container with id e72a70bfe9d8f15ea9f2fed25198c2602cf14d7f91a110d6dccff2e581416637
Jul 30 18:04:16.442462 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:16.442431    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq" event={"ID":"cfd53a78-f025-4f68-bebb-4d8fc6c4610e","Type":"ContainerStarted","Data":"2c7e2bdfb4e6e35b4b05558367f499b4b5fbc372eeb4de0ac0b6c5562d374aed"}
Jul 30 18:04:16.442893 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:16.442480    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq" event={"ID":"cfd53a78-f025-4f68-bebb-4d8fc6c4610e","Type":"ContainerStarted","Data":"e72a70bfe9d8f15ea9f2fed25198c2602cf14d7f91a110d6dccff2e581416637"}
Jul 30 18:04:16.462854 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:16.462805    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq" podStartSLOduration=1.462789238 podStartE2EDuration="1.462789238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:04:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:04:16.461709114 +0000 UTC m=+2238.187393395" watchObservedRunningTime="2026-07-30 18:04:16.462789238 +0000 UTC m=+2238.188473518"
Jul 30 18:04:17.449457 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:17.449422    2538 generic.go:356] "Generic (PLEG): container finished" podID="cfd53a78-f025-4f68-bebb-4d8fc6c4610e" containerID="2c7e2bdfb4e6e35b4b05558367f499b4b5fbc372eeb4de0ac0b6c5562d374aed" exitCode=0
Jul 30 18:04:17.449854 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:17.449474    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq" event={"ID":"cfd53a78-f025-4f68-bebb-4d8fc6c4610e","Type":"ContainerDied","Data":"2c7e2bdfb4e6e35b4b05558367f499b4b5fbc372eeb4de0ac0b6c5562d374aed"}
Jul 30 18:04:18.584870 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:18.584841    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:18.736405 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:18.736310    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd53a78-f025-4f68-bebb-4d8fc6c4610e-maas-api-service-ca\") pod \"cfd53a78-f025-4f68-bebb-4d8fc6c4610e\" (UID: \"cfd53a78-f025-4f68-bebb-4d8fc6c4610e\") "
Jul 30 18:04:18.736743 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:18.736711    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd53a78-f025-4f68-bebb-4d8fc6c4610e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfd53a78-f025-4f68-bebb-4d8fc6c4610e" (UID: "cfd53a78-f025-4f68-bebb-4d8fc6c4610e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:04:18.837449 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:18.837425    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd53a78-f025-4f68-bebb-4d8fc6c4610e-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:04:19.459776 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:19.459745    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"
Jul 30 18:04:19.459776 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:19.459763    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq" event={"ID":"cfd53a78-f025-4f68-bebb-4d8fc6c4610e","Type":"ContainerDied","Data":"e72a70bfe9d8f15ea9f2fed25198c2602cf14d7f91a110d6dccff2e581416637"}
Jul 30 18:04:19.460065 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:19.459806    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e72a70bfe9d8f15ea9f2fed25198c2602cf14d7f91a110d6dccff2e581416637"
Jul 30 18:04:21.878320 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:21.878239    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"]
Jul 30 18:04:21.883713 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:21.883687    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c2052f19-bm9fq"]
Jul 30 18:04:22.826796 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:22.826763    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd53a78-f025-4f68-bebb-4d8fc6c4610e" path="/var/lib/kubelet/pods/cfd53a78-f025-4f68-bebb-4d8fc6c4610e/volumes"
Jul 30 18:04:25.427828 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:25.427792    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:04:37.524231 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:37.524190    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:04:51.612041 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.612003    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"]
Jul 30 18:04:51.612547 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.612399    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd53a78-f025-4f68-bebb-4d8fc6c4610e" containerName="revoke-keys"
Jul 30 18:04:51.612547 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.612412    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd53a78-f025-4f68-bebb-4d8fc6c4610e" containerName="revoke-keys"
Jul 30 18:04:51.612547 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.612467    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd53a78-f025-4f68-bebb-4d8fc6c4610e" containerName="revoke-keys"
Jul 30 18:04:51.614347 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.614329    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:51.617135 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.617112    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:04:51.617252 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.617211    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:04:51.623504 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.623483    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"]
Jul 30 18:04:51.729168 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.729127    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5f556-9733-4fae-95a4-966024ef3147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9995abfe-p99r6\" (UID: \"4cb5f556-9733-4fae-95a4-966024ef3147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:51.829818 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.829787    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5f556-9733-4fae-95a4-966024ef3147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9995abfe-p99r6\" (UID: \"4cb5f556-9733-4fae-95a4-966024ef3147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:51.830413 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.830395    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5f556-9733-4fae-95a4-966024ef3147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9995abfe-p99r6\" (UID: \"4cb5f556-9733-4fae-95a4-966024ef3147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:51.924902 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:51.924794    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:52.051546 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:52.051515    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"]
Jul 30 18:04:52.053912 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:04:52.053863    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb5f556_9733_4fae_95a4_966024ef3147.slice/crio-0286b35c07741868afa88efeb2016a59e73551342fc1eb1d103ab014146d7488 WatchSource:0}: Error finding container 0286b35c07741868afa88efeb2016a59e73551342fc1eb1d103ab014146d7488: Status 404 returned error can't find the container with id 0286b35c07741868afa88efeb2016a59e73551342fc1eb1d103ab014146d7488
Jul 30 18:04:52.620816 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:52.620727    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6" event={"ID":"4cb5f556-9733-4fae-95a4-966024ef3147","Type":"ContainerStarted","Data":"d9e1bc6c409d4b3304f1b5720bb3196fbaa38849778e90f9e58ea365e8ce4089"}
Jul 30 18:04:52.620816 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:52.620781    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6" event={"ID":"4cb5f556-9733-4fae-95a4-966024ef3147","Type":"ContainerStarted","Data":"0286b35c07741868afa88efeb2016a59e73551342fc1eb1d103ab014146d7488"}
Jul 30 18:04:52.635888 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:52.635829    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6" podStartSLOduration=1.6358154649999999 podStartE2EDuration="1.635815465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:04:52.635312987 +0000 UTC m=+2274.360997269" watchObservedRunningTime="2026-07-30 18:04:52.635815465 +0000 UTC m=+2274.361499745"
Jul 30 18:04:53.626665 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:53.626629    2538 generic.go:356] "Generic (PLEG): container finished" podID="4cb5f556-9733-4fae-95a4-966024ef3147" containerID="d9e1bc6c409d4b3304f1b5720bb3196fbaa38849778e90f9e58ea365e8ce4089" exitCode=0
Jul 30 18:04:53.627118 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:53.626693    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6" event={"ID":"4cb5f556-9733-4fae-95a4-966024ef3147","Type":"ContainerDied","Data":"d9e1bc6c409d4b3304f1b5720bb3196fbaa38849778e90f9e58ea365e8ce4089"}
Jul 30 18:04:54.759664 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:54.759638    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:54.855523 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:54.855491    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5f556-9733-4fae-95a4-966024ef3147-maas-api-service-ca\") pod \"4cb5f556-9733-4fae-95a4-966024ef3147\" (UID: \"4cb5f556-9733-4fae-95a4-966024ef3147\") "
Jul 30 18:04:54.855825 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:54.855803    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cb5f556-9733-4fae-95a4-966024ef3147-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4cb5f556-9733-4fae-95a4-966024ef3147" (UID: "4cb5f556-9733-4fae-95a4-966024ef3147"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:04:54.956436 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:54.956401    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb5f556-9733-4fae-95a4-966024ef3147-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:04:55.637828 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:55.637794    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"
Jul 30 18:04:55.637828 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:55.637808    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6" event={"ID":"4cb5f556-9733-4fae-95a4-966024ef3147","Type":"ContainerDied","Data":"0286b35c07741868afa88efeb2016a59e73551342fc1eb1d103ab014146d7488"}
Jul 30 18:04:55.638113 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:55.637851    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0286b35c07741868afa88efeb2016a59e73551342fc1eb1d103ab014146d7488"
Jul 30 18:04:58.614497 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:58.614455    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"]
Jul 30 18:04:58.617359 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:58.617335    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9995abfe-p99r6"]
Jul 30 18:04:58.826053 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:04:58.826018    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cb5f556-9733-4fae-95a4-966024ef3147" path="/var/lib/kubelet/pods/4cb5f556-9733-4fae-95a4-966024ef3147/volumes"
Jul 30 18:05:02.318706 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:05:02.318669    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:05:25.313323 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:05:25.313285    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:06:55.426602 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:06:55.426560    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:06:58.849107 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:06:58.849077    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:06:58.854353 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:06:58.854330    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:07:08.329361 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:08.329322    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:07:21.622164 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:21.622079    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:07:44.744476 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.744435    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"]
Jul 30 18:07:44.745109 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.744929    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cb5f556-9733-4fae-95a4-966024ef3147" containerName="revoke-keys"
Jul 30 18:07:44.745109 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.744948    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cb5f556-9733-4fae-95a4-966024ef3147" containerName="revoke-keys"
Jul 30 18:07:44.745109 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.745077    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cb5f556-9733-4fae-95a4-966024ef3147" containerName="revoke-keys"
Jul 30 18:07:44.747058 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.747036    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:44.749932 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.749915    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:07:44.750016 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.749942    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:07:44.759102 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.759073    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"]
Jul 30 18:07:44.836865 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.836829    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l\" (UID: \"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:44.937774 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.937739    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l\" (UID: \"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:44.938433 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:44.938407    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l\" (UID: \"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:45.060756 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:45.060680    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:45.189767 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:45.189743    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"]
Jul 30 18:07:45.192009 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:07:45.191934    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff0d0f5_7b41_4e42_b77e_f93d1f4713f5.slice/crio-6b2e4c80bc8bbcc46a937df3e8fd0d200292d34967425a01958a993ca80a506b WatchSource:0}: Error finding container 6b2e4c80bc8bbcc46a937df3e8fd0d200292d34967425a01958a993ca80a506b: Status 404 returned error can't find the container with id 6b2e4c80bc8bbcc46a937df3e8fd0d200292d34967425a01958a993ca80a506b
Jul 30 18:07:45.440862 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:45.440819    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l" event={"ID":"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5","Type":"ContainerStarted","Data":"cd84fb77539536ad555421d6c090b35edf38d0c107f1c9656e2cef1e85ca3555"}
Jul 30 18:07:45.441039 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:45.440912    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l" event={"ID":"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5","Type":"ContainerStarted","Data":"6b2e4c80bc8bbcc46a937df3e8fd0d200292d34967425a01958a993ca80a506b"}
Jul 30 18:07:45.458022 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:45.457973    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l" podStartSLOduration=1.457958626 podStartE2EDuration="1.457958626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:07:45.45699525 +0000 UTC m=+2447.182679533" watchObservedRunningTime="2026-07-30 18:07:45.457958626 +0000 UTC m=+2447.183642906"
Jul 30 18:07:46.446374 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:46.446342    2538 generic.go:356] "Generic (PLEG): container finished" podID="8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5" containerID="cd84fb77539536ad555421d6c090b35edf38d0c107f1c9656e2cef1e85ca3555" exitCode=0
Jul 30 18:07:46.446747 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:46.446431    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l" event={"ID":"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5","Type":"ContainerDied","Data":"cd84fb77539536ad555421d6c090b35edf38d0c107f1c9656e2cef1e85ca3555"}
Jul 30 18:07:47.587721 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:47.587681    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:47.760007 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:47.759944    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5-maas-api-service-ca\") pod \"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5\" (UID: \"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5\") "
Jul 30 18:07:47.760349 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:47.760323    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5" (UID: "8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:07:47.861222 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:47.861178    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:07:48.457529 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:48.457499    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"
Jul 30 18:07:48.457529 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:48.457523    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l" event={"ID":"8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5","Type":"ContainerDied","Data":"6b2e4c80bc8bbcc46a937df3e8fd0d200292d34967425a01958a993ca80a506b"}
Jul 30 18:07:48.457754 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:48.457569    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b2e4c80bc8bbcc46a937df3e8fd0d200292d34967425a01958a993ca80a506b"
Jul 30 18:07:55.564961 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:55.564928    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"]
Jul 30 18:07:55.566767 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:55.566740    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e004b9c2-scb7l"]
Jul 30 18:07:56.826302 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:56.826270    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5" path="/var/lib/kubelet/pods/8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5/volumes"
Jul 30 18:07:58.419696 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:07:58.419659    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:08:38.717135 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:08:38.717101    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:08:58.904941 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:08:58.904912    2538 scope.go:117] "RemoveContainer" containerID="721b5da480ed85ed526ea48a3d60941496614baf6d042b0a66c7d6596290d340"
Jul 30 18:09:58.923052 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:09:58.923020    2538 scope.go:117] "RemoveContainer" containerID="51c38f8ffdd1008064b3ece21b34f42236c87a9ba7baed43dc42ce087f54d46f"
Jul 30 18:10:23.629459 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:23.629420    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:10:34.411917 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:34.411868    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:10:49.514095 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.514062    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"]
Jul 30 18:10:49.514551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.514412    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5" containerName="revoke-keys"
Jul 30 18:10:49.514551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.514423    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5" containerName="revoke-keys"
Jul 30 18:10:49.514551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.514485    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ff0d0f5-7b41-4e42-b77e-f93d1f4713f5" containerName="revoke-keys"
Jul 30 18:10:49.517785 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.517769    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.520474 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.520449    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-657b86df\"/\"kube-root-ca.crt\""
Jul 30 18:10:49.520608 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.520568    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-657b86df\"/\"openshift-service-ca.crt\""
Jul 30 18:10:49.521718 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.521701    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-657b86df\"/\"default-dockercfg-5vq9l\""
Jul 30 18:10:49.521808 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.521719    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-657b86df\"/\"e2e-lifecycle-model-657b86df-kserve-self-signed-certs\""
Jul 30 18:10:49.528230 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.528208    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"]
Jul 30 18:10:49.647417 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.647379    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-model-cache\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.647417 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.647417    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-home\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.647635 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.647437    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-tmp-dir\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.647635 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.647505    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-dshm\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.647635 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.647533    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2r74\" (UniqueName: \"kubernetes.io/projected/5d606a2e-1628-484c-a13b-b2c275d10dd9-kube-api-access-b2r74\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.647635 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.647564    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d606a2e-1628-484c-a13b-b2c275d10dd9-tls-certs\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748309 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748273    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-model-cache\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748309 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748310    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-home\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748572 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748328    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-tmp-dir\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748572 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748364    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-dshm\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748572 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748481    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2r74\" (UniqueName: \"kubernetes.io/projected/5d606a2e-1628-484c-a13b-b2c275d10dd9-kube-api-access-b2r74\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748572 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748543    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d606a2e-1628-484c-a13b-b2c275d10dd9-tls-certs\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748755 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748705    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-tmp-dir\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748852 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748829    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-home\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.748928 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.748862    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-model-cache\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.750679 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.750652    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-dshm\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.750938 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.750920    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d606a2e-1628-484c-a13b-b2c275d10dd9-tls-certs\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.756971 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.756951    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2r74\" (UniqueName: \"kubernetes.io/projected/5d606a2e-1628-484c-a13b-b2c275d10dd9-kube-api-access-b2r74\") pod \"e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") " pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.827552 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.827464    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:49.958461 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:49.958436    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"]
Jul 30 18:10:49.960596 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:10:49.960569    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d606a2e_1628_484c_a13b_b2c275d10dd9.slice/crio-9c4416ecdfe091c54dfd60a6c8401dbdfeb39c96612994f26c11386319f4a4ff WatchSource:0}: Error finding container 9c4416ecdfe091c54dfd60a6c8401dbdfeb39c96612994f26c11386319f4a4ff: Status 404 returned error can't find the container with id 9c4416ecdfe091c54dfd60a6c8401dbdfeb39c96612994f26c11386319f4a4ff
Jul 30 18:10:50.314551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:50.314506    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v" event={"ID":"5d606a2e-1628-484c-a13b-b2c275d10dd9","Type":"ContainerStarted","Data":"29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d"}
Jul 30 18:10:50.314551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:50.314554    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v" event={"ID":"5d606a2e-1628-484c-a13b-b2c275d10dd9","Type":"ContainerStarted","Data":"9c4416ecdfe091c54dfd60a6c8401dbdfeb39c96612994f26c11386319f4a4ff"}
Jul 30 18:10:50.332587 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:50.332539    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v" podStartSLOduration=1.3325219 podStartE2EDuration="1.3325219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:10:50.331671616 +0000 UTC m=+2632.057355947" watchObservedRunningTime="2026-07-30 18:10:50.3325219 +0000 UTC m=+2632.058206184"
Jul 30 18:10:52.827077 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:52.827044    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:10:58.941817 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:58.941786    2538 scope.go:117] "RemoveContainer" containerID="d9e1bc6c409d4b3304f1b5720bb3196fbaa38849778e90f9e58ea365e8ce4089"
Jul 30 18:10:58.951334 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:58.951313    2538 scope.go:117] "RemoveContainer" containerID="2c7e2bdfb4e6e35b4b05558367f499b4b5fbc372eeb4de0ac0b6c5562d374aed"
Jul 30 18:10:59.827623 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:59.827573    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:59.827623 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:59.827633    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:10:59.840177 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:10:59.840141    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:11:00.371194 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:00.371158    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:11:09.023327 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:09.023293    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:11:21.986053 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:21.986018    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"]
Jul 30 18:11:21.989504 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:21.989487    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:21.992076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:21.992055    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:11:21.992197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:21.992084    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:11:21.997234 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:21.996351    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"]
Jul 30 18:11:22.140077 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:22.140036    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662d4b59-f992-4ff0-a571-ba4f88ef99b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-657b86df-5btdf\" (UID: \"662d4b59-f992-4ff0-a571-ba4f88ef99b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:22.241364 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:22.241274    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662d4b59-f992-4ff0-a571-ba4f88ef99b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-657b86df-5btdf\" (UID: \"662d4b59-f992-4ff0-a571-ba4f88ef99b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:22.241968 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:22.241947    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662d4b59-f992-4ff0-a571-ba4f88ef99b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-657b86df-5btdf\" (UID: \"662d4b59-f992-4ff0-a571-ba4f88ef99b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:22.300716 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:22.300682    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:22.426521 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:22.426493    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"]
Jul 30 18:11:22.428906 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:11:22.428852    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662d4b59_f992_4ff0_a571_ba4f88ef99b0.slice/crio-c98cb439ce009abc807e8740c319ad5eaa934569f837cfa5783384e04b137a12 WatchSource:0}: Error finding container c98cb439ce009abc807e8740c319ad5eaa934569f837cfa5783384e04b137a12: Status 404 returned error can't find the container with id c98cb439ce009abc807e8740c319ad5eaa934569f837cfa5783384e04b137a12
Jul 30 18:11:22.461736 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:22.461707    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf" event={"ID":"662d4b59-f992-4ff0-a571-ba4f88ef99b0","Type":"ContainerStarted","Data":"c98cb439ce009abc807e8740c319ad5eaa934569f837cfa5783384e04b137a12"}
Jul 30 18:11:23.468054 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:23.468024    2538 generic.go:356] "Generic (PLEG): container finished" podID="662d4b59-f992-4ff0-a571-ba4f88ef99b0" containerID="a474d80ca7e97842a281dc83f94cf9f6167b25228132963ed490ddfdf8ecfad9" exitCode=0
Jul 30 18:11:23.468429 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:23.468115    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf" event={"ID":"662d4b59-f992-4ff0-a571-ba4f88ef99b0","Type":"ContainerDied","Data":"a474d80ca7e97842a281dc83f94cf9f6167b25228132963ed490ddfdf8ecfad9"}
Jul 30 18:11:24.603250 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:24.603219    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:24.662005 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:24.661971    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662d4b59-f992-4ff0-a571-ba4f88ef99b0-maas-api-service-ca\") pod \"662d4b59-f992-4ff0-a571-ba4f88ef99b0\" (UID: \"662d4b59-f992-4ff0-a571-ba4f88ef99b0\") "
Jul 30 18:11:24.662272 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:24.662251    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/662d4b59-f992-4ff0-a571-ba4f88ef99b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "662d4b59-f992-4ff0-a571-ba4f88ef99b0" (UID: "662d4b59-f992-4ff0-a571-ba4f88ef99b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:11:24.662352 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:24.662332    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/662d4b59-f992-4ff0-a571-ba4f88ef99b0-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:11:25.478489 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:25.478462    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"
Jul 30 18:11:25.478489 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:25.478469    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf" event={"ID":"662d4b59-f992-4ff0-a571-ba4f88ef99b0","Type":"ContainerDied","Data":"c98cb439ce009abc807e8740c319ad5eaa934569f837cfa5783384e04b137a12"}
Jul 30 18:11:25.478713 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:25.478514    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c98cb439ce009abc807e8740c319ad5eaa934569f837cfa5783384e04b137a12"
Jul 30 18:11:36.025013 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:36.024977    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:11:37.870143 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:37.870112    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"]
Jul 30 18:11:37.873122 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:37.873097    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-657b86df-5btdf"]
Jul 30 18:11:38.826992 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:38.826949    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="662d4b59-f992-4ff0-a571-ba4f88ef99b0" path="/var/lib/kubelet/pods/662d4b59-f992-4ff0-a571-ba4f88ef99b0/volumes"
Jul 30 18:11:46.222014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:46.221977    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:11:46.239127 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:46.239098    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"]
Jul 30 18:11:58.875678 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:58.875648    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:11:58.882783 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:11:58.882761    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:12:01.258042 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.257966    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v" podUID="5d606a2e-1628-484c-a13b-b2c275d10dd9" containerName="main" containerID="cri-o://29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d" gracePeriod=45
Jul 30 18:12:01.504638 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.504613    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:12:01.584418 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584343    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-tmp-dir\") pod \"5d606a2e-1628-484c-a13b-b2c275d10dd9\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") "
Jul 30 18:12:01.584418 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584389    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2r74\" (UniqueName: \"kubernetes.io/projected/5d606a2e-1628-484c-a13b-b2c275d10dd9-kube-api-access-b2r74\") pod \"5d606a2e-1628-484c-a13b-b2c275d10dd9\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") "
Jul 30 18:12:01.584606 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584424    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-home\") pod \"5d606a2e-1628-484c-a13b-b2c275d10dd9\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") "
Jul 30 18:12:01.584606 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584442    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-dshm\") pod \"5d606a2e-1628-484c-a13b-b2c275d10dd9\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") "
Jul 30 18:12:01.584606 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584461    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-model-cache\") pod \"5d606a2e-1628-484c-a13b-b2c275d10dd9\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") "
Jul 30 18:12:01.584606 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584508    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d606a2e-1628-484c-a13b-b2c275d10dd9-tls-certs\") pod \"5d606a2e-1628-484c-a13b-b2c275d10dd9\" (UID: \"5d606a2e-1628-484c-a13b-b2c275d10dd9\") "
Jul 30 18:12:01.584814 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584653    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d606a2e-1628-484c-a13b-b2c275d10dd9" (UID: "5d606a2e-1628-484c-a13b-b2c275d10dd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:12:01.584814 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584724    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d606a2e-1628-484c-a13b-b2c275d10dd9" (UID: "5d606a2e-1628-484c-a13b-b2c275d10dd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:12:01.584814 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584740    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-home" (OuterVolumeSpecName: "home") pod "5d606a2e-1628-484c-a13b-b2c275d10dd9" (UID: "5d606a2e-1628-484c-a13b-b2c275d10dd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:12:01.584980 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584825    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:12:01.584980 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584841    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:12:01.584980 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.584853    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:12:01.586625 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.586602    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-dshm" (OuterVolumeSpecName: "dshm") pod "5d606a2e-1628-484c-a13b-b2c275d10dd9" (UID: "5d606a2e-1628-484c-a13b-b2c275d10dd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:12:01.586735 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.586658    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d606a2e-1628-484c-a13b-b2c275d10dd9-kube-api-access-b2r74" (OuterVolumeSpecName: "kube-api-access-b2r74") pod "5d606a2e-1628-484c-a13b-b2c275d10dd9" (UID: "5d606a2e-1628-484c-a13b-b2c275d10dd9"). InnerVolumeSpecName "kube-api-access-b2r74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:12:01.586735 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.586671    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d606a2e-1628-484c-a13b-b2c275d10dd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d606a2e-1628-484c-a13b-b2c275d10dd9" (UID: "5d606a2e-1628-484c-a13b-b2c275d10dd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:12:01.653941 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.653904    2538 generic.go:356] "Generic (PLEG): container finished" podID="5d606a2e-1628-484c-a13b-b2c275d10dd9" containerID="29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d" exitCode=0
Jul 30 18:12:01.654098 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.653943    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"
Jul 30 18:12:01.654098 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.654003    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v" event={"ID":"5d606a2e-1628-484c-a13b-b2c275d10dd9","Type":"ContainerDied","Data":"29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d"}
Jul 30 18:12:01.654098 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.654054    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v" event={"ID":"5d606a2e-1628-484c-a13b-b2c275d10dd9","Type":"ContainerDied","Data":"9c4416ecdfe091c54dfd60a6c8401dbdfeb39c96612994f26c11386319f4a4ff"}
Jul 30 18:12:01.654098 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.654077    2538 scope.go:117] "RemoveContainer" containerID="29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d"
Jul 30 18:12:01.663428 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.663414    2538 scope.go:117] "RemoveContainer" containerID="29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d"
Jul 30 18:12:01.663652 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:12:01.663633    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d\": container with ID starting with 29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d not found: ID does not exist" containerID="29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d"
Jul 30 18:12:01.663701 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.663661    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d"} err="failed to get container status \"29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d\": rpc error: code = NotFound desc = could not find container \"29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d\": container with ID starting with 29df135cfa801d1c22c7ed3ee3ceab3ffa4a4672471877e5274cd89f958eff9d not found: ID does not exist"
Jul 30 18:12:01.676544 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.676520    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"]
Jul 30 18:12:01.681112 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.681093    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-657b86df/e2e-lifecycle-model-657b86df-kserve-67c449756c-fsn8v"]
Jul 30 18:12:01.685948 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.685919    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d606a2e-1628-484c-a13b-b2c275d10dd9-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:12:01.685948 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.685944    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2r74\" (UniqueName: \"kubernetes.io/projected/5d606a2e-1628-484c-a13b-b2c275d10dd9-kube-api-access-b2r74\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:12:01.686065 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:01.685959    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d606a2e-1628-484c-a13b-b2c275d10dd9-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:12:02.826629 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:02.826593    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d606a2e-1628-484c-a13b-b2c275d10dd9" path="/var/lib/kubelet/pods/5d606a2e-1628-484c-a13b-b2c275d10dd9/volumes"
Jul 30 18:12:32.714551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:32.714517    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:12:56.615989 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:12:56.615937    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:13:06.433161 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:13:06.433129    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:13:54.423511 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:13:54.423473    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:13:58.991601 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:13:58.991570    2538 scope.go:117] "RemoveContainer" containerID="cd84fb77539536ad555421d6c090b35edf38d0c107f1c9656e2cef1e85ca3555"
Jul 30 18:14:21.919867 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:21.919823    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:14:54.602439 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.602398    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"]
Jul 30 18:14:54.603062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.602951    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="662d4b59-f992-4ff0-a571-ba4f88ef99b0" containerName="revoke-keys"
Jul 30 18:14:54.603062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.602970    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="662d4b59-f992-4ff0-a571-ba4f88ef99b0" containerName="revoke-keys"
Jul 30 18:14:54.603062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.602999    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d606a2e-1628-484c-a13b-b2c275d10dd9" containerName="main"
Jul 30 18:14:54.603062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.603009    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d606a2e-1628-484c-a13b-b2c275d10dd9" containerName="main"
Jul 30 18:14:54.603279 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.603097    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d606a2e-1628-484c-a13b-b2c275d10dd9" containerName="main"
Jul 30 18:14:54.603279 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.603114    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="662d4b59-f992-4ff0-a571-ba4f88ef99b0" containerName="revoke-keys"
Jul 30 18:14:54.606124 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.606104    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.608636 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.608618    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-166ba9\"/\"default-dockercfg-mh2bj\""
Jul 30 18:14:54.609900 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.609865    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-166ba9\"/\"test-model-166ba9-kserve-self-signed-certs\""
Jul 30 18:14:54.609968 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.609899    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-166ba9\"/\"kube-root-ca.crt\""
Jul 30 18:14:54.609968 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.609903    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-166ba9\"/\"openshift-service-ca.crt\""
Jul 30 18:14:54.616108 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.616089    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"]
Jul 30 18:14:54.657435 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.657404    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvtb\" (UniqueName: \"kubernetes.io/projected/dd74689e-ab59-4f9c-a128-ba67d43864d4-kube-api-access-bxvtb\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.657570 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.657449    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-model-cache\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.657570 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.657473    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-tmp-dir\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.657570 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.657509    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-home\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.657570 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.657536    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd74689e-ab59-4f9c-a128-ba67d43864d4-tls-certs\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.657711 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.657606    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-dshm\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.758718 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.758677    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-dshm\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.758937 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.758755    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvtb\" (UniqueName: \"kubernetes.io/projected/dd74689e-ab59-4f9c-a128-ba67d43864d4-kube-api-access-bxvtb\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.758937 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.758785    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-model-cache\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.758937 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.758800    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-tmp-dir\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.758937 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.758828    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-home\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.758937 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.758854    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd74689e-ab59-4f9c-a128-ba67d43864d4-tls-certs\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.759259 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.759238    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-model-cache\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.759259 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.759252    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-tmp-dir\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.759358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.759307    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-home\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.761094 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.761072    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-dshm\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.761228 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.761212    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd74689e-ab59-4f9c-a128-ba67d43864d4-tls-certs\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.767476 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.767444    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvtb\" (UniqueName: \"kubernetes.io/projected/dd74689e-ab59-4f9c-a128-ba67d43864d4-kube-api-access-bxvtb\") pod \"test-model-166ba9-kserve-5766448dc-xtmcd\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") " pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:54.916016 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:54.915925    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:14:55.046816 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:55.046785    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"]
Jul 30 18:14:55.048779 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:14:55.048748    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd74689e_ab59_4f9c_a128_ba67d43864d4.slice/crio-d56a7428e4aa3baf6652d83a3f4a41c9a941be82796489815b531d354681b1ea WatchSource:0}: Error finding container d56a7428e4aa3baf6652d83a3f4a41c9a941be82796489815b531d354681b1ea: Status 404 returned error can't find the container with id d56a7428e4aa3baf6652d83a3f4a41c9a941be82796489815b531d354681b1ea
Jul 30 18:14:55.448460 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:55.448426    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd" event={"ID":"dd74689e-ab59-4f9c-a128-ba67d43864d4","Type":"ContainerStarted","Data":"132af18cf8c8ff0a304bd4d8f4cbcc1316fbe49bacff0a5c33ee5fce128e4a60"}
Jul 30 18:14:55.448664 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:55.448469    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd" event={"ID":"dd74689e-ab59-4f9c-a128-ba67d43864d4","Type":"ContainerStarted","Data":"d56a7428e4aa3baf6652d83a3f4a41c9a941be82796489815b531d354681b1ea"}
Jul 30 18:14:55.466018 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:55.465965    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd" podStartSLOduration=1.465948737 podStartE2EDuration="1.465948737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:14:55.465485473 +0000 UTC m=+2877.191169759" watchObservedRunningTime="2026-07-30 18:14:55.465948737 +0000 UTC m=+2877.191633018"
Jul 30 18:14:57.925576 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:14:57.925540    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:15:00.133156 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.133122    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"]
Jul 30 18:15:00.136402 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.136383    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"]
Jul 30 18:15:00.136512 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.136493    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"
Jul 30 18:15:00.139294 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.139276    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:15:00.139663 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.139648    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"]
Jul 30 18:15:00.139760 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.139748    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"
Jul 30 18:15:00.142975 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.142953    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"]
Jul 30 18:15:00.143078 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.143048    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"
Jul 30 18:15:00.146023 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.145999    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"]
Jul 30 18:15:00.147963 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.147899    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"]
Jul 30 18:15:00.149706 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.149685    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"
Jul 30 18:15:00.158536 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.158516    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"
Jul 30 18:15:00.192005 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.191930    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"
Jul 30 18:15:00.309761 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.309688    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"]
Jul 30 18:15:00.313013 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:15:00.312950    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0b7187_7304_4d0c_bf4b_83d29540139c.slice/crio-c3dccee58b539739ea6c4d57baf630e2f025d4e01272ab18ebc627ea54814b77 WatchSource:0}: Error finding container c3dccee58b539739ea6c4d57baf630e2f025d4e01272ab18ebc627ea54814b77: Status 404 returned error can't find the container with id c3dccee58b539739ea6c4d57baf630e2f025d4e01272ab18ebc627ea54814b77
Jul 30 18:15:00.358787 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.358766    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"]
Jul 30 18:15:00.360429 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:15:00.360392    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc456d8e7_7920_4942_ad5d_fd3dfbcf3be6.slice/crio-e593fae53e476e2361478ee5caa2b35af5418ffc040966a1a63ed81e01f6bf00 WatchSource:0}: Error finding container e593fae53e476e2361478ee5caa2b35af5418ffc040966a1a63ed81e01f6bf00: Status 404 returned error can't find the container with id e593fae53e476e2361478ee5caa2b35af5418ffc040966a1a63ed81e01f6bf00
Jul 30 18:15:00.473958 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.473926    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj" event={"ID":"fd0b7187-7304-4d0c-bf4b-83d29540139c","Type":"ContainerStarted","Data":"c3dccee58b539739ea6c4d57baf630e2f025d4e01272ab18ebc627ea54814b77"}
Jul 30 18:15:00.474986 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.474961    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz" event={"ID":"c456d8e7-7920-4942-ad5d-fd3dfbcf3be6","Type":"ContainerStarted","Data":"e593fae53e476e2361478ee5caa2b35af5418ffc040966a1a63ed81e01f6bf00"}
Jul 30 18:15:00.541208 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:00.541184    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"]
Jul 30 18:15:00.548944 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:15:00.548918    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00295f0_b9cd_4ddf_bcc8_f7d56ff5291d.slice/crio-197377551e8ce151811e24dcb2b6dca99f096133410036cf08bdd5222165b80d WatchSource:0}: Error finding container 197377551e8ce151811e24dcb2b6dca99f096133410036cf08bdd5222165b80d: Status 404 returned error can't find the container with id 197377551e8ce151811e24dcb2b6dca99f096133410036cf08bdd5222165b80d
Jul 30 18:15:01.482233 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.482205    2538 generic.go:356] "Generic (PLEG): container finished" podID="fd0b7187-7304-4d0c-bf4b-83d29540139c" containerID="1bf9491c3c2fe021f4cb1f81e190fe6ab9472c2dd0bee3f43b3e291382bfd425" exitCode=0
Jul 30 18:15:01.482598 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.482292    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj" event={"ID":"fd0b7187-7304-4d0c-bf4b-83d29540139c","Type":"ContainerDied","Data":"1bf9491c3c2fe021f4cb1f81e190fe6ab9472c2dd0bee3f43b3e291382bfd425"}
Jul 30 18:15:01.483758 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.483733    2538 generic.go:356] "Generic (PLEG): container finished" podID="c456d8e7-7920-4942-ad5d-fd3dfbcf3be6" containerID="0c46596d122e1c8177b8d17679db24d08a3ee096de3f47619e59cfef231f4c5a" exitCode=0
Jul 30 18:15:01.483843 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.483798    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz" event={"ID":"c456d8e7-7920-4942-ad5d-fd3dfbcf3be6","Type":"ContainerDied","Data":"0c46596d122e1c8177b8d17679db24d08a3ee096de3f47619e59cfef231f4c5a"}
Jul 30 18:15:01.485188 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.485169    2538 generic.go:356] "Generic (PLEG): container finished" podID="b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d" containerID="d0f278610758ebcb2c5d850a9d07a1abb1b282cb7ef2c280b5201be400d9ed0e" exitCode=0
Jul 30 18:15:01.485273 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.485195    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s" event={"ID":"b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d","Type":"ContainerDied","Data":"d0f278610758ebcb2c5d850a9d07a1abb1b282cb7ef2c280b5201be400d9ed0e"}
Jul 30 18:15:01.485273 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:01.485222    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s" event={"ID":"b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d","Type":"ContainerStarted","Data":"197377551e8ce151811e24dcb2b6dca99f096133410036cf08bdd5222165b80d"}
Jul 30 18:15:02.635977 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:02.635950    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"
Jul 30 18:15:02.670666 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:02.670646    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"
Jul 30 18:15:02.682853 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:02.679344    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"
Jul 30 18:15:03.497039 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.496998    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"
Jul 30 18:15:03.497039 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.497012    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj" event={"ID":"fd0b7187-7304-4d0c-bf4b-83d29540139c","Type":"ContainerDied","Data":"c3dccee58b539739ea6c4d57baf630e2f025d4e01272ab18ebc627ea54814b77"}
Jul 30 18:15:03.497329 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.497068    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3dccee58b539739ea6c4d57baf630e2f025d4e01272ab18ebc627ea54814b77"
Jul 30 18:15:03.498502 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.498478    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"
Jul 30 18:15:03.498628 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.498484    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz" event={"ID":"c456d8e7-7920-4942-ad5d-fd3dfbcf3be6","Type":"ContainerDied","Data":"e593fae53e476e2361478ee5caa2b35af5418ffc040966a1a63ed81e01f6bf00"}
Jul 30 18:15:03.498628 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.498609    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e593fae53e476e2361478ee5caa2b35af5418ffc040966a1a63ed81e01f6bf00"
Jul 30 18:15:03.500046 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.500025    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s"
Jul 30 18:15:03.500126 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.500025    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757255-xvh7s" event={"ID":"b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d","Type":"ContainerDied","Data":"197377551e8ce151811e24dcb2b6dca99f096133410036cf08bdd5222165b80d"}
Jul 30 18:15:03.500175 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:03.500144    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="197377551e8ce151811e24dcb2b6dca99f096133410036cf08bdd5222165b80d"
Jul 30 18:15:04.916957 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:04.916907    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:15:04.917375 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:04.916979    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:15:04.929546 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:04.929518    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:15:05.520793 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:05.520765    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:15:08.837081 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:08.837048    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:15:21.324399 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324354    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"]
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324710    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c456d8e7-7920-4942-ad5d-fd3dfbcf3be6" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324722    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="c456d8e7-7920-4942-ad5d-fd3dfbcf3be6" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324733    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd0b7187-7304-4d0c-bf4b-83d29540139c" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324738    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd0b7187-7304-4d0c-bf4b-83d29540139c" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324744    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324750    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324824    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd0b7187-7304-4d0c-bf4b-83d29540139c" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324832    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="c456d8e7-7920-4942-ad5d-fd3dfbcf3be6" containerName="cleanup"
Jul 30 18:15:21.324842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.324838    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d" containerName="cleanup"
Jul 30 18:15:21.328028 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.327990    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.332200 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.332174    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-984898\"/\"default-dockercfg-vqj68\""
Jul 30 18:15:21.332322 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.332226    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-984898\"/\"kube-root-ca.crt\""
Jul 30 18:15:21.332409 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.332173    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-984898\"/\"openshift-service-ca.crt\""
Jul 30 18:15:21.332478 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.332456    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-984898\"/\"test-model-984898-kserve-self-signed-certs\""
Jul 30 18:15:21.338254 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.338231    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"]
Jul 30 18:15:21.499267 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.499215    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9d8\" (UniqueName: \"kubernetes.io/projected/339a1c74-1c97-4bf1-83cc-d32e4df52af4-kube-api-access-kk9d8\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.499267 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.499269    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-dshm\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.499467 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.499337    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tmp-dir\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.499467 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.499390    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-model-cache\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.499467 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.499425    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-home\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.499600 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.499489    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tls-certs\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.600676 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600577    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-home\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.600676 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600654    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tls-certs\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.600934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600696    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9d8\" (UniqueName: \"kubernetes.io/projected/339a1c74-1c97-4bf1-83cc-d32e4df52af4-kube-api-access-kk9d8\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.600934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600722    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-dshm\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.600934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600757    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tmp-dir\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.600934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600808    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-model-cache\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.601146 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.600988    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-home\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.601146 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.601120    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tmp-dir\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.601257 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.601217    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-model-cache\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.603013 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.602978    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-dshm\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.603248 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.603232    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tls-certs\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.609545 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.609520    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9d8\" (UniqueName: \"kubernetes.io/projected/339a1c74-1c97-4bf1-83cc-d32e4df52af4-kube-api-access-kk9d8\") pod \"test-model-984898-kserve-84b4c5f65c-nhbw2\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") " pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.639697 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.639669    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:21.770623 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:21.770601    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"]
Jul 30 18:15:21.773486 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:15:21.773457    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod339a1c74_1c97_4bf1_83cc_d32e4df52af4.slice/crio-c360dbef16604893cb96c45902835cdb05891eaa543bd2540887c13ed4d9c9fb WatchSource:0}: Error finding container c360dbef16604893cb96c45902835cdb05891eaa543bd2540887c13ed4d9c9fb: Status 404 returned error can't find the container with id c360dbef16604893cb96c45902835cdb05891eaa543bd2540887c13ed4d9c9fb
Jul 30 18:15:22.595801 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:22.595765    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2" event={"ID":"339a1c74-1c97-4bf1-83cc-d32e4df52af4","Type":"ContainerStarted","Data":"7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb"}
Jul 30 18:15:22.596215 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:22.595812    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2" event={"ID":"339a1c74-1c97-4bf1-83cc-d32e4df52af4","Type":"ContainerStarted","Data":"c360dbef16604893cb96c45902835cdb05891eaa543bd2540887c13ed4d9c9fb"}
Jul 30 18:15:22.613032 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:22.612988    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2" podStartSLOduration=1.6129713589999999 podStartE2EDuration="1.612971359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:15:22.611566051 +0000 UTC m=+2904.337250331" watchObservedRunningTime="2026-07-30 18:15:22.612971359 +0000 UTC m=+2904.338655638"
Jul 30 18:15:25.321155 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:25.321120    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:15:31.641015 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:31.639836    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:31.641015 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:31.640914    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:31.656630 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:31.656592    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:32.663894 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:32.663848    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:15:39.013030 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:15:39.012994    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:16:02.652534 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:02.652502    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"]
Jul 30 18:16:03.580276 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:03.580242    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"]
Jul 30 18:16:07.328507 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:07.328471    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:16:14.200757 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:14.200709    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"]
Jul 30 18:16:14.203331 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:14.203301    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-166ba9-29757255-nnzkz"]
Jul 30 18:16:14.826513 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:14.826476    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c456d8e7-7920-4942-ad5d-fd3dfbcf3be6" path="/var/lib/kubelet/pods/c456d8e7-7920-4942-ad5d-fd3dfbcf3be6/volumes"
Jul 30 18:16:17.672133 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:17.672092    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd" podUID="dd74689e-ab59-4f9c-a128-ba67d43864d4" containerName="main" containerID="cri-o://132af18cf8c8ff0a304bd4d8f4cbcc1316fbe49bacff0a5c33ee5fce128e4a60" gracePeriod=45
Jul 30 18:16:17.860421 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:17.860375    2538 generic.go:356] "Generic (PLEG): container finished" podID="dd74689e-ab59-4f9c-a128-ba67d43864d4" containerID="132af18cf8c8ff0a304bd4d8f4cbcc1316fbe49bacff0a5c33ee5fce128e4a60" exitCode=0
Jul 30 18:16:17.860582 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:17.860485    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd" event={"ID":"dd74689e-ab59-4f9c-a128-ba67d43864d4","Type":"ContainerDied","Data":"132af18cf8c8ff0a304bd4d8f4cbcc1316fbe49bacff0a5c33ee5fce128e4a60"}
Jul 30 18:16:17.916380 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:17.916356    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:16:18.100487 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100460    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-model-cache\") pod \"dd74689e-ab59-4f9c-a128-ba67d43864d4\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") "
Jul 30 18:16:18.100644 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100514    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxvtb\" (UniqueName: \"kubernetes.io/projected/dd74689e-ab59-4f9c-a128-ba67d43864d4-kube-api-access-bxvtb\") pod \"dd74689e-ab59-4f9c-a128-ba67d43864d4\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") "
Jul 30 18:16:18.100644 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100574    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-dshm\") pod \"dd74689e-ab59-4f9c-a128-ba67d43864d4\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") "
Jul 30 18:16:18.100644 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100609    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-home\") pod \"dd74689e-ab59-4f9c-a128-ba67d43864d4\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") "
Jul 30 18:16:18.100791 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100645    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd74689e-ab59-4f9c-a128-ba67d43864d4-tls-certs\") pod \"dd74689e-ab59-4f9c-a128-ba67d43864d4\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") "
Jul 30 18:16:18.100791 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100701    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-tmp-dir\") pod \"dd74689e-ab59-4f9c-a128-ba67d43864d4\" (UID: \"dd74689e-ab59-4f9c-a128-ba67d43864d4\") "
Jul 30 18:16:18.100791 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100747    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd74689e-ab59-4f9c-a128-ba67d43864d4" (UID: "dd74689e-ab59-4f9c-a128-ba67d43864d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:18.100983 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100869    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-home" (OuterVolumeSpecName: "home") pod "dd74689e-ab59-4f9c-a128-ba67d43864d4" (UID: "dd74689e-ab59-4f9c-a128-ba67d43864d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:18.101050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.100983    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd74689e-ab59-4f9c-a128-ba67d43864d4" (UID: "dd74689e-ab59-4f9c-a128-ba67d43864d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:18.101050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.101016    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:18.101050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.101031    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:18.102710 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.102688    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-dshm" (OuterVolumeSpecName: "dshm") pod "dd74689e-ab59-4f9c-a128-ba67d43864d4" (UID: "dd74689e-ab59-4f9c-a128-ba67d43864d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:18.102808 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.102709    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd74689e-ab59-4f9c-a128-ba67d43864d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd74689e-ab59-4f9c-a128-ba67d43864d4" (UID: "dd74689e-ab59-4f9c-a128-ba67d43864d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:16:18.102808 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.102753    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd74689e-ab59-4f9c-a128-ba67d43864d4-kube-api-access-bxvtb" (OuterVolumeSpecName: "kube-api-access-bxvtb") pod "dd74689e-ab59-4f9c-a128-ba67d43864d4" (UID: "dd74689e-ab59-4f9c-a128-ba67d43864d4"). InnerVolumeSpecName "kube-api-access-bxvtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:16:18.201927 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.201888    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxvtb\" (UniqueName: \"kubernetes.io/projected/dd74689e-ab59-4f9c-a128-ba67d43864d4-kube-api-access-bxvtb\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:18.201927 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.201920    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:18.201927 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.201931    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd74689e-ab59-4f9c-a128-ba67d43864d4-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:18.202158 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.201960    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd74689e-ab59-4f9c-a128-ba67d43864d4-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:18.599191 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.599143    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2" podUID="339a1c74-1c97-4bf1-83cc-d32e4df52af4" containerName="main" containerID="cri-o://7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb" gracePeriod=45
Jul 30 18:16:18.855488 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.855435    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:16:18.866343 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.866323    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"
Jul 30 18:16:18.866467 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.866346    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd" event={"ID":"dd74689e-ab59-4f9c-a128-ba67d43864d4","Type":"ContainerDied","Data":"d56a7428e4aa3baf6652d83a3f4a41c9a941be82796489815b531d354681b1ea"}
Jul 30 18:16:18.866467 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.866391    2538 scope.go:117] "RemoveContainer" containerID="132af18cf8c8ff0a304bd4d8f4cbcc1316fbe49bacff0a5c33ee5fce128e4a60"
Jul 30 18:16:18.867627 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.867604    2538 generic.go:356] "Generic (PLEG): container finished" podID="339a1c74-1c97-4bf1-83cc-d32e4df52af4" containerID="7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb" exitCode=0
Jul 30 18:16:18.867718 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.867650    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"
Jul 30 18:16:18.867718 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.867686    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2" event={"ID":"339a1c74-1c97-4bf1-83cc-d32e4df52af4","Type":"ContainerDied","Data":"7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb"}
Jul 30 18:16:18.867807 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.867723    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2" event={"ID":"339a1c74-1c97-4bf1-83cc-d32e4df52af4","Type":"ContainerDied","Data":"c360dbef16604893cb96c45902835cdb05891eaa543bd2540887c13ed4d9c9fb"}
Jul 30 18:16:18.875985 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.875961    2538 scope.go:117] "RemoveContainer" containerID="7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb"
Jul 30 18:16:18.885805 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.885496    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"]
Jul 30 18:16:18.887319 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.886146    2538 scope.go:117] "RemoveContainer" containerID="7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb"
Jul 30 18:16:18.887319 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:16:18.887376    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb\": container with ID starting with 7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb not found: ID does not exist" containerID="7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb"
Jul 30 18:16:18.887319 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.887414    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb"} err="failed to get container status \"7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb\": rpc error: code = NotFound desc = could not find container \"7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb\": container with ID starting with 7ff1eb21615f7ad23c62052594307d97aa56b39844cdc70ffade968c62c624eb not found: ID does not exist"
Jul 30 18:16:18.892077 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:18.892054    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-166ba9/test-model-166ba9-kserve-5766448dc-xtmcd"]
Jul 30 18:16:19.008634 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.008594    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk9d8\" (UniqueName: \"kubernetes.io/projected/339a1c74-1c97-4bf1-83cc-d32e4df52af4-kube-api-access-kk9d8\") pod \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") "
Jul 30 18:16:19.008820 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.008640    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-home\") pod \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") "
Jul 30 18:16:19.008820 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.008684    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-dshm\") pod \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") "
Jul 30 18:16:19.008820 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.008704    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-model-cache\") pod \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") "
Jul 30 18:16:19.008820 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.008729    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tmp-dir\") pod \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") "
Jul 30 18:16:19.008820 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.008755    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tls-certs\") pod \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\" (UID: \"339a1c74-1c97-4bf1-83cc-d32e4df52af4\") "
Jul 30 18:16:19.009119 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.009086    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-home" (OuterVolumeSpecName: "home") pod "339a1c74-1c97-4bf1-83cc-d32e4df52af4" (UID: "339a1c74-1c97-4bf1-83cc-d32e4df52af4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:19.009119 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.009102    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-model-cache" (OuterVolumeSpecName: "model-cache") pod "339a1c74-1c97-4bf1-83cc-d32e4df52af4" (UID: "339a1c74-1c97-4bf1-83cc-d32e4df52af4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:19.009232 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.009193    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "339a1c74-1c97-4bf1-83cc-d32e4df52af4" (UID: "339a1c74-1c97-4bf1-83cc-d32e4df52af4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:19.010975 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.010948    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-dshm" (OuterVolumeSpecName: "dshm") pod "339a1c74-1c97-4bf1-83cc-d32e4df52af4" (UID: "339a1c74-1c97-4bf1-83cc-d32e4df52af4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:16:19.010975 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.010965    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "339a1c74-1c97-4bf1-83cc-d32e4df52af4" (UID: "339a1c74-1c97-4bf1-83cc-d32e4df52af4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:16:19.011123 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.011041    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/339a1c74-1c97-4bf1-83cc-d32e4df52af4-kube-api-access-kk9d8" (OuterVolumeSpecName: "kube-api-access-kk9d8") pod "339a1c74-1c97-4bf1-83cc-d32e4df52af4" (UID: "339a1c74-1c97-4bf1-83cc-d32e4df52af4"). InnerVolumeSpecName "kube-api-access-kk9d8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:16:19.110014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.109913    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:19.110014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.109957    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk9d8\" (UniqueName: \"kubernetes.io/projected/339a1c74-1c97-4bf1-83cc-d32e4df52af4-kube-api-access-kk9d8\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:19.110014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.109967    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:19.110014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.109976    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:19.110014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.109984    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:19.110014 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.109992    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a1c74-1c97-4bf1-83cc-d32e4df52af4-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:19.189918 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.189888    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"]
Jul 30 18:16:19.193587 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:19.193559    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-984898/test-model-984898-kserve-84b4c5f65c-nhbw2"]
Jul 30 18:16:20.826577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:20.826499    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="339a1c74-1c97-4bf1-83cc-d32e4df52af4" path="/var/lib/kubelet/pods/339a1c74-1c97-4bf1-83cc-d32e4df52af4/volumes"
Jul 30 18:16:20.827039 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:20.826866    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd74689e-ab59-4f9c-a128-ba67d43864d4" path="/var/lib/kubelet/pods/dd74689e-ab59-4f9c-a128-ba67d43864d4/volumes"
Jul 30 18:16:21.661658 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.661622    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"]
Jul 30 18:16:21.662055 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.662037    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd74689e-ab59-4f9c-a128-ba67d43864d4" containerName="main"
Jul 30 18:16:21.662055 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.662056    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd74689e-ab59-4f9c-a128-ba67d43864d4" containerName="main"
Jul 30 18:16:21.662209 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.662100    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339a1c74-1c97-4bf1-83cc-d32e4df52af4" containerName="main"
Jul 30 18:16:21.662209 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.662109    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="339a1c74-1c97-4bf1-83cc-d32e4df52af4" containerName="main"
Jul 30 18:16:21.662209 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.662192    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd74689e-ab59-4f9c-a128-ba67d43864d4" containerName="main"
Jul 30 18:16:21.662209 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.662205    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="339a1c74-1c97-4bf1-83cc-d32e4df52af4" containerName="main"
Jul 30 18:16:21.666565 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.666546    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:21.669285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.669264    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:16:21.669285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.669273    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:16:21.672926 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.672902    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"]
Jul 30 18:16:21.831527 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.831494    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25a0599-d4b2-4f3d-9774-3a480d57ea10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-984898-jthtv\" (UID: \"d25a0599-d4b2-4f3d-9774-3a480d57ea10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:21.932006 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.931908    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25a0599-d4b2-4f3d-9774-3a480d57ea10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-984898-jthtv\" (UID: \"d25a0599-d4b2-4f3d-9774-3a480d57ea10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:21.932540 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.932521    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25a0599-d4b2-4f3d-9774-3a480d57ea10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-984898-jthtv\" (UID: \"d25a0599-d4b2-4f3d-9774-3a480d57ea10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:21.978045 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:21.978010    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:22.107109 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:22.107081    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"]
Jul 30 18:16:22.109156 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:16:22.109128    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25a0599_d4b2_4f3d_9774_3a480d57ea10.slice/crio-46175cecd00ac435fb734a5510c2d93c20d9bf234947d5c57c464a195c3c8f69 WatchSource:0}: Error finding container 46175cecd00ac435fb734a5510c2d93c20d9bf234947d5c57c464a195c3c8f69: Status 404 returned error can't find the container with id 46175cecd00ac435fb734a5510c2d93c20d9bf234947d5c57c464a195c3c8f69
Jul 30 18:16:22.891372 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:22.891296    2538 generic.go:356] "Generic (PLEG): container finished" podID="d25a0599-d4b2-4f3d-9774-3a480d57ea10" containerID="b59a8e3cb13efa1bdeb8c4b978ff05b3e53e3c1e220e19c879a94789fc7f816b" exitCode=0
Jul 30 18:16:22.891726 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:22.891385    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv" event={"ID":"d25a0599-d4b2-4f3d-9774-3a480d57ea10","Type":"ContainerDied","Data":"b59a8e3cb13efa1bdeb8c4b978ff05b3e53e3c1e220e19c879a94789fc7f816b"}
Jul 30 18:16:22.891726 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:22.891444    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv" event={"ID":"d25a0599-d4b2-4f3d-9774-3a480d57ea10","Type":"ContainerStarted","Data":"46175cecd00ac435fb734a5510c2d93c20d9bf234947d5c57c464a195c3c8f69"}
Jul 30 18:16:23.222683 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:23.222649    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:16:24.022100 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.022075    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:24.050004 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.049979    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25a0599-d4b2-4f3d-9774-3a480d57ea10-maas-api-service-ca\") pod \"d25a0599-d4b2-4f3d-9774-3a480d57ea10\" (UID: \"d25a0599-d4b2-4f3d-9774-3a480d57ea10\") "
Jul 30 18:16:24.050366 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.050346    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25a0599-d4b2-4f3d-9774-3a480d57ea10-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d25a0599-d4b2-4f3d-9774-3a480d57ea10" (UID: "d25a0599-d4b2-4f3d-9774-3a480d57ea10"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:16:24.150709 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.150618    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25a0599-d4b2-4f3d-9774-3a480d57ea10-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:16:24.901938 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.901904    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"
Jul 30 18:16:24.901938 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.901922    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv" event={"ID":"d25a0599-d4b2-4f3d-9774-3a480d57ea10","Type":"ContainerDied","Data":"46175cecd00ac435fb734a5510c2d93c20d9bf234947d5c57c464a195c3c8f69"}
Jul 30 18:16:24.902176 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:24.901989    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46175cecd00ac435fb734a5510c2d93c20d9bf234947d5c57c464a195c3c8f69"
Jul 30 18:16:32.241784 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:32.241751    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"]
Jul 30 18:16:32.244136 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:32.244109    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-984898-29757255-dzrqj"]
Jul 30 18:16:32.450007 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:32.449972    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"]
Jul 30 18:16:32.451750 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:32.451725    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-984898-jthtv"]
Jul 30 18:16:32.831596 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:32.831560    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25a0599-d4b2-4f3d-9774-3a480d57ea10" path="/var/lib/kubelet/pods/d25a0599-d4b2-4f3d-9774-3a480d57ea10/volumes"
Jul 30 18:16:32.831849 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:32.831834    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd0b7187-7304-4d0c-bf4b-83d29540139c" path="/var/lib/kubelet/pods/fd0b7187-7304-4d0c-bf4b-83d29540139c/volumes"
Jul 30 18:16:35.116400 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:35.116361    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:16:51.020584 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:51.020543    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:16:58.903943 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:58.903913    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:16:58.912723 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:16:58.912696    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:17:19.449042 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:19.449002    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:17:40.376055 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.376018    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"]
Jul 30 18:17:40.376524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.376356    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25a0599-d4b2-4f3d-9774-3a480d57ea10" containerName="revoke-keys"
Jul 30 18:17:40.376524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.376368    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25a0599-d4b2-4f3d-9774-3a480d57ea10" containerName="revoke-keys"
Jul 30 18:17:40.376524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.376434    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25a0599-d4b2-4f3d-9774-3a480d57ea10" containerName="revoke-keys"
Jul 30 18:17:40.379270 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.379254    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:40.382292 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.382271    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:17:40.382292 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.382286    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:17:40.387238 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.387217    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"]
Jul 30 18:17:40.515592 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.515562    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23154c1-891e-46f2-a079-e15d00f678df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k\" (UID: \"a23154c1-891e-46f2-a079-e15d00f678df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:40.616937 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.616903    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23154c1-891e-46f2-a079-e15d00f678df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k\" (UID: \"a23154c1-891e-46f2-a079-e15d00f678df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:40.617486 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.617467    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23154c1-891e-46f2-a079-e15d00f678df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k\" (UID: \"a23154c1-891e-46f2-a079-e15d00f678df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:40.691505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.691430    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:40.817405 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:40.817378    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"]
Jul 30 18:17:40.819360 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:17:40.819325    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23154c1_891e_46f2_a079_e15d00f678df.slice/crio-e6fec0093e0942a1a63c88bc2fd5303aa02ca702c39d767131d2b28cb5ac3ffa WatchSource:0}: Error finding container e6fec0093e0942a1a63c88bc2fd5303aa02ca702c39d767131d2b28cb5ac3ffa: Status 404 returned error can't find the container with id e6fec0093e0942a1a63c88bc2fd5303aa02ca702c39d767131d2b28cb5ac3ffa
Jul 30 18:17:41.264398 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:41.264361    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k" event={"ID":"a23154c1-891e-46f2-a079-e15d00f678df","Type":"ContainerStarted","Data":"aa22f174eb1462bbcce6efa60715359b1455fd4475a7d670096415a0959ed426"}
Jul 30 18:17:41.264601 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:41.264418    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k" event={"ID":"a23154c1-891e-46f2-a079-e15d00f678df","Type":"ContainerStarted","Data":"e6fec0093e0942a1a63c88bc2fd5303aa02ca702c39d767131d2b28cb5ac3ffa"}
Jul 30 18:17:41.280643 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:41.280596    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k" podStartSLOduration=1.280581508 podStartE2EDuration="1.280581508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:17:41.27929256 +0000 UTC m=+3043.004976839" watchObservedRunningTime="2026-07-30 18:17:41.280581508 +0000 UTC m=+3043.006265784"
Jul 30 18:17:42.270692 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:42.270653    2538 generic.go:356] "Generic (PLEG): container finished" podID="a23154c1-891e-46f2-a079-e15d00f678df" containerID="aa22f174eb1462bbcce6efa60715359b1455fd4475a7d670096415a0959ed426" exitCode=0
Jul 30 18:17:42.271134 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:42.270744    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k" event={"ID":"a23154c1-891e-46f2-a079-e15d00f678df","Type":"ContainerDied","Data":"aa22f174eb1462bbcce6efa60715359b1455fd4475a7d670096415a0959ed426"}
Jul 30 18:17:43.401891 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:43.401854    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:43.543802 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:43.543716    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23154c1-891e-46f2-a079-e15d00f678df-maas-api-service-ca\") pod \"a23154c1-891e-46f2-a079-e15d00f678df\" (UID: \"a23154c1-891e-46f2-a079-e15d00f678df\") "
Jul 30 18:17:43.544089 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:43.544068    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23154c1-891e-46f2-a079-e15d00f678df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a23154c1-891e-46f2-a079-e15d00f678df" (UID: "a23154c1-891e-46f2-a079-e15d00f678df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:17:43.644513 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:43.644476    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a23154c1-891e-46f2-a079-e15d00f678df-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:17:44.281022 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:44.280990    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k" event={"ID":"a23154c1-891e-46f2-a079-e15d00f678df","Type":"ContainerDied","Data":"e6fec0093e0942a1a63c88bc2fd5303aa02ca702c39d767131d2b28cb5ac3ffa"}
Jul 30 18:17:44.281022 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:44.281011    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"
Jul 30 18:17:44.281243 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:44.281036    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6fec0093e0942a1a63c88bc2fd5303aa02ca702c39d767131d2b28cb5ac3ffa"
Jul 30 18:17:56.089076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:56.089038    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"]
Jul 30 18:17:56.091353 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:56.091329    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d12cf5-h8p8k"]
Jul 30 18:17:56.831075 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:56.831030    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a23154c1-891e-46f2-a079-e15d00f678df" path="/var/lib/kubelet/pods/a23154c1-891e-46f2-a079-e15d00f678df/volumes"
Jul 30 18:17:58.324294 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:58.324262    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:17:59.039722 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:17:59.039619    2538 scope.go:117] "RemoveContainer" containerID="a474d80ca7e97842a281dc83f94cf9f6167b25228132963ed490ddfdf8ecfad9"
Jul 30 18:18:03.074038 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.074003    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"]
Jul 30 18:18:03.074417 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.074335    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a23154c1-891e-46f2-a079-e15d00f678df" containerName="revoke-keys"
Jul 30 18:18:03.074417 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.074347    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="a23154c1-891e-46f2-a079-e15d00f678df" containerName="revoke-keys"
Jul 30 18:18:03.074417 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.074403    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="a23154c1-891e-46f2-a079-e15d00f678df" containerName="revoke-keys"
Jul 30 18:18:03.078699 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.078677    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:03.081336 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.081314    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:18:03.081435 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.081393    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:18:03.087250 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.086121    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"]
Jul 30 18:18:03.220312 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.220274    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4a8498-74bb-4942-ab1d-d19dba052c48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj\" (UID: \"de4a8498-74bb-4942-ab1d-d19dba052c48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:03.320957 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.320922    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4a8498-74bb-4942-ab1d-d19dba052c48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj\" (UID: \"de4a8498-74bb-4942-ab1d-d19dba052c48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:03.321501 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.321483    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4a8498-74bb-4942-ab1d-d19dba052c48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj\" (UID: \"de4a8498-74bb-4942-ab1d-d19dba052c48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:03.397467 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.397398    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:03.523364 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:03.523331    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"]
Jul 30 18:18:03.525250 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:18:03.525220    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4a8498_74bb_4942_ab1d_d19dba052c48.slice/crio-c23ccf81a18c1d8d7116ad0a97735aac609935c59f91ee0703858212c276af81 WatchSource:0}: Error finding container c23ccf81a18c1d8d7116ad0a97735aac609935c59f91ee0703858212c276af81: Status 404 returned error can't find the container with id c23ccf81a18c1d8d7116ad0a97735aac609935c59f91ee0703858212c276af81
Jul 30 18:18:04.379589 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:04.379556    2538 generic.go:356] "Generic (PLEG): container finished" podID="de4a8498-74bb-4942-ab1d-d19dba052c48" containerID="3bcd9ae3a13ee9ab853f2256a09f0e0443af7ae5fddd9a4f120b5b24b2c7813d" exitCode=0
Jul 30 18:18:04.380018 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:04.379646    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj" event={"ID":"de4a8498-74bb-4942-ab1d-d19dba052c48","Type":"ContainerDied","Data":"3bcd9ae3a13ee9ab853f2256a09f0e0443af7ae5fddd9a4f120b5b24b2c7813d"}
Jul 30 18:18:04.380018 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:04.379706    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj" event={"ID":"de4a8498-74bb-4942-ab1d-d19dba052c48","Type":"ContainerStarted","Data":"c23ccf81a18c1d8d7116ad0a97735aac609935c59f91ee0703858212c276af81"}
Jul 30 18:18:05.511464 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:05.511440    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:05.640990 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:05.640863    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4a8498-74bb-4942-ab1d-d19dba052c48-maas-api-service-ca\") pod \"de4a8498-74bb-4942-ab1d-d19dba052c48\" (UID: \"de4a8498-74bb-4942-ab1d-d19dba052c48\") "
Jul 30 18:18:05.641249 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:05.641223    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4a8498-74bb-4942-ab1d-d19dba052c48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "de4a8498-74bb-4942-ab1d-d19dba052c48" (UID: "de4a8498-74bb-4942-ab1d-d19dba052c48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:18:05.742151 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:05.742112    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de4a8498-74bb-4942-ab1d-d19dba052c48-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:18:06.389991 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:06.389960    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"
Jul 30 18:18:06.390296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:06.389961    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj" event={"ID":"de4a8498-74bb-4942-ab1d-d19dba052c48","Type":"ContainerDied","Data":"c23ccf81a18c1d8d7116ad0a97735aac609935c59f91ee0703858212c276af81"}
Jul 30 18:18:06.390296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:06.390089    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c23ccf81a18c1d8d7116ad0a97735aac609935c59f91ee0703858212c276af81"
Jul 30 18:18:18.921176 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:18.921098    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"]
Jul 30 18:18:18.923315 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:18.923288    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b51ede-b4cgj"]
Jul 30 18:18:20.826572 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:20.826538    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de4a8498-74bb-4942-ab1d-d19dba052c48" path="/var/lib/kubelet/pods/de4a8498-74bb-4942-ab1d-d19dba052c48/volumes"
Jul 30 18:18:23.934790 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:23.934753    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:18:35.911304 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:18:35.911272    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:19:07.211302 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:07.211260    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:19:28.219476 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.219445    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"]
Jul 30 18:19:28.219890 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.219823    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4a8498-74bb-4942-ab1d-d19dba052c48" containerName="revoke-keys"
Jul 30 18:19:28.219890 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.219836    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4a8498-74bb-4942-ab1d-d19dba052c48" containerName="revoke-keys"
Jul 30 18:19:28.220026 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.219903    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4a8498-74bb-4942-ab1d-d19dba052c48" containerName="revoke-keys"
Jul 30 18:19:28.222835 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.222820    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.226781 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.226761    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8f586d\"/\"kube-root-ca.crt\""
Jul 30 18:19:28.226781 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.226771    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f586d\"/\"auth-test-model-8f586d-kserve-self-signed-certs\""
Jul 30 18:19:28.226993 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.226797    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8f586d\"/\"openshift-service-ca.crt\""
Jul 30 18:19:28.226993 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.226771    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f586d\"/\"default-dockercfg-wdqfz\""
Jul 30 18:19:28.232699 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.232677    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"]
Jul 30 18:19:28.353098 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.353064    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-home\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.353290 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.353124    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-tmp-dir\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.353290 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.353194    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-model-cache\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.353290 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.353212    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hq92\" (UniqueName: \"kubernetes.io/projected/6eadad58-be97-47a9-bd88-e6168182a350-kube-api-access-7hq92\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.353290 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.353230    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-dshm\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.353290 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.353256    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eadad58-be97-47a9-bd88-e6168182a350-tls-certs\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.453863 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.453827    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-home\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.453863 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.453868    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-tmp-dir\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454128 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.453915    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-model-cache\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454128 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.453931    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hq92\" (UniqueName: \"kubernetes.io/projected/6eadad58-be97-47a9-bd88-e6168182a350-kube-api-access-7hq92\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454128 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.453950    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-dshm\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454128 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.453972    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eadad58-be97-47a9-bd88-e6168182a350-tls-certs\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454326 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.454229    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-home\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454326 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.454296    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-model-cache\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.454394 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.454360    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-tmp-dir\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.456175 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.456145    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-dshm\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.456418 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.456399    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eadad58-be97-47a9-bd88-e6168182a350-tls-certs\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.462302 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.462281    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hq92\" (UniqueName: \"kubernetes.io/projected/6eadad58-be97-47a9-bd88-e6168182a350-kube-api-access-7hq92\") pod \"auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") " pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.532208 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.532123    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:28.663457 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.663432    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"]
Jul 30 18:19:28.665715 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:19:28.665682    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eadad58_be97_47a9_bd88_e6168182a350.slice/crio-7a1eab9931df2435fd47c373b1d1837c7ff32d1d5587bbce2c20cbf4669fd04e WatchSource:0}: Error finding container 7a1eab9931df2435fd47c373b1d1837c7ff32d1d5587bbce2c20cbf4669fd04e: Status 404 returned error can't find the container with id 7a1eab9931df2435fd47c373b1d1837c7ff32d1d5587bbce2c20cbf4669fd04e
Jul 30 18:19:28.796570 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.796478    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df" event={"ID":"6eadad58-be97-47a9-bd88-e6168182a350","Type":"ContainerStarted","Data":"cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da"}
Jul 30 18:19:28.796570 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.796527    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df" event={"ID":"6eadad58-be97-47a9-bd88-e6168182a350","Type":"ContainerStarted","Data":"7a1eab9931df2435fd47c373b1d1837c7ff32d1d5587bbce2c20cbf4669fd04e"}
Jul 30 18:19:28.812789 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:28.812734    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df" podStartSLOduration=0.812719099 podStartE2EDuration="812.719099ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:19:28.81227015 +0000 UTC m=+3150.537954429" watchObservedRunningTime="2026-07-30 18:19:28.812719099 +0000 UTC m=+3150.538403578"
Jul 30 18:19:31.226731 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:31.226694    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:19:38.532415 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:38.532381    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:38.532995 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:38.532430    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:38.544834 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:38.544812    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:38.856931 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:38.856826    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:19:54.124636 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.124599    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"]
Jul 30 18:19:54.128499 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.128481    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.131371 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.131345    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"kube-root-ca.crt\""
Jul 30 18:19:54.132694 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.132672    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"default-dockercfg-mg9gp\""
Jul 30 18:19:54.132807 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.132712    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"openshift-service-ca.crt\""
Jul 30 18:19:54.132807 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.132753    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"auth-test-model-fbbaa9-kserve-self-signed-certs\""
Jul 30 18:19:54.137062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.137016    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"]
Jul 30 18:19:54.179638 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.179608    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-tmp-dir\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.179780 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.179642    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-home\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.179780 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.179667    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsz92\" (UniqueName: \"kubernetes.io/projected/0ea4a256-d984-4576-a835-b0c6f9182112-kube-api-access-xsz92\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.179780 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.179756    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-model-cache\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.179901 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.179780    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea4a256-d984-4576-a835-b0c6f9182112-tls-certs\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.179901 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.179869    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-dshm\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.280604 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.280569    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-tmp-dir\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.280604 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.280611    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-home\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.280906 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.280627    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsz92\" (UniqueName: \"kubernetes.io/projected/0ea4a256-d984-4576-a835-b0c6f9182112-kube-api-access-xsz92\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.280906 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.280648    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-model-cache\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.280906 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.280663    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea4a256-d984-4576-a835-b0c6f9182112-tls-certs\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.280906 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.280721    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-dshm\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.281092 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.281015    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-tmp-dir\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.281092 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.281066    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-model-cache\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.281173 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.281101    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-home\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.283041 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.283014    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-dshm\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.283194 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.283175    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea4a256-d984-4576-a835-b0c6f9182112-tls-certs\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.288651 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.288633    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsz92\" (UniqueName: \"kubernetes.io/projected/0ea4a256-d984-4576-a835-b0c6f9182112-kube-api-access-xsz92\") pod \"auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") " pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.440132 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.440039    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:19:54.568769 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.568743    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"]
Jul 30 18:19:54.570831 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:19:54.570806    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ea4a256_d984_4576_a835_b0c6f9182112.slice/crio-352b800b95a48fcf91f92352c28b9e872fb9fb6018b857f0c1414a536257a694 WatchSource:0}: Error finding container 352b800b95a48fcf91f92352c28b9e872fb9fb6018b857f0c1414a536257a694: Status 404 returned error can't find the container with id 352b800b95a48fcf91f92352c28b9e872fb9fb6018b857f0c1414a536257a694
Jul 30 18:19:54.927078 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.927045    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh" event={"ID":"0ea4a256-d984-4576-a835-b0c6f9182112","Type":"ContainerStarted","Data":"854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822"}
Jul 30 18:19:54.927078 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.927084    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh" event={"ID":"0ea4a256-d984-4576-a835-b0c6f9182112","Type":"ContainerStarted","Data":"352b800b95a48fcf91f92352c28b9e872fb9fb6018b857f0c1414a536257a694"}
Jul 30 18:19:54.946544 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:54.946490    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh" podStartSLOduration=0.946473885 podStartE2EDuration="946.473885ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:19:54.945036836 +0000 UTC m=+3176.670721115" watchObservedRunningTime="2026-07-30 18:19:54.946473885 +0000 UTC m=+3176.672158165"
Jul 30 18:19:58.127499 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:19:58.127462    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:20:04.440979 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:20:04.440935    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:20:04.440979 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:20:04.440990    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:20:04.453665 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:20:04.453637    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:20:04.988689 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:20:04.988655    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:20:29.920362 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:20:29.920327    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:20:56.024769 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:20:56.024735    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:21:14.717576 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:21:14.717539    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:21:42.113671 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:21:42.113633    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:21:58.934992 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:21:58.934962    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:21:58.946777 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:21:58.946746    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:21:59.080358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:21:59.080309    2538 scope.go:117] "RemoveContainer" containerID="1bf9491c3c2fe021f4cb1f81e190fe6ab9472c2dd0bee3f43b3e291382bfd425"
Jul 30 18:21:59.089121 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:21:59.089098    2538 scope.go:117] "RemoveContainer" containerID="0c46596d122e1c8177b8d17679db24d08a3ee096de3f47619e59cfef231f4c5a"
Jul 30 18:22:01.823266 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:22:01.823224    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:22:27.718172 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:22:27.718089    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:22:44.723596 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:22:44.723557    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:22:59.112844 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:22:59.112738    2538 scope.go:117] "RemoveContainer" containerID="b59a8e3cb13efa1bdeb8c4b978ff05b3e53e3c1e220e19c879a94789fc7f816b"
Jul 30 18:23:12.526177 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:23:12.526140    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:23:29.617442 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:23:29.617401    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:23:41.919271 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:23:41.919229    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:23:59.131119 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:23:59.131085    2538 scope.go:117] "RemoveContainer" containerID="aa22f174eb1462bbcce6efa60715359b1455fd4475a7d670096415a0959ed426"
Jul 30 18:24:08.724504 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:24:08.724464    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:24:27.420403 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:24:27.420365    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:24:53.322455 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:24:53.322417    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:24:57.998751 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:24:57.998720    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"]
Jul 30 18:24:59.081306 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:24:59.081270    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"]
Jul 30 18:24:59.149723 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:24:59.149694    2538 scope.go:117] "RemoveContainer" containerID="3bcd9ae3a13ee9ab853f2256a09f0e0443af7ae5fddd9a4f120b5b24b2c7813d"
Jul 30 18:25:07.527582 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.527547    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"]
Jul 30 18:25:07.532163 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.532147    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.535194 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.535171    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f586d\"/\"sub-test-model-8f586d-kserve-self-signed-certs\""
Jul 30 18:25:07.540032 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.540008    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"]
Jul 30 18:25:07.580713 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.580686    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3398dc6e-055f-4c6b-9b02-274672663eb3-tls-certs\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.580827 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.580717    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-tmp-dir\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.580827 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.580745    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-dshm\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.580827 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.580763    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr9pt\" (UniqueName: \"kubernetes.io/projected/3398dc6e-055f-4c6b-9b02-274672663eb3-kube-api-access-tr9pt\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.580827 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.580811    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-home\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.581011 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.580854    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-model-cache\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681277 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681247    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3398dc6e-055f-4c6b-9b02-274672663eb3-tls-certs\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681277 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681279    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-tmp-dir\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681459 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681308    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-dshm\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681504 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681481    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr9pt\" (UniqueName: \"kubernetes.io/projected/3398dc6e-055f-4c6b-9b02-274672663eb3-kube-api-access-tr9pt\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681550 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681519    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-home\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681604 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681592    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-model-cache\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681697 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681676    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-tmp-dir\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.681945 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681925    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-home\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.682019 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.681968    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-model-cache\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.683586 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.683562    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-dshm\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.683768 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.683750    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3398dc6e-055f-4c6b-9b02-274672663eb3-tls-certs\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.690983 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.690962    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr9pt\" (UniqueName: \"kubernetes.io/projected/3398dc6e-055f-4c6b-9b02-274672663eb3-kube-api-access-tr9pt\") pod \"sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") " pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.843113 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.843044    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:07.975417 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:07.975395    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"]
Jul 30 18:25:07.977372 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:25:07.977342    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3398dc6e_055f_4c6b_9b02_274672663eb3.slice/crio-5669d0e5caa1280c93e567a6dcf8a3fa8b16863413e68192a469cf526955891b WatchSource:0}: Error finding container 5669d0e5caa1280c93e567a6dcf8a3fa8b16863413e68192a469cf526955891b: Status 404 returned error can't find the container with id 5669d0e5caa1280c93e567a6dcf8a3fa8b16863413e68192a469cf526955891b
Jul 30 18:25:08.458528 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:08.458488    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5" event={"ID":"3398dc6e-055f-4c6b-9b02-274672663eb3","Type":"ContainerStarted","Data":"56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c"}
Jul 30 18:25:08.458528 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:08.458535    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5" event={"ID":"3398dc6e-055f-4c6b-9b02-274672663eb3","Type":"ContainerStarted","Data":"5669d0e5caa1280c93e567a6dcf8a3fa8b16863413e68192a469cf526955891b"}
Jul 30 18:25:08.476031 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:08.475976    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5" podStartSLOduration=1.475959842 podStartE2EDuration="1.475959842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:25:08.474631659 +0000 UTC m=+3490.200315940" watchObservedRunningTime="2026-07-30 18:25:08.475959842 +0000 UTC m=+3490.201644121"
Jul 30 18:25:10.719201 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:10.719170    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:25:13.020577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.020529    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df" podUID="6eadad58-be97-47a9-bd88-e6168182a350" containerName="main" containerID="cri-o://cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da" gracePeriod=45
Jul 30 18:25:13.267524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.267495    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:25:13.323152 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323082    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-tmp-dir\") pod \"6eadad58-be97-47a9-bd88-e6168182a350\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") "
Jul 30 18:25:13.323152 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323123    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-model-cache\") pod \"6eadad58-be97-47a9-bd88-e6168182a350\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") "
Jul 30 18:25:13.323348 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323161    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-home\") pod \"6eadad58-be97-47a9-bd88-e6168182a350\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") "
Jul 30 18:25:13.323348 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323183    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-dshm\") pod \"6eadad58-be97-47a9-bd88-e6168182a350\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") "
Jul 30 18:25:13.323348 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323226    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hq92\" (UniqueName: \"kubernetes.io/projected/6eadad58-be97-47a9-bd88-e6168182a350-kube-api-access-7hq92\") pod \"6eadad58-be97-47a9-bd88-e6168182a350\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") "
Jul 30 18:25:13.323348 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323251    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eadad58-be97-47a9-bd88-e6168182a350-tls-certs\") pod \"6eadad58-be97-47a9-bd88-e6168182a350\" (UID: \"6eadad58-be97-47a9-bd88-e6168182a350\") "
Jul 30 18:25:13.323560 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323380    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6eadad58-be97-47a9-bd88-e6168182a350" (UID: "6eadad58-be97-47a9-bd88-e6168182a350"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:13.323560 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323451    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-model-cache" (OuterVolumeSpecName: "model-cache") pod "6eadad58-be97-47a9-bd88-e6168182a350" (UID: "6eadad58-be97-47a9-bd88-e6168182a350"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:13.323560 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323469    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-home" (OuterVolumeSpecName: "home") pod "6eadad58-be97-47a9-bd88-e6168182a350" (UID: "6eadad58-be97-47a9-bd88-e6168182a350"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:13.323691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323591    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:13.323691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323605    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:13.323691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.323613    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:13.325358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.325331    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-dshm" (OuterVolumeSpecName: "dshm") pod "6eadad58-be97-47a9-bd88-e6168182a350" (UID: "6eadad58-be97-47a9-bd88-e6168182a350"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:13.325461 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.325408    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eadad58-be97-47a9-bd88-e6168182a350-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6eadad58-be97-47a9-bd88-e6168182a350" (UID: "6eadad58-be97-47a9-bd88-e6168182a350"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:25:13.325503 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.325454    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eadad58-be97-47a9-bd88-e6168182a350-kube-api-access-7hq92" (OuterVolumeSpecName: "kube-api-access-7hq92") pod "6eadad58-be97-47a9-bd88-e6168182a350" (UID: "6eadad58-be97-47a9-bd88-e6168182a350"). InnerVolumeSpecName "kube-api-access-7hq92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:25:13.424645 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.424612    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hq92\" (UniqueName: \"kubernetes.io/projected/6eadad58-be97-47a9-bd88-e6168182a350-kube-api-access-7hq92\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:13.424645 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.424639    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eadad58-be97-47a9-bd88-e6168182a350-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:13.424645 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.424649    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eadad58-be97-47a9-bd88-e6168182a350-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:13.485039 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.485005    2538 generic.go:356] "Generic (PLEG): container finished" podID="6eadad58-be97-47a9-bd88-e6168182a350" containerID="cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da" exitCode=0
Jul 30 18:25:13.485197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.485058    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"
Jul 30 18:25:13.485197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.485069    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df" event={"ID":"6eadad58-be97-47a9-bd88-e6168182a350","Type":"ContainerDied","Data":"cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da"}
Jul 30 18:25:13.485197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.485102    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df" event={"ID":"6eadad58-be97-47a9-bd88-e6168182a350","Type":"ContainerDied","Data":"7a1eab9931df2435fd47c373b1d1837c7ff32d1d5587bbce2c20cbf4669fd04e"}
Jul 30 18:25:13.485197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.485120    2538 scope.go:117] "RemoveContainer" containerID="cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da"
Jul 30 18:25:13.494222 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.494204    2538 scope.go:117] "RemoveContainer" containerID="cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da"
Jul 30 18:25:13.494459 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:25:13.494444    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da\": container with ID starting with cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da not found: ID does not exist" containerID="cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da"
Jul 30 18:25:13.494507 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.494465    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da"} err="failed to get container status \"cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da\": rpc error: code = NotFound desc = could not find container \"cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da\": container with ID starting with cd81583996dd7cb215449114ee05a9fb91fab80604a4c5ca125e91b41c1a41da not found: ID does not exist"
Jul 30 18:25:13.507271 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.507250    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"]
Jul 30 18:25:13.511814 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:13.511795    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/auth-test-model-8f586d-kserve-66ddfd6bf9-fz6df"]
Jul 30 18:25:14.100182 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.100141    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh" podUID="0ea4a256-d984-4576-a835-b0c6f9182112" containerName="main" containerID="cri-o://854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822" gracePeriod=45
Jul 30 18:25:14.351421 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.351364    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:25:14.433003 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.432964    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-home\") pod \"0ea4a256-d984-4576-a835-b0c6f9182112\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") "
Jul 30 18:25:14.433211 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433018    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsz92\" (UniqueName: \"kubernetes.io/projected/0ea4a256-d984-4576-a835-b0c6f9182112-kube-api-access-xsz92\") pod \"0ea4a256-d984-4576-a835-b0c6f9182112\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") "
Jul 30 18:25:14.433211 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433088    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea4a256-d984-4576-a835-b0c6f9182112-tls-certs\") pod \"0ea4a256-d984-4576-a835-b0c6f9182112\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") "
Jul 30 18:25:14.433211 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433126    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-tmp-dir\") pod \"0ea4a256-d984-4576-a835-b0c6f9182112\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") "
Jul 30 18:25:14.433211 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433161    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-model-cache\") pod \"0ea4a256-d984-4576-a835-b0c6f9182112\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") "
Jul 30 18:25:14.433410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433217    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-dshm\") pod \"0ea4a256-d984-4576-a835-b0c6f9182112\" (UID: \"0ea4a256-d984-4576-a835-b0c6f9182112\") "
Jul 30 18:25:14.433410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433309    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-home" (OuterVolumeSpecName: "home") pod "0ea4a256-d984-4576-a835-b0c6f9182112" (UID: "0ea4a256-d984-4576-a835-b0c6f9182112"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:14.433492 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433456    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ea4a256-d984-4576-a835-b0c6f9182112" (UID: "0ea4a256-d984-4576-a835-b0c6f9182112"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:14.433492 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433467    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ea4a256-d984-4576-a835-b0c6f9182112" (UID: "0ea4a256-d984-4576-a835-b0c6f9182112"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:14.433606 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433591    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:14.433645 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433608    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:14.433645 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.433619    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:14.435356 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.435334    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea4a256-d984-4576-a835-b0c6f9182112-kube-api-access-xsz92" (OuterVolumeSpecName: "kube-api-access-xsz92") pod "0ea4a256-d984-4576-a835-b0c6f9182112" (UID: "0ea4a256-d984-4576-a835-b0c6f9182112"). InnerVolumeSpecName "kube-api-access-xsz92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:25:14.435427 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.435368    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-dshm" (OuterVolumeSpecName: "dshm") pod "0ea4a256-d984-4576-a835-b0c6f9182112" (UID: "0ea4a256-d984-4576-a835-b0c6f9182112"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:25:14.435427 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.435384    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea4a256-d984-4576-a835-b0c6f9182112-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ea4a256-d984-4576-a835-b0c6f9182112" (UID: "0ea4a256-d984-4576-a835-b0c6f9182112"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:25:14.491507 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.491467    2538 generic.go:356] "Generic (PLEG): container finished" podID="0ea4a256-d984-4576-a835-b0c6f9182112" containerID="854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822" exitCode=0
Jul 30 18:25:14.491651 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.491519    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"
Jul 30 18:25:14.491651 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.491558    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh" event={"ID":"0ea4a256-d984-4576-a835-b0c6f9182112","Type":"ContainerDied","Data":"854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822"}
Jul 30 18:25:14.491651 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.491597    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh" event={"ID":"0ea4a256-d984-4576-a835-b0c6f9182112","Type":"ContainerDied","Data":"352b800b95a48fcf91f92352c28b9e872fb9fb6018b857f0c1414a536257a694"}
Jul 30 18:25:14.491651 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.491613    2538 scope.go:117] "RemoveContainer" containerID="854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822"
Jul 30 18:25:14.500751 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.500731    2538 scope.go:117] "RemoveContainer" containerID="854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822"
Jul 30 18:25:14.501078 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:25:14.501057    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822\": container with ID starting with 854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822 not found: ID does not exist" containerID="854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822"
Jul 30 18:25:14.501148 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.501086    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822"} err="failed to get container status \"854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822\": rpc error: code = NotFound desc = could not find container \"854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822\": container with ID starting with 854cc52b96f8fd3f07ac0af9b7fd07298108046a272ef6a33ef6c224eebe2822 not found: ID does not exist"
Jul 30 18:25:14.514216 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.514186    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"]
Jul 30 18:25:14.518151 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.518123    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/auth-test-model-fbbaa9-kserve-fc7688c95-8n7vh"]
Jul 30 18:25:14.534801 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.534769    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea4a256-d984-4576-a835-b0c6f9182112-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:14.534801 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.534797    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea4a256-d984-4576-a835-b0c6f9182112-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:14.534801 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.534807    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsz92\" (UniqueName: \"kubernetes.io/projected/0ea4a256-d984-4576-a835-b0c6f9182112-kube-api-access-xsz92\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:25:14.826324 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.826281    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea4a256-d984-4576-a835-b0c6f9182112" path="/var/lib/kubelet/pods/0ea4a256-d984-4576-a835-b0c6f9182112/volumes"
Jul 30 18:25:14.826773 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:14.826752    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eadad58-be97-47a9-bd88-e6168182a350" path="/var/lib/kubelet/pods/6eadad58-be97-47a9-bd88-e6168182a350/volumes"
Jul 30 18:25:17.843741 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:17.843709    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:17.844237 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:17.843773    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:17.856055 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:17.856032    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:18.522117 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:18.522082    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:25:30.304789 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.304687    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"]
Jul 30 18:25:30.305358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.305171    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eadad58-be97-47a9-bd88-e6168182a350" containerName="main"
Jul 30 18:25:30.305358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.305186    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eadad58-be97-47a9-bd88-e6168182a350" containerName="main"
Jul 30 18:25:30.305358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.305198    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea4a256-d984-4576-a835-b0c6f9182112" containerName="main"
Jul 30 18:25:30.305358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.305204    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea4a256-d984-4576-a835-b0c6f9182112" containerName="main"
Jul 30 18:25:30.305358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.305265    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea4a256-d984-4576-a835-b0c6f9182112" containerName="main"
Jul 30 18:25:30.305358 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.305274    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eadad58-be97-47a9-bd88-e6168182a350" containerName="main"
Jul 30 18:25:30.309338 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.309319    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.312199 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.312176    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"openshift-service-ca.crt\""
Jul 30 18:25:30.313747 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.313727    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"kube-root-ca.crt\""
Jul 30 18:25:30.313833 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.313748    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"default-dockercfg-mg9gp\""
Jul 30 18:25:30.313833 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.313733    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"sub-test-model-fbbaa9-kserve-self-signed-certs\""
Jul 30 18:25:30.318655 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.318634    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"]
Jul 30 18:25:30.377403 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.377369    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-model-cache\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.377588 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.377412    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-dshm\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.377588 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.377436    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tmp-dir\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.377588 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.377522    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tls-certs\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.377588 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.377558    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8w5d\" (UniqueName: \"kubernetes.io/projected/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-kube-api-access-x8w5d\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.377792 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.377613    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-home\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478241 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478201    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-home\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478436 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478346    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-model-cache\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478436 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478371    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-dshm\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478436 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478392    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tmp-dir\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478436 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478431    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tls-certs\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478666 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478454    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8w5d\" (UniqueName: \"kubernetes.io/projected/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-kube-api-access-x8w5d\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478666 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478650    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-home\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478767 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478740    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tmp-dir\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.478889 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.478853    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-model-cache\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.480849 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.480818    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-dshm\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.481018 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.481001    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tls-certs\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.488973 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.488944    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8w5d\" (UniqueName: \"kubernetes.io/projected/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-kube-api-access-x8w5d\") pod \"sub-test-model-fbbaa9-kserve-58854769df-szcdn\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") " pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.619450 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.619361    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:30.747953 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:30.746381    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"]
Jul 30 18:25:31.570834 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:31.570799    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn" event={"ID":"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f","Type":"ContainerStarted","Data":"819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a"}
Jul 30 18:25:31.570834 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:31.570840    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn" event={"ID":"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f","Type":"ContainerStarted","Data":"06e21e45c6725a17389a306757e4d8626dfa19a542f721467b45012887fb0ca5"}
Jul 30 18:25:31.590260 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:31.590208    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn" podStartSLOduration=1.590192287 podStartE2EDuration="1.590192287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:25:31.58957 +0000 UTC m=+3513.315254294" watchObservedRunningTime="2026-07-30 18:25:31.590192287 +0000 UTC m=+3513.315876566"
Jul 30 18:25:34.318759 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:34.318722    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:25:40.620289 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:40.620253    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:40.620709 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:40.620305    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:40.632772 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:40.632744    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:25:41.632934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:25:41.632909    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:26:22.916419 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:26:22.916382    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:26:42.129110 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:26:42.129074    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:26:58.969139 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:26:58.969110    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:26:58.980090 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:26:58.980065    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:27:04.818866 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:04.818828    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:27:10.094934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:10.094901    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"]
Jul 30 18:27:11.023733 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:11.023699    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"]
Jul 30 18:27:15.004558 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.004521    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"]
Jul 30 18:27:15.008145 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.008128    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.010926 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.010905    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f586d\"/\"rate-test-model-8f586d-kserve-self-signed-certs\""
Jul 30 18:27:15.016715 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.016694    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"]
Jul 30 18:27:15.138957 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.138931    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-home\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.139131 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.138965    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-model-cache\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.139131 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.138986    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tls-certs\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.139131 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.139103    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qxbf\" (UniqueName: \"kubernetes.io/projected/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-kube-api-access-8qxbf\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.139255 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.139138    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-dshm\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.139255 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.139188    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tmp-dir\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240237 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240206    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-dshm\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240369 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240251    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tmp-dir\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240369 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240357    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-home\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240456 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240391    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-model-cache\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240456 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240410    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tls-certs\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240540 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240483    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qxbf\" (UniqueName: \"kubernetes.io/projected/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-kube-api-access-8qxbf\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240623 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240602    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tmp-dir\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240747 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240728    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-home\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.240809 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.240745    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-model-cache\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.242455 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.242434    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-dshm\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.242842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.242819    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tls-certs\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.249473 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.249450    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qxbf\" (UniqueName: \"kubernetes.io/projected/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-kube-api-access-8qxbf\") pod \"rate-test-model-8f586d-kserve-5c9fdb884c-jlm26\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") " pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.318415 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.318357    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:15.446268 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:15.446244    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"]
Jul 30 18:27:15.448858 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:27:15.448829    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7566b5cf_78ec_45a2_b9f6_b3d2de41b29a.slice/crio-4187ac19add224e4929a6f05728efae03337da1d22cb00681f6eae97e87779d5 WatchSource:0}: Error finding container 4187ac19add224e4929a6f05728efae03337da1d22cb00681f6eae97e87779d5: Status 404 returned error can't find the container with id 4187ac19add224e4929a6f05728efae03337da1d22cb00681f6eae97e87779d5
Jul 30 18:27:16.065886 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:16.065834    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26" event={"ID":"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a","Type":"ContainerStarted","Data":"93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011"}
Jul 30 18:27:16.066302 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:16.065894    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26" event={"ID":"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a","Type":"ContainerStarted","Data":"4187ac19add224e4929a6f05728efae03337da1d22cb00681f6eae97e87779d5"}
Jul 30 18:27:16.084264 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:16.084215    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26" podStartSLOduration=2.084200178 podStartE2EDuration="2.084200178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:27:16.082569315 +0000 UTC m=+3617.808253596" watchObservedRunningTime="2026-07-30 18:27:16.084200178 +0000 UTC m=+3617.809884457"
Jul 30 18:27:22.521846 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:22.521794    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:27:25.113502 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.113435    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5" podUID="3398dc6e-055f-4c6b-9b02-274672663eb3" containerName="main" containerID="cri-o://56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c" gracePeriod=45
Jul 30 18:27:25.319269 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.319232    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:25.319420 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.319276    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:25.331669 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.331644    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:25.371240 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.371189    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:27:25.435159 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435127    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3398dc6e-055f-4c6b-9b02-274672663eb3-tls-certs\") pod \"3398dc6e-055f-4c6b-9b02-274672663eb3\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") "
Jul 30 18:27:25.435159 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435162    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-model-cache\") pod \"3398dc6e-055f-4c6b-9b02-274672663eb3\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") "
Jul 30 18:27:25.435397 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435190    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-dshm\") pod \"3398dc6e-055f-4c6b-9b02-274672663eb3\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") "
Jul 30 18:27:25.435397 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435232    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr9pt\" (UniqueName: \"kubernetes.io/projected/3398dc6e-055f-4c6b-9b02-274672663eb3-kube-api-access-tr9pt\") pod \"3398dc6e-055f-4c6b-9b02-274672663eb3\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") "
Jul 30 18:27:25.435397 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435249    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-tmp-dir\") pod \"3398dc6e-055f-4c6b-9b02-274672663eb3\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") "
Jul 30 18:27:25.435397 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435303    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-home\") pod \"3398dc6e-055f-4c6b-9b02-274672663eb3\" (UID: \"3398dc6e-055f-4c6b-9b02-274672663eb3\") "
Jul 30 18:27:25.435619 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435435    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-model-cache" (OuterVolumeSpecName: "model-cache") pod "3398dc6e-055f-4c6b-9b02-274672663eb3" (UID: "3398dc6e-055f-4c6b-9b02-274672663eb3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:25.435619 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435557    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:25.435619 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435540    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3398dc6e-055f-4c6b-9b02-274672663eb3" (UID: "3398dc6e-055f-4c6b-9b02-274672663eb3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:25.435776 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.435622    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-home" (OuterVolumeSpecName: "home") pod "3398dc6e-055f-4c6b-9b02-274672663eb3" (UID: "3398dc6e-055f-4c6b-9b02-274672663eb3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:25.437380 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.437352    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-dshm" (OuterVolumeSpecName: "dshm") pod "3398dc6e-055f-4c6b-9b02-274672663eb3" (UID: "3398dc6e-055f-4c6b-9b02-274672663eb3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:25.437486 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.437398    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3398dc6e-055f-4c6b-9b02-274672663eb3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3398dc6e-055f-4c6b-9b02-274672663eb3" (UID: "3398dc6e-055f-4c6b-9b02-274672663eb3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:27:25.437486 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.437430    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3398dc6e-055f-4c6b-9b02-274672663eb3-kube-api-access-tr9pt" (OuterVolumeSpecName: "kube-api-access-tr9pt") pod "3398dc6e-055f-4c6b-9b02-274672663eb3" (UID: "3398dc6e-055f-4c6b-9b02-274672663eb3"). InnerVolumeSpecName "kube-api-access-tr9pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:27:25.536274 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.536224    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:25.536274 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.536268    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3398dc6e-055f-4c6b-9b02-274672663eb3-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:25.536274 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.536279    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:25.536274 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.536288    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr9pt\" (UniqueName: \"kubernetes.io/projected/3398dc6e-055f-4c6b-9b02-274672663eb3-kube-api-access-tr9pt\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:25.536556 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:25.536297    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3398dc6e-055f-4c6b-9b02-274672663eb3-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.044254 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.044214    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn" podUID="50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" containerName="main" containerID="cri-o://819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a" gracePeriod=45
Jul 30 18:27:26.112723 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.112692    2538 generic.go:356] "Generic (PLEG): container finished" podID="3398dc6e-055f-4c6b-9b02-274672663eb3" containerID="56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c" exitCode=0
Jul 30 18:27:26.112897 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.112734    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"
Jul 30 18:27:26.112897 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.112783    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5" event={"ID":"3398dc6e-055f-4c6b-9b02-274672663eb3","Type":"ContainerDied","Data":"56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c"}
Jul 30 18:27:26.112897 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.112833    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5" event={"ID":"3398dc6e-055f-4c6b-9b02-274672663eb3","Type":"ContainerDied","Data":"5669d0e5caa1280c93e567a6dcf8a3fa8b16863413e68192a469cf526955891b"}
Jul 30 18:27:26.112897 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.112856    2538 scope.go:117] "RemoveContainer" containerID="56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c"
Jul 30 18:27:26.124688 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.124666    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:27:26.156560 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.156537    2538 scope.go:117] "RemoveContainer" containerID="56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c"
Jul 30 18:27:26.157109 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:27:26.157079    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c\": container with ID starting with 56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c not found: ID does not exist" containerID="56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c"
Jul 30 18:27:26.157240 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.157123    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c"} err="failed to get container status \"56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c\": rpc error: code = NotFound desc = could not find container \"56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c\": container with ID starting with 56f4e91512362b1e338af177a094f41caf4257ec130a9f13e99a839addebcf8c not found: ID does not exist"
Jul 30 18:27:26.157480 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.157460    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"]
Jul 30 18:27:26.166180 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.166149    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/sub-test-model-8f586d-kserve-59dd9b5d7c-c75c5"]
Jul 30 18:27:26.301050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.300985    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:27:26.343750 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.343722    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tls-certs\") pod \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") "
Jul 30 18:27:26.343953 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.343785    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8w5d\" (UniqueName: \"kubernetes.io/projected/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-kube-api-access-x8w5d\") pod \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") "
Jul 30 18:27:26.343953 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.343812    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-dshm\") pod \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") "
Jul 30 18:27:26.343953 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.343864    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-model-cache\") pod \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") "
Jul 30 18:27:26.343953 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.343928    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tmp-dir\") pod \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") "
Jul 30 18:27:26.343953 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.343947    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-home\") pod \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\" (UID: \"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f\") "
Jul 30 18:27:26.344263 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.344227    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-model-cache" (OuterVolumeSpecName: "model-cache") pod "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" (UID: "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:26.344263 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.344245    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" (UID: "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:26.344365 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.344347    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-home" (OuterVolumeSpecName: "home") pod "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" (UID: "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:26.346066 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.346028    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-dshm" (OuterVolumeSpecName: "dshm") pod "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" (UID: "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:27:26.346186 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.346058    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-kube-api-access-x8w5d" (OuterVolumeSpecName: "kube-api-access-x8w5d") pod "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" (UID: "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f"). InnerVolumeSpecName "kube-api-access-x8w5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:27:26.346186 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.346078    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" (UID: "50d6f5d0-e936-4c44-bd1d-95ba6737ed4f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:27:26.445585 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.445552    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.445585 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.445577    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.445585 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.445586    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.445585 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.445593    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.445843 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.445602    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8w5d\" (UniqueName: \"kubernetes.io/projected/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-kube-api-access-x8w5d\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.445843 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.445612    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:27:26.826650 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:26.826615    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3398dc6e-055f-4c6b-9b02-274672663eb3" path="/var/lib/kubelet/pods/3398dc6e-055f-4c6b-9b02-274672663eb3/volumes"
Jul 30 18:27:27.119817 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.119724    2538 generic.go:356] "Generic (PLEG): container finished" podID="50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" containerID="819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a" exitCode=0
Jul 30 18:27:27.119817 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.119769    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"
Jul 30 18:27:27.119817 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.119805    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn" event={"ID":"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f","Type":"ContainerDied","Data":"819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a"}
Jul 30 18:27:27.120142 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.119849    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn" event={"ID":"50d6f5d0-e936-4c44-bd1d-95ba6737ed4f","Type":"ContainerDied","Data":"06e21e45c6725a17389a306757e4d8626dfa19a542f721467b45012887fb0ca5"}
Jul 30 18:27:27.120142 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.119867    2538 scope.go:117] "RemoveContainer" containerID="819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a"
Jul 30 18:27:27.128296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.128278    2538 scope.go:117] "RemoveContainer" containerID="819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a"
Jul 30 18:27:27.128597 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:27:27.128529    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a\": container with ID starting with 819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a not found: ID does not exist" containerID="819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a"
Jul 30 18:27:27.128597 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.128555    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a"} err="failed to get container status \"819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a\": rpc error: code = NotFound desc = could not find container \"819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a\": container with ID starting with 819e476e7c7b80d00a32c4a3be952d7106c2d71bc10e0023d74ce4a244b8c86a not found: ID does not exist"
Jul 30 18:27:27.137428 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.137405    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"]
Jul 30 18:27:27.141232 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:27.141212    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/sub-test-model-fbbaa9-kserve-58854769df-szcdn"]
Jul 30 18:27:28.826047 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:28.826010    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" path="/var/lib/kubelet/pods/50d6f5d0-e936-4c44-bd1d-95ba6737ed4f/volumes"
Jul 30 18:27:39.724351 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724313    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"]
Jul 30 18:27:39.724764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724668    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3398dc6e-055f-4c6b-9b02-274672663eb3" containerName="main"
Jul 30 18:27:39.724764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724680    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="3398dc6e-055f-4c6b-9b02-274672663eb3" containerName="main"
Jul 30 18:27:39.724764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724695    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" containerName="main"
Jul 30 18:27:39.724764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724701    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" containerName="main"
Jul 30 18:27:39.724764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724751    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="3398dc6e-055f-4c6b-9b02-274672663eb3" containerName="main"
Jul 30 18:27:39.724764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.724763    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d6f5d0-e936-4c44-bd1d-95ba6737ed4f" containerName="main"
Jul 30 18:27:39.728828 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.728811    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.731997 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.731976    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"rate-test-model-fbbaa9-kserve-self-signed-certs\""
Jul 30 18:27:39.733009 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.732991    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"openshift-service-ca.crt\""
Jul 30 18:27:39.733082 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.733016    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"kube-root-ca.crt\""
Jul 30 18:27:39.733517 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.733499    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fbbaa9\"/\"default-dockercfg-mg9gp\""
Jul 30 18:27:39.739221 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.739201    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"]
Jul 30 18:27:39.873868 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.873832    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-dshm\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.873868 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.873867    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tmp-dir\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.874118 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.873960    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-home\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.874118 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.874002    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tls-certs\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.874118 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.874018    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457jr\" (UniqueName: \"kubernetes.io/projected/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-kube-api-access-457jr\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.874118 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.874036    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-model-cache\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.974811 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.974725    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-dshm\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.974811 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.974763    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tmp-dir\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.974811 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.974797    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-home\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.975050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.974845    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tls-certs\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.975050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.974871    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457jr\" (UniqueName: \"kubernetes.io/projected/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-kube-api-access-457jr\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.975050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.974923    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-model-cache\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.975247 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.975223    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-home\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.975325 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.975267    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tmp-dir\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.975325 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.975292    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-model-cache\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.977108 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.977083    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-dshm\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.977302 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.977288    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tls-certs\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:39.984530 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:39.984505    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-457jr\" (UniqueName: \"kubernetes.io/projected/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-kube-api-access-457jr\") pod \"rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") " pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:40.038975 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:40.038940    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:40.171270 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:40.171242    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"]
Jul 30 18:27:40.173149 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:27:40.173121    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f6133fd_aa34_4221_8c9b_8c26594e6b2b.slice/crio-c6f51598547536dfefb682aa2281c1fd39504ba45123ba8682bca33152f9f0e0 WatchSource:0}: Error finding container c6f51598547536dfefb682aa2281c1fd39504ba45123ba8682bca33152f9f0e0: Status 404 returned error can't find the container with id c6f51598547536dfefb682aa2281c1fd39504ba45123ba8682bca33152f9f0e0
Jul 30 18:27:40.185347 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:40.185316    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2" event={"ID":"8f6133fd-aa34-4221-8c9b-8c26594e6b2b","Type":"ContainerStarted","Data":"c6f51598547536dfefb682aa2281c1fd39504ba45123ba8682bca33152f9f0e0"}
Jul 30 18:27:41.191740 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:41.191708    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2" event={"ID":"8f6133fd-aa34-4221-8c9b-8c26594e6b2b","Type":"ContainerStarted","Data":"6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081"}
Jul 30 18:27:41.210263 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:41.210219    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2" podStartSLOduration=2.210203465 podStartE2EDuration="2.210203465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:27:41.209014767 +0000 UTC m=+3642.934699087" watchObservedRunningTime="2026-07-30 18:27:41.210203465 +0000 UTC m=+3642.935887775"
Jul 30 18:27:42.616868 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:42.616836    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:27:50.039973 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:50.039925    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:50.040473 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:50.039989    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:50.052400 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:50.052374    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:27:50.245254 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:27:50.245228    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:28:35.515478 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:28:35.515439    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:28:50.725169 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:28:50.725130    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:29:22.432160 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:22.432105    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:29:29.016680 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:29.016647    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"]
Jul 30 18:29:30.038815 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:30.038785    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"]
Jul 30 18:29:42.614749 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:42.614716    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:29:44.035684 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.035632    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26" podUID="7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" containerName="main" containerID="cri-o://93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011" gracePeriod=45
Jul 30 18:29:44.291459 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.291402    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:29:44.355381 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355346    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qxbf\" (UniqueName: \"kubernetes.io/projected/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-kube-api-access-8qxbf\") pod \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") "
Jul 30 18:29:44.355569 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355397    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-dshm\") pod \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") "
Jul 30 18:29:44.355569 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355468    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tls-certs\") pod \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") "
Jul 30 18:29:44.355569 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355496    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-model-cache\") pod \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") "
Jul 30 18:29:44.355569 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355521    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tmp-dir\") pod \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") "
Jul 30 18:29:44.355569 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355550    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-home\") pod \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\" (UID: \"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a\") "
Jul 30 18:29:44.355870 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355816    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-model-cache" (OuterVolumeSpecName: "model-cache") pod "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" (UID: "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:44.355954 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355842    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" (UID: "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:44.355954 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.355898    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-home" (OuterVolumeSpecName: "home") pod "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" (UID: "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:44.357601 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.357572    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-dshm" (OuterVolumeSpecName: "dshm") pod "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" (UID: "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:44.357706 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.357644    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" (UID: "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:29:44.357706 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.357687    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-kube-api-access-8qxbf" (OuterVolumeSpecName: "kube-api-access-8qxbf") pod "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" (UID: "7566b5cf-78ec-45a2-b9f6-b3d2de41b29a"). InnerVolumeSpecName "kube-api-access-8qxbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:29:44.456608 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.456573    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:44.456608 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.456600    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:44.456823 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.456630    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:44.456823 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.456638    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:44.456823 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.456647    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qxbf\" (UniqueName: \"kubernetes.io/projected/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-kube-api-access-8qxbf\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:44.456823 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.456656    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:44.762978 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.762944    2538 generic.go:356] "Generic (PLEG): container finished" podID="7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" containerID="93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011" exitCode=0
Jul 30 18:29:44.762978 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.762979    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"
Jul 30 18:29:44.763235 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.762983    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26" event={"ID":"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a","Type":"ContainerDied","Data":"93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011"}
Jul 30 18:29:44.763235 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.763108    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26" event={"ID":"7566b5cf-78ec-45a2-b9f6-b3d2de41b29a","Type":"ContainerDied","Data":"4187ac19add224e4929a6f05728efae03337da1d22cb00681f6eae97e87779d5"}
Jul 30 18:29:44.763235 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.763140    2538 scope.go:117] "RemoveContainer" containerID="93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011"
Jul 30 18:29:44.772071 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.772051    2538 scope.go:117] "RemoveContainer" containerID="93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011"
Jul 30 18:29:44.772327 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:29:44.772307    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011\": container with ID starting with 93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011 not found: ID does not exist" containerID="93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011"
Jul 30 18:29:44.772376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.772336    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011"} err="failed to get container status \"93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011\": rpc error: code = NotFound desc = could not find container \"93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011\": container with ID starting with 93b0b4b199f84a442a77c71f61be31bf0f842ae8e882f335c5607d73d61f3011 not found: ID does not exist"
Jul 30 18:29:44.784416 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.784391    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"]
Jul 30 18:29:44.788429 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.788401    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8f586d/rate-test-model-8f586d-kserve-5c9fdb884c-jlm26"]
Jul 30 18:29:44.826802 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:44.826777    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" path="/var/lib/kubelet/pods/7566b5cf-78ec-45a2-b9f6-b3d2de41b29a/volumes"
Jul 30 18:29:45.057256 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.057156    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2" podUID="8f6133fd-aa34-4221-8c9b-8c26594e6b2b" containerName="main" containerID="cri-o://6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081" gracePeriod=45
Jul 30 18:29:45.314554 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.314491    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:29:45.364264 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364227    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-model-cache\") pod \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") "
Jul 30 18:29:45.364264 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364269    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-dshm\") pod \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") "
Jul 30 18:29:45.364524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364332    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tmp-dir\") pod \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") "
Jul 30 18:29:45.364524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364360    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tls-certs\") pod \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") "
Jul 30 18:29:45.364524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364380    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-457jr\" (UniqueName: \"kubernetes.io/projected/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-kube-api-access-457jr\") pod \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") "
Jul 30 18:29:45.364524 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364405    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-home\") pod \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\" (UID: \"8f6133fd-aa34-4221-8c9b-8c26594e6b2b\") "
Jul 30 18:29:45.364731 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364576    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f6133fd-aa34-4221-8c9b-8c26594e6b2b" (UID: "8f6133fd-aa34-4221-8c9b-8c26594e6b2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:45.364731 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364654    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f6133fd-aa34-4221-8c9b-8c26594e6b2b" (UID: "8f6133fd-aa34-4221-8c9b-8c26594e6b2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:45.364731 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.364709    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-home" (OuterVolumeSpecName: "home") pod "8f6133fd-aa34-4221-8c9b-8c26594e6b2b" (UID: "8f6133fd-aa34-4221-8c9b-8c26594e6b2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:45.366507 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.366482    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-dshm" (OuterVolumeSpecName: "dshm") pod "8f6133fd-aa34-4221-8c9b-8c26594e6b2b" (UID: "8f6133fd-aa34-4221-8c9b-8c26594e6b2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:29:45.366602 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.366519    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-kube-api-access-457jr" (OuterVolumeSpecName: "kube-api-access-457jr") pod "8f6133fd-aa34-4221-8c9b-8c26594e6b2b" (UID: "8f6133fd-aa34-4221-8c9b-8c26594e6b2b"). InnerVolumeSpecName "kube-api-access-457jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:29:45.366602 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.366528    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f6133fd-aa34-4221-8c9b-8c26594e6b2b" (UID: "8f6133fd-aa34-4221-8c9b-8c26594e6b2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:29:45.465931 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.465869    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:45.465931 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.465923    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:45.465931 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.465932    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:45.465931 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.465941    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:45.466218 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.465949    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-457jr\" (UniqueName: \"kubernetes.io/projected/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-kube-api-access-457jr\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:45.466218 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.465957    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f6133fd-aa34-4221-8c9b-8c26594e6b2b-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:29:45.768935 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.768901    2538 generic.go:356] "Generic (PLEG): container finished" podID="8f6133fd-aa34-4221-8c9b-8c26594e6b2b" containerID="6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081" exitCode=0
Jul 30 18:29:45.769150 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.768947    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"
Jul 30 18:29:45.769150 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.768984    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2" event={"ID":"8f6133fd-aa34-4221-8c9b-8c26594e6b2b","Type":"ContainerDied","Data":"6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081"}
Jul 30 18:29:45.769150 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.769025    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2" event={"ID":"8f6133fd-aa34-4221-8c9b-8c26594e6b2b","Type":"ContainerDied","Data":"c6f51598547536dfefb682aa2281c1fd39504ba45123ba8682bca33152f9f0e0"}
Jul 30 18:29:45.769150 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.769048    2538 scope.go:117] "RemoveContainer" containerID="6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081"
Jul 30 18:29:45.778592 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.778574    2538 scope.go:117] "RemoveContainer" containerID="6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081"
Jul 30 18:29:45.778834 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:29:45.778818    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081\": container with ID starting with 6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081 not found: ID does not exist" containerID="6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081"
Jul 30 18:29:45.778895 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.778842    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081"} err="failed to get container status \"6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081\": rpc error: code = NotFound desc = could not find container \"6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081\": container with ID starting with 6238a5d655313d0b7f12a1547cca179325e7ea6a256bd7b4eb4b6766e1a41081 not found: ID does not exist"
Jul 30 18:29:45.792013 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.791986    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"]
Jul 30 18:29:45.795589 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:45.795565    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fbbaa9/rate-test-model-fbbaa9-kserve-6bfdd45bd7-sqcr2"]
Jul 30 18:29:46.826165 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:29:46.826133    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f6133fd-aa34-4221-8c9b-8c26594e6b2b" path="/var/lib/kubelet/pods/8f6133fd-aa34-4221-8c9b-8c26594e6b2b/volumes"
Jul 30 18:30:00.140076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140020    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"]
Jul 30 18:30:00.140527 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140508    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" containerName="main"
Jul 30 18:30:00.140575 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140530    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" containerName="main"
Jul 30 18:30:00.140575 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140568    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6133fd-aa34-4221-8c9b-8c26594e6b2b" containerName="main"
Jul 30 18:30:00.140646 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140577    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6133fd-aa34-4221-8c9b-8c26594e6b2b" containerName="main"
Jul 30 18:30:00.140690 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140647    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6133fd-aa34-4221-8c9b-8c26594e6b2b" containerName="main"
Jul 30 18:30:00.140690 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.140659    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="7566b5cf-78ec-45a2-b9f6-b3d2de41b29a" containerName="main"
Jul 30 18:30:00.144955 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.144937    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"]
Jul 30 18:30:00.145077 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.145060    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"
Jul 30 18:30:00.148146 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.148128    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"]
Jul 30 18:30:00.148270 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.148231    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"
Jul 30 18:30:00.149134 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.149102    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:30:00.151857 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.151831    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"]
Jul 30 18:30:00.152167 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.152149    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"
Jul 30 18:30:00.155587 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.155569    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"]
Jul 30 18:30:00.155729 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.155716    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"]
Jul 30 18:30:00.155936 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.155920    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"
Jul 30 18:30:00.156529 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.156466    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"]
Jul 30 18:30:00.158922 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.158906    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"
Jul 30 18:30:00.169630 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.169605    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"]
Jul 30 18:30:00.170160 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.170141    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"
Jul 30 18:30:00.203390 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.203365    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"
Jul 30 18:30:00.211038 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.211015    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"
Jul 30 18:30:00.532586 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.532562    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"]
Jul 30 18:30:00.534568 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:30:00.534544    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b84511_0c3b_4867_a75b_08600da6ec86.slice/crio-0fbf1e9d34708845c0f942520a2213466b0370190e0f504893871fd496498c7d WatchSource:0}: Error finding container 0fbf1e9d34708845c0f942520a2213466b0370190e0f504893871fd496498c7d: Status 404 returned error can't find the container with id 0fbf1e9d34708845c0f942520a2213466b0370190e0f504893871fd496498c7d
Jul 30 18:30:00.566084 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.566042    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"]
Jul 30 18:30:00.568346 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:30:00.568316    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f4fbe3_e218_43b6_85f2_2283bd9757da.slice/crio-57efde89d57be1a52b2845e09597cc218dcc21435d992e1188ff08079c802dab WatchSource:0}: Error finding container 57efde89d57be1a52b2845e09597cc218dcc21435d992e1188ff08079c802dab: Status 404 returned error can't find the container with id 57efde89d57be1a52b2845e09597cc218dcc21435d992e1188ff08079c802dab
Jul 30 18:30:00.590137 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.590106    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"]
Jul 30 18:30:00.592835 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.592810    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"]
Jul 30 18:30:00.598081 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:30:00.598054    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27688888_73ac_4194_b004_a4dd339aa328.slice/crio-4500a7b8383ac249bc3ad4bbc9f83ab95ccaf2a292b3d27e0d138bf5c25f5022 WatchSource:0}: Error finding container 4500a7b8383ac249bc3ad4bbc9f83ab95ccaf2a292b3d27e0d138bf5c25f5022: Status 404 returned error can't find the container with id 4500a7b8383ac249bc3ad4bbc9f83ab95ccaf2a292b3d27e0d138bf5c25f5022
Jul 30 18:30:00.598304 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:30:00.598282    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34af0beb_9f85_4df3_b853_9bd15bdae070.slice/crio-df99881de1fe52de1ca122eb0e46d9ef290b908505b94e91f8468de913ea607a WatchSource:0}: Error finding container df99881de1fe52de1ca122eb0e46d9ef290b908505b94e91f8468de913ea607a: Status 404 returned error can't find the container with id df99881de1fe52de1ca122eb0e46d9ef290b908505b94e91f8468de913ea607a
Jul 30 18:30:00.850663 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.850625    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4" event={"ID":"33b84511-0c3b-4867-a75b-08600da6ec86","Type":"ContainerStarted","Data":"0fbf1e9d34708845c0f942520a2213466b0370190e0f504893871fd496498c7d"}
Jul 30 18:30:00.852185 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.852141    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq" event={"ID":"27688888-73ac-4194-b004-a4dd339aa328","Type":"ContainerStarted","Data":"4500a7b8383ac249bc3ad4bbc9f83ab95ccaf2a292b3d27e0d138bf5c25f5022"}
Jul 30 18:30:00.854401 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.854379    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm" event={"ID":"88f4fbe3-e218-43b6-85f2-2283bd9757da","Type":"ContainerStarted","Data":"57efde89d57be1a52b2845e09597cc218dcc21435d992e1188ff08079c802dab"}
Jul 30 18:30:00.855525 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:00.855503    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb" event={"ID":"34af0beb-9f85-4df3-b853-9bd15bdae070","Type":"ContainerStarted","Data":"df99881de1fe52de1ca122eb0e46d9ef290b908505b94e91f8468de913ea607a"}
Jul 30 18:30:01.861484 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.861451    2538 generic.go:356] "Generic (PLEG): container finished" podID="27688888-73ac-4194-b004-a4dd339aa328" containerID="42453e9b5eb781886910e57804fd91a06474550e6538d5ef5389910933b76845" exitCode=7
Jul 30 18:30:01.861862 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.861535    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq" event={"ID":"27688888-73ac-4194-b004-a4dd339aa328","Type":"ContainerDied","Data":"42453e9b5eb781886910e57804fd91a06474550e6538d5ef5389910933b76845"}
Jul 30 18:30:01.861862 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.861667    2538 scope.go:117] "RemoveContainer" containerID="42453e9b5eb781886910e57804fd91a06474550e6538d5ef5389910933b76845"
Jul 30 18:30:01.863090 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.863068    2538 generic.go:356] "Generic (PLEG): container finished" podID="88f4fbe3-e218-43b6-85f2-2283bd9757da" containerID="2ef2dcc56bd0ede55f00198eb9eb960db2fe39124dfde04617d4a611ce1238b5" exitCode=0
Jul 30 18:30:01.863204 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.863140    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm" event={"ID":"88f4fbe3-e218-43b6-85f2-2283bd9757da","Type":"ContainerDied","Data":"2ef2dcc56bd0ede55f00198eb9eb960db2fe39124dfde04617d4a611ce1238b5"}
Jul 30 18:30:01.864646 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.864622    2538 generic.go:356] "Generic (PLEG): container finished" podID="34af0beb-9f85-4df3-b853-9bd15bdae070" containerID="18281df0379db2af285f3d51e46fdcce56a14aa1f5b0415c8e65f1e7c221ea73" exitCode=0
Jul 30 18:30:01.864744 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.864688    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb" event={"ID":"34af0beb-9f85-4df3-b853-9bd15bdae070","Type":"ContainerDied","Data":"18281df0379db2af285f3d51e46fdcce56a14aa1f5b0415c8e65f1e7c221ea73"}
Jul 30 18:30:01.866146 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.866127    2538 generic.go:356] "Generic (PLEG): container finished" podID="33b84511-0c3b-4867-a75b-08600da6ec86" containerID="90ec0d651e225e71008f30c817bc33d5becdb342186754e0f5984781613e0f3e" exitCode=0
Jul 30 18:30:01.866235 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:01.866161    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4" event={"ID":"33b84511-0c3b-4867-a75b-08600da6ec86","Type":"ContainerDied","Data":"90ec0d651e225e71008f30c817bc33d5becdb342186754e0f5984781613e0f3e"}
Jul 30 18:30:02.727647 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:02.727616    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:30:02.872505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:02.872470    2538 generic.go:356] "Generic (PLEG): container finished" podID="27688888-73ac-4194-b004-a4dd339aa328" containerID="ce4b5c4ac57c632dd52cc35934540300359fcf7e43c476126c1d970857f025f3" exitCode=0
Jul 30 18:30:02.872982 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:02.872549    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq" event={"ID":"27688888-73ac-4194-b004-a4dd339aa328","Type":"ContainerDied","Data":"ce4b5c4ac57c632dd52cc35934540300359fcf7e43c476126c1d970857f025f3"}
Jul 30 18:30:02.872982 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:02.872608    2538 scope.go:117] "RemoveContainer" containerID="42453e9b5eb781886910e57804fd91a06474550e6538d5ef5389910933b76845"
Jul 30 18:30:03.026738 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.026711    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"
Jul 30 18:30:03.052213 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.052191    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"
Jul 30 18:30:03.055521 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.055500    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"
Jul 30 18:30:03.878861 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.878838    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"
Jul 30 18:30:03.879356 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.878829    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm" event={"ID":"88f4fbe3-e218-43b6-85f2-2283bd9757da","Type":"ContainerDied","Data":"57efde89d57be1a52b2845e09597cc218dcc21435d992e1188ff08079c802dab"}
Jul 30 18:30:03.879356 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.878939    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57efde89d57be1a52b2845e09597cc218dcc21435d992e1188ff08079c802dab"
Jul 30 18:30:03.880078 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.880060    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"
Jul 30 18:30:03.880195 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.880096    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb" event={"ID":"34af0beb-9f85-4df3-b853-9bd15bdae070","Type":"ContainerDied","Data":"df99881de1fe52de1ca122eb0e46d9ef290b908505b94e91f8468de913ea607a"}
Jul 30 18:30:03.880195 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.880129    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df99881de1fe52de1ca122eb0e46d9ef290b908505b94e91f8468de913ea607a"
Jul 30 18:30:03.881495 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.881475    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4"
Jul 30 18:30:03.881628 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.881497    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757270-ccbp4" event={"ID":"33b84511-0c3b-4867-a75b-08600da6ec86","Type":"ContainerDied","Data":"0fbf1e9d34708845c0f942520a2213466b0370190e0f504893871fd496498c7d"}
Jul 30 18:30:03.881628 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:03.881532    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fbf1e9d34708845c0f942520a2213466b0370190e0f504893871fd496498c7d"
Jul 30 18:30:04.011548 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:04.011524    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"
Jul 30 18:30:04.889291 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:04.889258    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq" event={"ID":"27688888-73ac-4194-b004-a4dd339aa328","Type":"ContainerDied","Data":"4500a7b8383ac249bc3ad4bbc9f83ab95ccaf2a292b3d27e0d138bf5c25f5022"}
Jul 30 18:30:04.889291 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:04.889288    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"
Jul 30 18:30:04.889718 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:04.889308    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4500a7b8383ac249bc3ad4bbc9f83ab95ccaf2a292b3d27e0d138bf5c25f5022"
Jul 30 18:30:19.525807 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.525770    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"]
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526111    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34af0beb-9f85-4df3-b853-9bd15bdae070" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526123    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="34af0beb-9f85-4df3-b853-9bd15bdae070" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526140    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b84511-0c3b-4867-a75b-08600da6ec86" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526146    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b84511-0c3b-4867-a75b-08600da6ec86" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526162    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f4fbe3-e218-43b6-85f2-2283bd9757da" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526168    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f4fbe3-e218-43b6-85f2-2283bd9757da" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526173    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27688888-73ac-4194-b004-a4dd339aa328" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526178    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="27688888-73ac-4194-b004-a4dd339aa328" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526186    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27688888-73ac-4194-b004-a4dd339aa328" containerName="cleanup"
Jul 30 18:30:19.526197 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526191    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="27688888-73ac-4194-b004-a4dd339aa328" containerName="cleanup"
Jul 30 18:30:19.526505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526253    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b84511-0c3b-4867-a75b-08600da6ec86" containerName="cleanup"
Jul 30 18:30:19.526505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526261    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="27688888-73ac-4194-b004-a4dd339aa328" containerName="cleanup"
Jul 30 18:30:19.526505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526267    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="34af0beb-9f85-4df3-b853-9bd15bdae070" containerName="cleanup"
Jul 30 18:30:19.526505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.526274    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f4fbe3-e218-43b6-85f2-2283bd9757da" containerName="cleanup"
Jul 30 18:30:19.529230 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.529213    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.532109 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.532089    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 18:30:19.532236 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.532094    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c8d7de-openshift-default-dockercfg-xjcgf\""
Jul 30 18:30:19.543350 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.543316    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"]
Jul 30 18:30:19.648353 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648319    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-data\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648353 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648357    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-podinfo\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648489    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-socket\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648519    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-certs\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648543    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-token\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648563    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-credential-socket\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648577 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648579    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-envoy\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648754 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648595    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzqrt\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-kube-api-access-qzqrt\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.648754 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.648622    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istiod-ca-cert\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750047 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750015    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-socket\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750052    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-certs\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750174    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-token\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750216    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-credential-socket\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750384 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750336    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-envoy\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750384 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750375    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzqrt\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-kube-api-access-qzqrt\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750444    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-certs\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750505 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750488    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-socket\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750612 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750489    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istiod-ca-cert\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750612 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750587    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-data\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750683 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750616    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-podinfo\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750790 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750773    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-credential-socket\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.750955 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.750925    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-data\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.751095 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.751076    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istiod-ca-cert\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.752635 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.752606    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-envoy\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.752847 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.752830    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-podinfo\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.758319 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.758296    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-token\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.758727 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.758710    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzqrt\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-kube-api-access-qzqrt\") pod \"e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") " pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.846589 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.846534    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:19.978236 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.978207    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"]
Jul 30 18:30:19.979789 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:30:19.979765    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9f3327_fcc0_46a2_8662_ff4e33b0d093.slice/crio-be25b0467117af15af2b856411a9a50e70d0f7bf5d64f22cdd400c0cdf429bf9 WatchSource:0}: Error finding container be25b0467117af15af2b856411a9a50e70d0f7bf5d64f22cdd400c0cdf429bf9: Status 404 returned error can't find the container with id be25b0467117af15af2b856411a9a50e70d0f7bf5d64f22cdd400c0cdf429bf9
Jul 30 18:30:19.981677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:19.981657    2538 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 18:30:20.965266 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:20.965233    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" event={"ID":"af9f3327-fcc0-46a2-8662-ff4e33b0d093","Type":"ContainerStarted","Data":"be25b0467117af15af2b856411a9a50e70d0f7bf5d64f22cdd400c0cdf429bf9"}
Jul 30 18:30:22.758812 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:22.758768    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:30:22.759125 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:22.758846    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:30:22.759125 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:22.758894    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:30:22.976372 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:22.976338    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" event={"ID":"af9f3327-fcc0-46a2-8662-ff4e33b0d093","Type":"ContainerStarted","Data":"31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"}
Jul 30 18:30:23.000814 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:23.000755    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podStartSLOduration=1.224089809 podStartE2EDuration="4.000733599s" totalImagesPullingTime="2.77664379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:30:22.998685846 +0000 UTC m=+3804.724370152" watchObservedRunningTime="2026-07-30 18:30:23.000733599 +0000 UTC m=+3804.726417891"
Jul 30 18:30:23.846934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:23.846903    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:23.851923 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:23.851897    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:23.981066 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:23.981035    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:23.981785 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:23.981765    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:31.326124 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:31.326084    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:30:39.375691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:39.375661    2538 patch_prober.go:28] interesting pod/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:33624->10.133.0.60:15021: read: connection reset by peer" start-of-body=
Jul 30 18:30:39.376059 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:39.375728    2538 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:33624->10.133.0.60:15021: read: connection reset by peer"
Jul 30 18:30:40.067830 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:40.067798    2538 generic.go:356] "Generic (PLEG): container finished" podID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerID="31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283" exitCode=0
Jul 30 18:30:40.068063 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:40.067888    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" event={"ID":"af9f3327-fcc0-46a2-8662-ff4e33b0d093","Type":"ContainerDied","Data":"31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"}
Jul 30 18:30:40.068343 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:40.068326    2538 scope.go:117] "RemoveContainer" containerID="31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"
Jul 30 18:30:40.070427 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:40.070397    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:30:40.070522 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:40.070470    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:30:40.070522 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:40.070503    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:30:41.075141 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:41.075106    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" event={"ID":"af9f3327-fcc0-46a2-8662-ff4e33b0d093","Type":"ContainerStarted","Data":"c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0"}
Jul 30 18:30:41.847442 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:41.847401    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:41.847835 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:41.847804    2538 patch_prober.go:28] interesting pod/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 18:30:41.847978 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:41.847919    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 18:30:42.847544 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:42.847508    2538 patch_prober.go:28] interesting pod/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 18:30:42.848212 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:42.848176    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 18:30:43.847712 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:43.847664    2538 patch_prober.go:28] interesting pod/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 30 18:30:43.848244 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:43.847747    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 30 18:30:44.850360 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:44.850330    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:44.850837 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:44.850561    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:44.851320 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:44.851301    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:30:59.919296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.919265    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"]
Jul 30 18:30:59.919689 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.919648    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="27688888-73ac-4194-b004-a4dd339aa328" containerName="cleanup"
Jul 30 18:30:59.921602 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.921586    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:30:59.925645 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.925620    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fadb12\"/\"kube-root-ca.crt\""
Jul 30 18:30:59.925850 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.925834    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fadb12\"/\"ipp-route-fadb12-kserve-self-signed-certs\""
Jul 30 18:30:59.925957 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.925933    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fadb12\"/\"openshift-service-ca.crt\""
Jul 30 18:30:59.926019 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.925974    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fadb12\"/\"default-dockercfg-6gfq5\""
Jul 30 18:30:59.932112 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:30:59.932090    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"]
Jul 30 18:31:00.003240 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.003211    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe38195e-f438-40bc-8d35-7be16014a301-tls-certs\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.003412 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.003260    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-tmp-dir\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.003412 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.003280    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-dshm\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.003412 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.003341    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b57cw\" (UniqueName: \"kubernetes.io/projected/fe38195e-f438-40bc-8d35-7be16014a301-kube-api-access-b57cw\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.003412 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.003383    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-home\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.003548 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.003429    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-model-cache\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104245 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104212    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-home\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104265    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-model-cache\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104302    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe38195e-f438-40bc-8d35-7be16014a301-tls-certs\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104339    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-tmp-dir\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104367    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-dshm\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104393    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b57cw\" (UniqueName: \"kubernetes.io/projected/fe38195e-f438-40bc-8d35-7be16014a301-kube-api-access-b57cw\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104666 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104650    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-home\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104742 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104724    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-model-cache\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.104838 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.104821    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-tmp-dir\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.106478 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.106453    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-dshm\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.106720 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.106704    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe38195e-f438-40bc-8d35-7be16014a301-tls-certs\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.113440 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.113418    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b57cw\" (UniqueName: \"kubernetes.io/projected/fe38195e-f438-40bc-8d35-7be16014a301-kube-api-access-b57cw\") pod \"ipp-route-fadb12-kserve-5c99bc6f87-gnw4x\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") " pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.231031 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.230994    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:00.359498 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:00.359465    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"]
Jul 30 18:31:00.361309 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:31:00.361266    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe38195e_f438_40bc_8d35_7be16014a301.slice/crio-c7bce2b0bfc369d2795326b03126fb4c2f22eee5be472e9f25ad11a183eed034 WatchSource:0}: Error finding container c7bce2b0bfc369d2795326b03126fb4c2f22eee5be472e9f25ad11a183eed034: Status 404 returned error can't find the container with id c7bce2b0bfc369d2795326b03126fb4c2f22eee5be472e9f25ad11a183eed034
Jul 30 18:31:01.175369 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:01.175328    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x" event={"ID":"fe38195e-f438-40bc-8d35-7be16014a301","Type":"ContainerStarted","Data":"6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4"}
Jul 30 18:31:01.175369 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:01.175375    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x" event={"ID":"fe38195e-f438-40bc-8d35-7be16014a301","Type":"ContainerStarted","Data":"c7bce2b0bfc369d2795326b03126fb4c2f22eee5be472e9f25ad11a183eed034"}
Jul 30 18:31:01.194838 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:01.194777    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x" podStartSLOduration=2.19475541 podStartE2EDuration="2.19475541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:31:01.192865142 +0000 UTC m=+3842.918549423" watchObservedRunningTime="2026-07-30 18:31:01.19475541 +0000 UTC m=+3842.920439690"
Jul 30 18:31:04.017225 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:04.017187    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:31:10.231760 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:10.231725    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:10.231760 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:10.231770    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:10.244374 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:10.244344    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:11.235208 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:11.235167    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:31:37.415120 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:37.415032    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:31:48.233410 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.233379    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"]
Jul 30 18:31:48.235811 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.235792    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.238501 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.238483    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-46b4e2-openshift-default-dockercfg-tvj5x\""
Jul 30 18:31:48.252041 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.252011    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"]
Jul 30 18:31:48.335104 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335072    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-podinfo\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335118    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-credential-socket\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335143    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-token\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335159    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbgx\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-kube-api-access-zsbgx\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335296 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335269    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-certs\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335506 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335331    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-data\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335506 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335363    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-envoy\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335506 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335389    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/314b2a8c-2158-48ba-a585-55432f63b7bf-istiod-ca-cert\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.335506 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.335475    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-socket\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436560 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436529    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-data\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436560 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436561    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-envoy\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436581    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/314b2a8c-2158-48ba-a585-55432f63b7bf-istiod-ca-cert\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436638    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-socket\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436658    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-podinfo\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436686    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-credential-socket\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436720    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-token\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436748    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbgx\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-kube-api-access-zsbgx\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.436800 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.436799    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-certs\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.437203 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.437050    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-data\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.437203 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.437092    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-socket\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.437203 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.437137    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-credential-socket\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.437391 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.437370    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-certs\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.437578 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.437562    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/314b2a8c-2158-48ba-a585-55432f63b7bf-istiod-ca-cert\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.439097 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.439077    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-envoy\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.439200 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.439166    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-podinfo\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.445163 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.445142    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-token\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.445298 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.445150    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbgx\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-kube-api-access-zsbgx\") pod \"e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") " pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.546422 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.546338    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:48.682856 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.682823    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"]
Jul 30 18:31:48.688611 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.688578    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:31:48.688714 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.688643    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:31:48.688714 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:48.688675    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:31:49.414254 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:49.414215    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" event={"ID":"314b2a8c-2158-48ba-a585-55432f63b7bf","Type":"ContainerStarted","Data":"a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"}
Jul 30 18:31:49.414666 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:49.414284    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" event={"ID":"314b2a8c-2158-48ba-a585-55432f63b7bf","Type":"ContainerStarted","Data":"f9c788e4f59ab1508ce6de0f4db172cabe50bdbc200713cd42d53c39cd606a63"}
Jul 30 18:31:49.434869 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:49.434816    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" podStartSLOduration=1.434801501 podStartE2EDuration="1.434801501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:31:49.434009329 +0000 UTC m=+3891.159693610" watchObservedRunningTime="2026-07-30 18:31:49.434801501 +0000 UTC m=+3891.160485781"
Jul 30 18:31:49.552958 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:49.551205    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:49.557466 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:49.557437    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:50.420324 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:50.420290    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:50.421276 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:50.421252    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:31:58.999444 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:58.999413    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:31:59.011584 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:31:59.011559    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:32:06.320723 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:06.320685    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:32:15.545934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:15.545860    2538 generic.go:356] "Generic (PLEG): container finished" podID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerID="a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c" exitCode=0
Jul 30 18:32:15.545934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:15.545901    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" event={"ID":"314b2a8c-2158-48ba-a585-55432f63b7bf","Type":"ContainerDied","Data":"a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"}
Jul 30 18:32:15.546429 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:15.546299    2538 scope.go:117] "RemoveContainer" containerID="a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"
Jul 30 18:32:15.547375 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:15.547343    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:32:15.547437 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:15.547406    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:32:15.547473 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:15.547437    2538 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 30 18:32:16.558482 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:16.558435    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" event={"ID":"314b2a8c-2158-48ba-a585-55432f63b7bf","Type":"ContainerStarted","Data":"1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7"}
Jul 30 18:32:17.254839 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.254786    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"]
Jul 30 18:32:17.258060 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.258030    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:17.261273 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.261248    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:32:17.261627 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.261265    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:32:17.267844 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.267680    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"]
Jul 30 18:32:17.325100 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.325060    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5f1bc6-6d69-408b-b631-a3623523fa0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl\" (UID: \"6e5f1bc6-6d69-408b-b631-a3623523fa0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:17.426105 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.426064    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5f1bc6-6d69-408b-b631-a3623523fa0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl\" (UID: \"6e5f1bc6-6d69-408b-b631-a3623523fa0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:17.426735 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.426715    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5f1bc6-6d69-408b-b631-a3623523fa0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl\" (UID: \"6e5f1bc6-6d69-408b-b631-a3623523fa0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:17.547582 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.547474    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:32:17.549382 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.549342    2538 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 30 18:32:17.549545 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.549407    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 30 18:32:17.572015 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.571984    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:17.735684 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:17.735655    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"]
Jul 30 18:32:18.547639 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:18.547176    2538 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 30 18:32:18.547639 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:18.547241    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 30 18:32:18.572535 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:18.572492    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl" event={"ID":"6e5f1bc6-6d69-408b-b631-a3623523fa0d","Type":"ContainerStarted","Data":"422c8f939027f58e215a692778f6a3f8edbb673e55046278a8c1643cd593ac89"}
Jul 30 18:32:18.572964 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:18.572559    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl" event={"ID":"6e5f1bc6-6d69-408b-b631-a3623523fa0d","Type":"ContainerStarted","Data":"c10c8865cf6ed032818f70f855c605e088aaadb6b9af6f55ef1432f0824ef66d"}
Jul 30 18:32:18.589826 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:18.589768    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl" podStartSLOduration=1.589752291 podStartE2EDuration="1.589752291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 18:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:32:18.587533174 +0000 UTC m=+3920.313217456" watchObservedRunningTime="2026-07-30 18:32:18.589752291 +0000 UTC m=+3920.315436572"
Jul 30 18:32:19.550318 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:19.550275    2538 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 30 18:32:19.550529 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:19.550341    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 30 18:32:19.579001 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:19.578966    2538 generic.go:356] "Generic (PLEG): container finished" podID="6e5f1bc6-6d69-408b-b631-a3623523fa0d" containerID="422c8f939027f58e215a692778f6a3f8edbb673e55046278a8c1643cd593ac89" exitCode=0
Jul 30 18:32:19.579432 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:19.579013    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl" event={"ID":"6e5f1bc6-6d69-408b-b631-a3623523fa0d","Type":"ContainerDied","Data":"422c8f939027f58e215a692778f6a3f8edbb673e55046278a8c1643cd593ac89"}
Jul 30 18:32:20.420693 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.420660    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:32:20.547299 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.547256    2538 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 30 18:32:20.547474 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.547332    2538 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 30 18:32:20.714380 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.714356    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:20.764677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.764648    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5f1bc6-6d69-408b-b631-a3623523fa0d-maas-api-service-ca\") pod \"6e5f1bc6-6d69-408b-b631-a3623523fa0d\" (UID: \"6e5f1bc6-6d69-408b-b631-a3623523fa0d\") "
Jul 30 18:32:20.765008 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.764987    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5f1bc6-6d69-408b-b631-a3623523fa0d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6e5f1bc6-6d69-408b-b631-a3623523fa0d" (UID: "6e5f1bc6-6d69-408b-b631-a3623523fa0d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:32:20.865408 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:20.865374    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5f1bc6-6d69-408b-b631-a3623523fa0d-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:21.550976 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:21.550944    2538 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:32:21.552101 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:21.552075    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:32:21.595070 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:21.595036    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"
Jul 30 18:32:21.595279 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:21.595044    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl" event={"ID":"6e5f1bc6-6d69-408b-b631-a3623523fa0d","Type":"ContainerDied","Data":"c10c8865cf6ed032818f70f855c605e088aaadb6b9af6f55ef1432f0824ef66d"}
Jul 30 18:32:21.595279 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:21.595165    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c10c8865cf6ed032818f70f855c605e088aaadb6b9af6f55ef1432f0824ef66d"
Jul 30 18:32:23.507928 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:23.507864    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"]
Jul 30 18:32:23.510499 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:23.510473    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-46b4e2-m87xl"]
Jul 30 18:32:24.826558 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:24.826523    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5f1bc6-6d69-408b-b631-a3623523fa0d" path="/var/lib/kubelet/pods/6e5f1bc6-6d69-408b-b631-a3623523fa0d/volumes"
Jul 30 18:32:28.421489 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:28.421455    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:32:30.243479 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:30.243448    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"]
Jul 30 18:32:30.243991 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:30.243702    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy" containerID="cri-o://1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7" gracePeriod=30
Jul 30 18:32:34.266864 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.266827    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"]
Jul 30 18:32:34.267256 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.267223    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5f1bc6-6d69-408b-b631-a3623523fa0d" containerName="revoke-keys"
Jul 30 18:32:34.267256 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.267235    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5f1bc6-6d69-408b-b631-a3623523fa0d" containerName="revoke-keys"
Jul 30 18:32:34.267346 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.267300    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5f1bc6-6d69-408b-b631-a3623523fa0d" containerName="revoke-keys"
Jul 30 18:32:34.269622 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.269605    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:34.272444 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.272428    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:32:34.272547 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.272425    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:32:34.278154 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.278058    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"]
Jul 30 18:32:34.395837 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.395799    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ba1a98-40dd-43c4-9426-8e4390bef9e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq\" (UID: \"c9ba1a98-40dd-43c4-9426-8e4390bef9e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:34.496407 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.496367    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ba1a98-40dd-43c4-9426-8e4390bef9e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq\" (UID: \"c9ba1a98-40dd-43c4-9426-8e4390bef9e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:34.497076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.497055    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ba1a98-40dd-43c4-9426-8e4390bef9e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq\" (UID: \"c9ba1a98-40dd-43c4-9426-8e4390bef9e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:34.581119 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.581000    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:34.729302 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:34.729273    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"]
Jul 30 18:32:34.730996 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:32:34.730941    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ba1a98_40dd_43c4_9426_8e4390bef9e2.slice/crio-33520726100ea9f72519df0fb5234e39c8cfe67b5e144808861aeef2147997a0 WatchSource:0}: Error finding container 33520726100ea9f72519df0fb5234e39c8cfe67b5e144808861aeef2147997a0: Status 404 returned error can't find the container with id 33520726100ea9f72519df0fb5234e39c8cfe67b5e144808861aeef2147997a0
Jul 30 18:32:35.505551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.505525    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:32:35.606904 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.606855    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-envoy\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607106 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.606947    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-data\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607106 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607012    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-credential-socket\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607106 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607063    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsbgx\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-kube-api-access-zsbgx\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607106 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607085    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-certs\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607388 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607360    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:32:35.607495 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607472    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:32:35.607541 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607498    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/314b2a8c-2158-48ba-a585-55432f63b7bf-istiod-ca-cert\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607541 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607525    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-socket\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607667 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607650    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-token\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607764 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607692    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-podinfo\") pod \"314b2a8c-2158-48ba-a585-55432f63b7bf\" (UID: \"314b2a8c-2158-48ba-a585-55432f63b7bf\") "
Jul 30 18:32:35.607853 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607773    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607950    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/314b2a8c-2158-48ba-a585-55432f63b7bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.607961    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.608192    2538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/314b2a8c-2158-48ba-a585-55432f63b7bf-istiod-ca-cert\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.608212    2538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-socket\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.608226    2538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-data\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.608239    2538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-credential-socket\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.608251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.608251    2538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-workload-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.610057 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.610012    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 18:32:35.610165 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.610057    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:32:35.610165 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.610082    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:32:35.610165 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.610115    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-kube-api-access-zsbgx" (OuterVolumeSpecName: "kube-api-access-zsbgx") pod "314b2a8c-2158-48ba-a585-55432f63b7bf" (UID: "314b2a8c-2158-48ba-a585-55432f63b7bf"). InnerVolumeSpecName "kube-api-access-zsbgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:32:35.670009 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.669967    2538 generic.go:356] "Generic (PLEG): container finished" podID="c9ba1a98-40dd-43c4-9426-8e4390bef9e2" containerID="c0efae156876973100ccdb2acf6d4d19be21b17887c62ad3a4c2860fa5c6de97" exitCode=0
Jul 30 18:32:35.670164 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.670060    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq" event={"ID":"c9ba1a98-40dd-43c4-9426-8e4390bef9e2","Type":"ContainerDied","Data":"c0efae156876973100ccdb2acf6d4d19be21b17887c62ad3a4c2860fa5c6de97"}
Jul 30 18:32:35.670164 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.670114    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq" event={"ID":"c9ba1a98-40dd-43c4-9426-8e4390bef9e2","Type":"ContainerStarted","Data":"33520726100ea9f72519df0fb5234e39c8cfe67b5e144808861aeef2147997a0"}
Jul 30 18:32:35.671603 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.671579    2538 generic.go:356] "Generic (PLEG): container finished" podID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerID="1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7" exitCode=0
Jul 30 18:32:35.671737 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.671612    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" event={"ID":"314b2a8c-2158-48ba-a585-55432f63b7bf","Type":"ContainerDied","Data":"1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7"}
Jul 30 18:32:35.671737 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.671628    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"
Jul 30 18:32:35.671737 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.671644    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc" event={"ID":"314b2a8c-2158-48ba-a585-55432f63b7bf","Type":"ContainerDied","Data":"f9c788e4f59ab1508ce6de0f4db172cabe50bdbc200713cd42d53c39cd606a63"}
Jul 30 18:32:35.671737 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.671667    2538 scope.go:117] "RemoveContainer" containerID="1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7"
Jul 30 18:32:35.680793 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.680775    2538 scope.go:117] "RemoveContainer" containerID="a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"
Jul 30 18:32:35.689020 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.688997    2538 scope.go:117] "RemoveContainer" containerID="1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7"
Jul 30 18:32:35.689302 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:32:35.689282    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7\": container with ID starting with 1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7 not found: ID does not exist" containerID="1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7"
Jul 30 18:32:35.689349 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.689310    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7"} err="failed to get container status \"1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7\": rpc error: code = NotFound desc = could not find container \"1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7\": container with ID starting with 1b2aa0ec64d69999e0c265a4c77578faf4b414b5ac19660f379ed129742895a7 not found: ID does not exist"
Jul 30 18:32:35.689349 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.689329    2538 scope.go:117] "RemoveContainer" containerID="a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"
Jul 30 18:32:35.689563 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:32:35.689546    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c\": container with ID starting with a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c not found: ID does not exist" containerID="a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"
Jul 30 18:32:35.689615 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.689567    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c"} err="failed to get container status \"a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c\": rpc error: code = NotFound desc = could not find container \"a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c\": container with ID starting with a87a913ca9df5e959079491d1fdfe8ccc2f15bff9d2f0da07c186668cb11bd2c not found: ID does not exist"
Jul 30 18:32:35.702161 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.702135    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"]
Jul 30 18:32:35.703870 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.703850    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-46b4e2-openshift-default-748fcfb5bb-mw2nc"]
Jul 30 18:32:35.708999 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.708981    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsbgx\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-kube-api-access-zsbgx\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.709076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.709002    2538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-token\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.709076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.709013    2538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-podinfo\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:35.709076 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:35.709021    2538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/314b2a8c-2158-48ba-a585-55432f63b7bf-istio-envoy\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:36.807921 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:36.807895    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:36.828509 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:36.828479    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" path="/var/lib/kubelet/pods/314b2a8c-2158-48ba-a585-55432f63b7bf/volumes"
Jul 30 18:32:36.922176 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:36.922119    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ba1a98-40dd-43c4-9426-8e4390bef9e2-maas-api-service-ca\") pod \"c9ba1a98-40dd-43c4-9426-8e4390bef9e2\" (UID: \"c9ba1a98-40dd-43c4-9426-8e4390bef9e2\") "
Jul 30 18:32:36.922504 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:36.922479    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9ba1a98-40dd-43c4-9426-8e4390bef9e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c9ba1a98-40dd-43c4-9426-8e4390bef9e2" (UID: "c9ba1a98-40dd-43c4-9426-8e4390bef9e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:32:36.922620 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:36.922603    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9ba1a98-40dd-43c4-9426-8e4390bef9e2-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:32:37.682883 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:37.682830    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq" event={"ID":"c9ba1a98-40dd-43c4-9426-8e4390bef9e2","Type":"ContainerDied","Data":"33520726100ea9f72519df0fb5234e39c8cfe67b5e144808861aeef2147997a0"}
Jul 30 18:32:37.682883 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:37.682853    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"
Jul 30 18:32:37.683095 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:37.682906    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33520726100ea9f72519df0fb5234e39c8cfe67b5e144808861aeef2147997a0"
Jul 30 18:32:48.611113 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:48.611081    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:32:49.794352 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:49.794314    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"]
Jul 30 18:32:49.799062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:49.799033    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-fadb12-29757270-dfjbq"]
Jul 30 18:32:49.972091 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:49.972048    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"]
Jul 30 18:32:49.974432 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:49.974406    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-fadb12-7sbtq"]
Jul 30 18:32:50.826849 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:50.826760    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27688888-73ac-4194-b004-a4dd339aa328" path="/var/lib/kubelet/pods/27688888-73ac-4194-b004-a4dd339aa328/volumes"
Jul 30 18:32:50.827256 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:50.827124    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ba1a98-40dd-43c4-9426-8e4390bef9e2" path="/var/lib/kubelet/pods/c9ba1a98-40dd-43c4-9426-8e4390bef9e2/volumes"
Jul 30 18:32:55.350305 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:32:55.350269    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"]
Jul 30 18:33:01.723721 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:01.719422    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:33:10.369614 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.369571    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x" podUID="fe38195e-f438-40bc-8d35-7be16014a301" containerName="main" containerID="cri-o://6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4" gracePeriod=45
Jul 30 18:33:10.617137 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.617115    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:33:10.724674 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.724643    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-home\") pod \"fe38195e-f438-40bc-8d35-7be16014a301\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") "
Jul 30 18:33:10.724916 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.724688    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-model-cache\") pod \"fe38195e-f438-40bc-8d35-7be16014a301\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") "
Jul 30 18:33:10.724916 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.724708    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-tmp-dir\") pod \"fe38195e-f438-40bc-8d35-7be16014a301\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") "
Jul 30 18:33:10.724916 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.724755    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe38195e-f438-40bc-8d35-7be16014a301-tls-certs\") pod \"fe38195e-f438-40bc-8d35-7be16014a301\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") "
Jul 30 18:33:10.724916 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.724772    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-dshm\") pod \"fe38195e-f438-40bc-8d35-7be16014a301\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") "
Jul 30 18:33:10.724916 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.724798    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b57cw\" (UniqueName: \"kubernetes.io/projected/fe38195e-f438-40bc-8d35-7be16014a301-kube-api-access-b57cw\") pod \"fe38195e-f438-40bc-8d35-7be16014a301\" (UID: \"fe38195e-f438-40bc-8d35-7be16014a301\") "
Jul 30 18:33:10.725220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.725056    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe38195e-f438-40bc-8d35-7be16014a301" (UID: "fe38195e-f438-40bc-8d35-7be16014a301"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:33:10.725220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.725068    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-home" (OuterVolumeSpecName: "home") pod "fe38195e-f438-40bc-8d35-7be16014a301" (UID: "fe38195e-f438-40bc-8d35-7be16014a301"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:33:10.725220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.725085    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe38195e-f438-40bc-8d35-7be16014a301" (UID: "fe38195e-f438-40bc-8d35-7be16014a301"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:33:10.727137 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.727109    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe38195e-f438-40bc-8d35-7be16014a301-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe38195e-f438-40bc-8d35-7be16014a301" (UID: "fe38195e-f438-40bc-8d35-7be16014a301"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 18:33:10.727137 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.727125    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe38195e-f438-40bc-8d35-7be16014a301-kube-api-access-b57cw" (OuterVolumeSpecName: "kube-api-access-b57cw") pod "fe38195e-f438-40bc-8d35-7be16014a301" (UID: "fe38195e-f438-40bc-8d35-7be16014a301"). InnerVolumeSpecName "kube-api-access-b57cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:33:10.727257 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.727173    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-dshm" (OuterVolumeSpecName: "dshm") pod "fe38195e-f438-40bc-8d35-7be16014a301" (UID: "fe38195e-f438-40bc-8d35-7be16014a301"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:33:10.825423 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.825389    2538 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe38195e-f438-40bc-8d35-7be16014a301-tls-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:10.825423 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.825417    2538 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-dshm\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:10.825423 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.825429    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b57cw\" (UniqueName: \"kubernetes.io/projected/fe38195e-f438-40bc-8d35-7be16014a301-kube-api-access-b57cw\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:10.825659 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.825442    2538 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-home\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:10.825659 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.825453    2538 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-model-cache\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:10.825659 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.825465    2538 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe38195e-f438-40bc-8d35-7be16014a301-tmp-dir\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:10.852487 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.852457    2538 generic.go:356] "Generic (PLEG): container finished" podID="fe38195e-f438-40bc-8d35-7be16014a301" containerID="6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4" exitCode=0
Jul 30 18:33:10.852629 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.852496    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"
Jul 30 18:33:10.852629 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.852533    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x" event={"ID":"fe38195e-f438-40bc-8d35-7be16014a301","Type":"ContainerDied","Data":"6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4"}
Jul 30 18:33:10.852629 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.852573    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x" event={"ID":"fe38195e-f438-40bc-8d35-7be16014a301","Type":"ContainerDied","Data":"c7bce2b0bfc369d2795326b03126fb4c2f22eee5be472e9f25ad11a183eed034"}
Jul 30 18:33:10.852629 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.852590    2538 scope.go:117] "RemoveContainer" containerID="6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4"
Jul 30 18:33:10.861541 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.861528    2538 scope.go:117] "RemoveContainer" containerID="6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4"
Jul 30 18:33:10.861784 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:33:10.861765    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4\": container with ID starting with 6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4 not found: ID does not exist" containerID="6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4"
Jul 30 18:33:10.861855 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.861792    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4"} err="failed to get container status \"6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4\": rpc error: code = NotFound desc = could not find container \"6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4\": container with ID starting with 6c90c954cceb1d4e136c4398d79eeb78fbe0133856800a6a148e8561967000e4 not found: ID does not exist"
Jul 30 18:33:10.872314 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.872293    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"]
Jul 30 18:33:10.877817 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:10.877798    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-fadb12/ipp-route-fadb12-kserve-5c99bc6f87-gnw4x"]
Jul 30 18:33:12.825888 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:12.825853    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe38195e-f438-40bc-8d35-7be16014a301" path="/var/lib/kubelet/pods/fe38195e-f438-40bc-8d35-7be16014a301/volumes"
Jul 30 18:33:39.213103 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213068    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"]
Jul 30 18:33:39.213677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213593    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe38195e-f438-40bc-8d35-7be16014a301" containerName="main"
Jul 30 18:33:39.213677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213615    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe38195e-f438-40bc-8d35-7be16014a301" containerName="main"
Jul 30 18:33:39.213677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213629    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy"
Jul 30 18:33:39.213677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213638    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy"
Jul 30 18:33:39.213677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213663    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ba1a98-40dd-43c4-9426-8e4390bef9e2" containerName="revoke-keys"
Jul 30 18:33:39.213677 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213673    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ba1a98-40dd-43c4-9426-8e4390bef9e2" containerName="revoke-keys"
Jul 30 18:33:39.214017 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213760    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe38195e-f438-40bc-8d35-7be16014a301" containerName="main"
Jul 30 18:33:39.214017 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213772    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ba1a98-40dd-43c4-9426-8e4390bef9e2" containerName="revoke-keys"
Jul 30 18:33:39.214017 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213783    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy"
Jul 30 18:33:39.214017 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.213794    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy"
Jul 30 18:33:39.215934 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.215913    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:39.218548 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.218522    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:33:39.218691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.218547    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:33:39.223702 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.223675    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"]
Jul 30 18:33:39.277315 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.277216    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168aad63-e703-4344-bcd5-f331defe9470-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k\" (UID: \"168aad63-e703-4344-bcd5-f331defe9470\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:39.378030 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.377983    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168aad63-e703-4344-bcd5-f331defe9470-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k\" (UID: \"168aad63-e703-4344-bcd5-f331defe9470\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:39.378639 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.378616    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168aad63-e703-4344-bcd5-f331defe9470-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k\" (UID: \"168aad63-e703-4344-bcd5-f331defe9470\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:39.527072 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.527037    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:39.899009 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:39.898985    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"]
Jul 30 18:33:39.901045 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:33:39.901013    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168aad63_e703_4344_bcd5_f331defe9470.slice/crio-e3ddf12e1d5bf7518607593f19afc3abb8ebd6d691ce9a053d7d7441f5beff2d WatchSource:0}: Error finding container e3ddf12e1d5bf7518607593f19afc3abb8ebd6d691ce9a053d7d7441f5beff2d: Status 404 returned error can't find the container with id e3ddf12e1d5bf7518607593f19afc3abb8ebd6d691ce9a053d7d7441f5beff2d
Jul 30 18:33:40.001897 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:40.001843    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k" event={"ID":"168aad63-e703-4344-bcd5-f331defe9470","Type":"ContainerStarted","Data":"e3ddf12e1d5bf7518607593f19afc3abb8ebd6d691ce9a053d7d7441f5beff2d"}
Jul 30 18:33:41.008016 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:41.007974    2538 generic.go:356] "Generic (PLEG): container finished" podID="168aad63-e703-4344-bcd5-f331defe9470" containerID="91dab4cd581b45ead578e47ed3b9c5ff185ee86078a81ed03bbb0d6686733bfb" exitCode=0
Jul 30 18:33:41.008394 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:41.008063    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k" event={"ID":"168aad63-e703-4344-bcd5-f331defe9470","Type":"ContainerDied","Data":"91dab4cd581b45ead578e47ed3b9c5ff185ee86078a81ed03bbb0d6686733bfb"}
Jul 30 18:33:42.142150 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:42.142118    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:42.202679 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:42.202642    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168aad63-e703-4344-bcd5-f331defe9470-maas-api-service-ca\") pod \"168aad63-e703-4344-bcd5-f331defe9470\" (UID: \"168aad63-e703-4344-bcd5-f331defe9470\") "
Jul 30 18:33:42.203039 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:42.203017    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/168aad63-e703-4344-bcd5-f331defe9470-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "168aad63-e703-4344-bcd5-f331defe9470" (UID: "168aad63-e703-4344-bcd5-f331defe9470"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:33:42.303758 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:42.303677    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/168aad63-e703-4344-bcd5-f331defe9470-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:43.018892 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:43.018835    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k" event={"ID":"168aad63-e703-4344-bcd5-f331defe9470","Type":"ContainerDied","Data":"e3ddf12e1d5bf7518607593f19afc3abb8ebd6d691ce9a053d7d7441f5beff2d"}
Jul 30 18:33:43.018892 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:43.018870    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"
Jul 30 18:33:43.019103 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:43.018919    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3ddf12e1d5bf7518607593f19afc3abb8ebd6d691ce9a053d7d7441f5beff2d"
Jul 30 18:33:49.823712 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:49.823679    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"]
Jul 30 18:33:49.826026 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:49.826003    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-c8d7de-z5f9k"]
Jul 30 18:33:50.826034 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:50.825999    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168aad63-e703-4344-bcd5-f331defe9470" path="/var/lib/kubelet/pods/168aad63-e703-4344-bcd5-f331defe9470/volumes"
Jul 30 18:33:53.113310 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:53.113276    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:33:56.341029 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.340986    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"]
Jul 30 18:33:56.341511 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.341210    2538 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy" containerID="cri-o://c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0" gracePeriod=30
Jul 30 18:33:56.745281 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.745246    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"]
Jul 30 18:33:56.745691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.745659    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168aad63-e703-4344-bcd5-f331defe9470" containerName="revoke-keys"
Jul 30 18:33:56.745691 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.745680    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="168aad63-e703-4344-bcd5-f331defe9470" containerName="revoke-keys"
Jul 30 18:33:56.745841 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.745709    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy"
Jul 30 18:33:56.745841 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.745718    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="314b2a8c-2158-48ba-a585-55432f63b7bf" containerName="istio-proxy"
Jul 30 18:33:56.745841 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.745809    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="168aad63-e703-4344-bcd5-f331defe9470" containerName="revoke-keys"
Jul 30 18:33:56.748335 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.748312    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:33:56.750897 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.750858    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:33:56.751029 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.751012    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:33:56.756465 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.756442    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"]
Jul 30 18:33:56.833562 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.833533    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb27d0d-36f2-40c1-972b-f6368f14807c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w\" (UID: \"dbb27d0d-36f2-40c1-972b-f6368f14807c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:33:56.934496 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.934460    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb27d0d-36f2-40c1-972b-f6368f14807c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w\" (UID: \"dbb27d0d-36f2-40c1-972b-f6368f14807c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:33:56.935127 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:56.935107    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb27d0d-36f2-40c1-972b-f6368f14807c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w\" (UID: \"dbb27d0d-36f2-40c1-972b-f6368f14807c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:33:57.059314 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:57.059236    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:33:57.190012 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:57.189985    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"]
Jul 30 18:33:57.191734 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:33:57.191702    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb27d0d_36f2_40c1_972b_f6368f14807c.slice/crio-5b086e92bf8cc3aa19fedd0f8a0fe8b3c065b4f02461cccf1d3865fe91833298 WatchSource:0}: Error finding container 5b086e92bf8cc3aa19fedd0f8a0fe8b3c065b4f02461cccf1d3865fe91833298: Status 404 returned error can't find the container with id 5b086e92bf8cc3aa19fedd0f8a0fe8b3c065b4f02461cccf1d3865fe91833298
Jul 30 18:33:58.093121 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:58.093026    2538 generic.go:356] "Generic (PLEG): container finished" podID="dbb27d0d-36f2-40c1-972b-f6368f14807c" containerID="531a0f7aad340bec472be7d44a0cd0b2cf56ee5b2c60701fe7972362fdc0aba0" exitCode=0
Jul 30 18:33:58.093121 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:58.093066    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w" event={"ID":"dbb27d0d-36f2-40c1-972b-f6368f14807c","Type":"ContainerDied","Data":"531a0f7aad340bec472be7d44a0cd0b2cf56ee5b2c60701fe7972362fdc0aba0"}
Jul 30 18:33:58.093520 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:58.093130    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w" event={"ID":"dbb27d0d-36f2-40c1-972b-f6368f14807c","Type":"ContainerStarted","Data":"5b086e92bf8cc3aa19fedd0f8a0fe8b3c065b4f02461cccf1d3865fe91833298"}
Jul 30 18:33:59.223569 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:59.223541    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:33:59.359087 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:59.359004    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb27d0d-36f2-40c1-972b-f6368f14807c-maas-api-service-ca\") pod \"dbb27d0d-36f2-40c1-972b-f6368f14807c\" (UID: \"dbb27d0d-36f2-40c1-972b-f6368f14807c\") "
Jul 30 18:33:59.359398 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:59.359374    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb27d0d-36f2-40c1-972b-f6368f14807c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dbb27d0d-36f2-40c1-972b-f6368f14807c" (UID: "dbb27d0d-36f2-40c1-972b-f6368f14807c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:33:59.460543 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:59.460500    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbb27d0d-36f2-40c1-972b-f6368f14807c-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:33:59.853085 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:59.853050    2538 patch_prober.go:28] interesting pod/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 18:33:59.853255 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:33:59.853104    2538 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 18:34:00.105393 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:00.105308    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"
Jul 30 18:34:00.105550 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:00.105308    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w" event={"ID":"dbb27d0d-36f2-40c1-972b-f6368f14807c","Type":"ContainerDied","Data":"5b086e92bf8cc3aa19fedd0f8a0fe8b3c065b4f02461cccf1d3865fe91833298"}
Jul 30 18:34:00.105550 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:00.105437    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b086e92bf8cc3aa19fedd0f8a0fe8b3c065b4f02461cccf1d3865fe91833298"
Jul 30 18:34:01.590341 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.590310    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:34:01.680108 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680031    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-certs\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680108 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680059    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-credential-socket\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680109    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istiod-ca-cert\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680163    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-token\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680189    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzqrt\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-kube-api-access-qzqrt\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680223    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-podinfo\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680285 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680261    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-socket\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680313    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-envoy\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680349    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-data\") pod \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\" (UID: \"af9f3327-fcc0-46a2-8662-ff4e33b0d093\") "
Jul 30 18:34:01.680551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680378    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:34:01.680551 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680399    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:34:01.680779 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680632    2538 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-certs\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.680779 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680653    2538 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-credential-socket\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.680779 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680623    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:34:01.680779 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.680642    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:34:01.681274 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.681245    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-data" (OuterVolumeSpecName: "istio-data") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:34:01.682463 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.682438    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 18:34:01.682463 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.682459    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-kube-api-access-qzqrt" (OuterVolumeSpecName: "kube-api-access-qzqrt") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "kube-api-access-qzqrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:34:01.682619 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.682496    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 18:34:01.682619 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.682502    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-token" (OuterVolumeSpecName: "istio-token") pod "af9f3327-fcc0-46a2-8662-ff4e33b0d093" (UID: "af9f3327-fcc0-46a2-8662-ff4e33b0d093"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 18:34:01.781085 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781055    2538 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-podinfo\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.781085 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781080    2538 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-workload-socket\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.781085 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781092    2538 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-envoy\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.781294 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781100    2538 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-data\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.781294 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781109    2538 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istiod-ca-cert\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.781294 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781116    2538 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-istio-token\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:01.781294 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:01.781124    2538 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzqrt\" (UniqueName: \"kubernetes.io/projected/af9f3327-fcc0-46a2-8662-ff4e33b0d093-kube-api-access-qzqrt\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:02.116726 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.116689    2538 generic.go:356] "Generic (PLEG): container finished" podID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerID="c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0" exitCode=0
Jul 30 18:34:02.116936 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.116735    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" event={"ID":"af9f3327-fcc0-46a2-8662-ff4e33b0d093","Type":"ContainerDied","Data":"c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0"}
Jul 30 18:34:02.116936 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.116745    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"
Jul 30 18:34:02.116936 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.116789    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t" event={"ID":"af9f3327-fcc0-46a2-8662-ff4e33b0d093","Type":"ContainerDied","Data":"be25b0467117af15af2b856411a9a50e70d0f7bf5d64f22cdd400c0cdf429bf9"}
Jul 30 18:34:02.116936 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.116822    2538 scope.go:117] "RemoveContainer" containerID="c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0"
Jul 30 18:34:02.126631 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.126613    2538 scope.go:117] "RemoveContainer" containerID="31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"
Jul 30 18:34:02.134485 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.134466    2538 scope.go:117] "RemoveContainer" containerID="c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0"
Jul 30 18:34:02.134735 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:34:02.134717    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0\": container with ID starting with c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0 not found: ID does not exist" containerID="c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0"
Jul 30 18:34:02.134775 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.134745    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0"} err="failed to get container status \"c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0\": rpc error: code = NotFound desc = could not find container \"c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0\": container with ID starting with c07ecb7a48a2b6059dd32ffc5f37827e3c1a4a913e7960aa2328a3b174be28d0 not found: ID does not exist"
Jul 30 18:34:02.134775 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.134762    2538 scope.go:117] "RemoveContainer" containerID="31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"
Jul 30 18:34:02.135040 ip-10-0-137-250 kubenswrapper[2538]: E0730 18:34:02.135025    2538 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283\": container with ID starting with 31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283 not found: ID does not exist" containerID="31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"
Jul 30 18:34:02.135112 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.135047    2538 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283"} err="failed to get container status \"31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283\": rpc error: code = NotFound desc = could not find container \"31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283\": container with ID starting with 31d1e5a69c6c7fbf07c1025b98589e38461f73f82f69d591220bc882f7f1e283 not found: ID does not exist"
Jul 30 18:34:02.139127 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.139105    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"]
Jul 30 18:34:02.143050 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.143030    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c8d7de-openshift-default-5ffb89f8fd-mkm7t"]
Jul 30 18:34:02.826483 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:02.826448    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" path="/var/lib/kubelet/pods/af9f3327-fcc0-46a2-8662-ff4e33b0d093/volumes"
Jul 30 18:34:07.182777 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:07.182746    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"]
Jul 30 18:34:07.185771 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:07.185749    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8f586d-29757270-6mdnm"]
Jul 30 18:34:07.353087 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:07.353051    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"]
Jul 30 18:34:07.357949 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:07.357920    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8f586d-bs57w"]
Jul 30 18:34:08.826545 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:08.826513    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f4fbe3-e218-43b6-85f2-2283bd9757da" path="/var/lib/kubelet/pods/88f4fbe3-e218-43b6-85f2-2283bd9757da/volumes"
Jul 30 18:34:08.826949 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:08.826807    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb27d0d-36f2-40c1-972b-f6368f14807c" path="/var/lib/kubelet/pods/dbb27d0d-36f2-40c1-972b-f6368f14807c/volumes"
Jul 30 18:34:10.320211 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:10.320159    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:34:14.511989 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.511954    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"]
Jul 30 18:34:14.512376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512319    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy"
Jul 30 18:34:14.512376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512331    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy"
Jul 30 18:34:14.512376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512339    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb27d0d-36f2-40c1-972b-f6368f14807c" containerName="revoke-keys"
Jul 30 18:34:14.512376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512345    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb27d0d-36f2-40c1-972b-f6368f14807c" containerName="revoke-keys"
Jul 30 18:34:14.512376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512362    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy"
Jul 30 18:34:14.512376 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512368    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy"
Jul 30 18:34:14.512574 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512425    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb27d0d-36f2-40c1-972b-f6368f14807c" containerName="revoke-keys"
Jul 30 18:34:14.512574 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512437    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy"
Jul 30 18:34:14.512574 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.512444    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="af9f3327-fcc0-46a2-8662-ff4e33b0d093" containerName="istio-proxy"
Jul 30 18:34:14.515510 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.515493    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:14.518369 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.518348    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 18:34:14.518440 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.518348    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qw74k\""
Jul 30 18:34:14.522797 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.522774    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"]
Jul 30 18:34:14.697779 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.697739    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd60ca2-9434-4ae6-be70-4a75b51ea84c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc\" (UID: \"4cd60ca2-9434-4ae6-be70-4a75b51ea84c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:14.799317 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.799200    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd60ca2-9434-4ae6-be70-4a75b51ea84c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc\" (UID: \"4cd60ca2-9434-4ae6-be70-4a75b51ea84c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:14.799805 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.799783    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd60ca2-9434-4ae6-be70-4a75b51ea84c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc\" (UID: \"4cd60ca2-9434-4ae6-be70-4a75b51ea84c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:14.826149 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.826128    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:14.951367 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:14.951342    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"]
Jul 30 18:34:14.953602 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:34:14.953566    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd60ca2_9434_4ae6_be70_4a75b51ea84c.slice/crio-3bda9bec4d4c017e7c57eff5ef89d33a58d2a4392e660095094cb7aabf0d1609 WatchSource:0}: Error finding container 3bda9bec4d4c017e7c57eff5ef89d33a58d2a4392e660095094cb7aabf0d1609: Status 404 returned error can't find the container with id 3bda9bec4d4c017e7c57eff5ef89d33a58d2a4392e660095094cb7aabf0d1609
Jul 30 18:34:15.186590 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:15.186558    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc" event={"ID":"4cd60ca2-9434-4ae6-be70-4a75b51ea84c","Type":"ContainerStarted","Data":"3bda9bec4d4c017e7c57eff5ef89d33a58d2a4392e660095094cb7aabf0d1609"}
Jul 30 18:34:16.192539 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:16.192499    2538 generic.go:356] "Generic (PLEG): container finished" podID="4cd60ca2-9434-4ae6-be70-4a75b51ea84c" containerID="2b30f8d809ad431c64443bde468a7cdf02ee5bcd0aab5424e8dc3aa11410b56e" exitCode=0
Jul 30 18:34:16.192945 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:16.192582    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc" event={"ID":"4cd60ca2-9434-4ae6-be70-4a75b51ea84c","Type":"ContainerDied","Data":"2b30f8d809ad431c64443bde468a7cdf02ee5bcd0aab5424e8dc3aa11410b56e"}
Jul 30 18:34:17.329469 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:17.329448    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:17.523957 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:17.523927    2538 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd60ca2-9434-4ae6-be70-4a75b51ea84c-maas-api-service-ca\") pod \"4cd60ca2-9434-4ae6-be70-4a75b51ea84c\" (UID: \"4cd60ca2-9434-4ae6-be70-4a75b51ea84c\") "
Jul 30 18:34:17.524323 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:17.524299    2538 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cd60ca2-9434-4ae6-be70-4a75b51ea84c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4cd60ca2-9434-4ae6-be70-4a75b51ea84c" (UID: "4cd60ca2-9434-4ae6-be70-4a75b51ea84c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 18:34:17.625204 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:17.625153    2538 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cd60ca2-9434-4ae6-be70-4a75b51ea84c-maas-api-service-ca\") on node \"ip-10-0-137-250.ec2.internal\" DevicePath \"\""
Jul 30 18:34:18.203448 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:18.203417    2538 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"
Jul 30 18:34:18.203625 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:18.203465    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc" event={"ID":"4cd60ca2-9434-4ae6-be70-4a75b51ea84c","Type":"ContainerDied","Data":"3bda9bec4d4c017e7c57eff5ef89d33a58d2a4392e660095094cb7aabf0d1609"}
Jul 30 18:34:18.203625 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:18.203509    2538 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bda9bec4d4c017e7c57eff5ef89d33a58d2a4392e660095094cb7aabf0d1609"
Jul 30 18:34:19.587930 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:19.587869    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"]
Jul 30 18:34:19.591899 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:19.591864    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fbbaa9-29757270-zbzkb"]
Jul 30 18:34:19.759257 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:19.759227    2538 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"]
Jul 30 18:34:19.763578 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:19.763556    2538 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-fbbaa9-hcfnc"]
Jul 30 18:34:20.826539 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:20.826462    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34af0beb-9f85-4df3-b853-9bd15bdae070" path="/var/lib/kubelet/pods/34af0beb-9f85-4df3-b853-9bd15bdae070/volumes"
Jul 30 18:34:20.826916 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:20.826802    2538 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cd60ca2-9434-4ae6-be70-4a75b51ea84c" path="/var/lib/kubelet/pods/4cd60ca2-9434-4ae6-be70-4a75b51ea84c/volumes"
Jul 30 18:34:23.511988 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:23.511951    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bsw46"]
Jul 30 18:34:27.214809 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:27.214779    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-988fbf677-xwmz2_114d6a7b-721a-4afe-9e65-baed75cdac37/authorino/0.log"
Jul 30 18:34:33.778528 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:33.778499    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-975dfc96f-jqnnm_bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5/copy-manifests/0.log"
Jul 30 18:34:33.786018 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:33.785993    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-975dfc96f-jqnnm_bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5/manager/0.log"
Jul 30 18:34:34.537433 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:34.537389    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757255-xvh7s_b00295f0-b9cd-4ddf-bcc8-f7d56ff5291d/cleanup/0.log"
Jul 30 18:34:34.653638 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:34.653606    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757270-ccbp4_33b84511-0c3b-4867-a75b-08600da6ec86/cleanup/0.log"
Jul 30 18:34:36.239018 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:36.238987    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-988fbf677-xwmz2_114d6a7b-721a-4afe-9e65-baed75cdac37/authorino/0.log"
Jul 30 18:34:36.602220 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:36.602143    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rw2v5_ca8efe4d-847c-4094-9525-93c872be4d72/kuadrant-console-plugin/0.log"
Jul 30 18:34:36.990202 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:36.990175    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bsw46_75d1665e-e96a-4ffd-bf64-1717f8b5fe01/limitador/0.log"
Jul 30 18:34:37.723670 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:37.723634    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff87f57bc-fgzpz_0e0bd348-db23-4d8a-b00e-26f19951337f/kube-auth-proxy/0.log"
Jul 30 18:34:38.811840 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:38.811807    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-rqgxz_2cb72f7a-33dd-4551-8d43-e95e3529932d/main/0.log"
Jul 30 18:34:39.303408 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:39.303373    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-vd948_633f6680-958b-4e85-896a-14fbe50e0ef7/main/0.log"
Jul 30 18:34:48.434740 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:48.434712    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6g9p2_e5017c50-4a74-45ad-8f74-259e8bbb2eca/global-pull-secret-syncer/0.log"
Jul 30 18:34:48.618609 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:48.618577    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hm9n7_8b871e5f-ae5f-4844-9da9-ae39290151ed/konnectivity-agent/0.log"
Jul 30 18:34:48.722024 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:48.721991    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-250.ec2.internal_cf942a6c196015e0d1cf3112ad1a0b12/haproxy/0.log"
Jul 30 18:34:54.091842 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:54.091753    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-988fbf677-xwmz2_114d6a7b-721a-4afe-9e65-baed75cdac37/authorino/0.log"
Jul 30 18:34:54.192021 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:54.191984    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rw2v5_ca8efe4d-847c-4094-9525-93c872be4d72/kuadrant-console-plugin/0.log"
Jul 30 18:34:54.380542 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:54.380447    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bsw46_75d1665e-e96a-4ffd-bf64-1717f8b5fe01/limitador/0.log"
Jul 30 18:34:56.437282 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.437227    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-wp68z_5d7ca8bb-1ce1-4349-a438-6a6e6ab1e2eb/cluster-monitoring-operator/0.log"
Jul 30 18:34:56.569730 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.569638    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58fb575bcc-7qjmz_5e8677d2-977b-445f-9898-a9b71f2963a2/metrics-server/0.log"
Jul 30 18:34:56.598391 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.598365    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-895qz_d9589ec6-83cc-4ecc-b242-cbf95d65f336/monitoring-plugin/0.log"
Jul 30 18:34:56.633085 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.633058    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-798jf_e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9/node-exporter/0.log"
Jul 30 18:34:56.655718 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.655690    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-798jf_e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9/kube-rbac-proxy/0.log"
Jul 30 18:34:56.679099 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.679074    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-798jf_e9c8b9c7-aa40-44b5-b684-c54cdfeb6ec9/init-textfile/0.log"
Jul 30 18:34:56.956739 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.956714    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/prometheus/0.log"
Jul 30 18:34:56.977494 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.977465    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/config-reloader/0.log"
Jul 30 18:34:56.999258 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:56.999235    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/thanos-sidecar/0.log"
Jul 30 18:34:57.020885 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:57.020855    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/kube-rbac-proxy-web/0.log"
Jul 30 18:34:57.043032 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:57.043009    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/kube-rbac-proxy/0.log"
Jul 30 18:34:57.063976 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:57.063954    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/kube-rbac-proxy-thanos/0.log"
Jul 30 18:34:57.085840 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:57.085813    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c1232e94-68f7-45b9-b870-d7f03c45ac02/init-config-reloader/0.log"
Jul 30 18:34:58.308057 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.308020    2538 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"]
Jul 30 18:34:58.308461 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.308358    2538 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd60ca2-9434-4ae6-be70-4a75b51ea84c" containerName="revoke-keys"
Jul 30 18:34:58.308461 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.308369    2538 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd60ca2-9434-4ae6-be70-4a75b51ea84c" containerName="revoke-keys"
Jul 30 18:34:58.308461 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.308428    2538 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd60ca2-9434-4ae6-be70-4a75b51ea84c" containerName="revoke-keys"
Jul 30 18:34:58.311886 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.311855    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.314695 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.314675    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vp2v8\"/\"kube-root-ca.crt\""
Jul 30 18:34:58.316105 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.316083    2538 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vp2v8\"/\"default-dockercfg-pj59w\""
Jul 30 18:34:58.316210 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.316090    2538 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vp2v8\"/\"openshift-service-ca.crt\""
Jul 30 18:34:58.320238 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.320218    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"]
Jul 30 18:34:58.480754 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.480723    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-lib-modules\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.480754 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.480758    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-podres\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.481049 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.480775    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjq2v\" (UniqueName: \"kubernetes.io/projected/db94f40b-fa21-4731-a75f-0a13c55ffdea-kube-api-access-wjq2v\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.481049 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.480804    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-sys\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.481049 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.480955    2538 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-proc\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582033 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.581953    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-lib-modules\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582033 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.581987    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-podres\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582033 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582005    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjq2v\" (UniqueName: \"kubernetes.io/projected/db94f40b-fa21-4731-a75f-0a13c55ffdea-kube-api-access-wjq2v\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582033 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582035    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-sys\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582360 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582108    2538 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-proc\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582360 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582128    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-podres\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582360 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582133    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-lib-modules\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582360 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582133    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-sys\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.582360 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.582212    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db94f40b-fa21-4731-a75f-0a13c55ffdea-proc\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.589748 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.589720    2538 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjq2v\" (UniqueName: \"kubernetes.io/projected/db94f40b-fa21-4731-a75f-0a13c55ffdea-kube-api-access-wjq2v\") pod \"perf-node-gather-daemonset-8j7f5\" (UID: \"db94f40b-fa21-4731-a75f-0a13c55ffdea\") " pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.622452 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.622422    2538 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:58.751600 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:58.751573    2538 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"]
Jul 30 18:34:58.754362 ip-10-0-137-250 kubenswrapper[2538]: W0730 18:34:58.754330    2538 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb94f40b_fa21_4731_a75f_0a13c55ffdea.slice/crio-0595863a5499f1387fde36a72cba6b586290ff8aafd62f0e65792914944aa0f2 WatchSource:0}: Error finding container 0595863a5499f1387fde36a72cba6b586290ff8aafd62f0e65792914944aa0f2: Status 404 returned error can't find the container with id 0595863a5499f1387fde36a72cba6b586290ff8aafd62f0e65792914944aa0f2
Jul 30 18:34:59.240124 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:59.240089    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/2.log"
Jul 30 18:34:59.246791 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:59.246767    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l4bg4_914923c1-dbde-401a-97f8-f63444f8fed5/console-operator/3.log"
Jul 30 18:34:59.415979 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:59.415935    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5" event={"ID":"db94f40b-fa21-4731-a75f-0a13c55ffdea","Type":"ContainerStarted","Data":"86c487e64dc0bdb426197dfaba65768cf984cb941e4c48c5381de85652e93aad"}
Jul 30 18:34:59.416451 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:59.416026    2538 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5" event={"ID":"db94f40b-fa21-4731-a75f-0a13c55ffdea","Type":"ContainerStarted","Data":"0595863a5499f1387fde36a72cba6b586290ff8aafd62f0e65792914944aa0f2"}
Jul 30 18:34:59.416451 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:59.416050    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:34:59.432251 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:34:59.432204    2538 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5" podStartSLOduration=1.432188927 podStartE2EDuration="1.432188927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 18:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 18:34:59.43080209 +0000 UTC m=+4081.156486394" watchObservedRunningTime="2026-07-30 18:34:59.432188927 +0000 UTC m=+4081.157873267"
Jul 30 18:35:00.388436 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:00.388390    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-bzctf_fc2787c0-180b-4b79-868d-302480799706/volume-data-source-validator/0.log"
Jul 30 18:35:01.515062 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:01.515005    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdtrv_a6236b53-0777-4fb6-ac34-7760b266b16a/dns/0.log"
Jul 30 18:35:01.538341 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:01.538318    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sdtrv_a6236b53-0777-4fb6-ac34-7760b266b16a/kube-rbac-proxy/0.log"
Jul 30 18:35:01.614237 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:01.614194    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hd6zk_664c5959-7ccc-4146-aec3-39a123ea1822/dns-node-resolver/0.log"
Jul 30 18:35:02.310152 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:02.310121    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wstkm_98e386c8-3e80-41f4-ad02-76680f052a4a/node-ca/0.log"
Jul 30 18:35:03.571980 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:03.571946    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff87f57bc-fgzpz_0e0bd348-db23-4d8a-b00e-26f19951337f/kube-auth-proxy/0.log"
Jul 30 18:35:04.679986 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:04.679951    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlrgr_0f006530-aef1-40cf-8922-26ad8c96bc1b/serve-healthcheck-canary/0.log"
Jul 30 18:35:05.333892 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:05.333837    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k894c_fe4e3c96-4928-4da3-a629-065e09c3f9f9/kube-rbac-proxy/0.log"
Jul 30 18:35:05.355495 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:05.355455    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k894c_fe4e3c96-4928-4da3-a629-065e09c3f9f9/exporter/0.log"
Jul 30 18:35:05.378486 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:05.378451    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k894c_fe4e3c96-4928-4da3-a629-065e09c3f9f9/extractor/0.log"
Jul 30 18:35:05.431382 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:05.431355    2538 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vp2v8/perf-node-gather-daemonset-8j7f5"
Jul 30 18:35:08.527407 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:08.527319    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-975dfc96f-jqnnm_bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5/manager/0.log"
Jul 30 18:35:08.553933 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:08.553910    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-975dfc96f-jqnnm_bf065dd6-d6ce-4bb1-85fe-75fdf14a14a5/copy-manifests/0.log"
Jul 30 18:35:09.487433 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:09.487399    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff87f57bc-fgzpz_0e0bd348-db23-4d8a-b00e-26f19951337f/kube-auth-proxy/0.log"
Jul 30 18:35:09.854791 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:09.854757    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cdfbb974d-fzl5q_775e67db-22a6-4135-9cd5-a7d2378b0802/manager/0.log"
Jul 30 18:35:09.913310 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:09.913283    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f6s6m_7c3db214-b188-4e3b-a1f1-5d8ca72e8521/openshift-lws-operator/0.log"
Jul 30 18:35:11.342264 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:11.342228    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6ff87f57bc-fgzpz_0e0bd348-db23-4d8a-b00e-26f19951337f/kube-auth-proxy/0.log"
Jul 30 18:35:14.833185 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:14.833156    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-6qt2c_0bcfd972-babc-46bd-ae74-d3b92d8e9ad7/migrator/0.log"
Jul 30 18:35:14.856144 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:14.856113    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-6qt2c_0bcfd972-babc-46bd-ae74-d3b92d8e9ad7/graceful-termination/0.log"
Jul 30 18:35:15.235515 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:15.235467    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6_1d450d29-2fd9-43f9-82be-fe0ba8030a77/kube-storage-version-migrator-operator/1.log"
Jul 30 18:35:15.237304 ip-10-0-137-250 kubenswrapper[2538]: I0730 18:35:15.237275    2538 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vqnq6_1d450d29-2fd9-43f9-82be-fe0ba8030a77/kube-storage-version-migrator-operator/0.log"